-- Logs begin at Tue 2022-08-09 06:20:07 UTC, end at Tue 2022-08-09 07:32:46 UTC. -- Aug 09 06:55:08.573976 dv-cinder-852514-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 09 06:55:08.585422 dv-cinder-852514-1-smb devstack@keystone.service[80185]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 09 06:55:08.587430 dv-cinder-852514-1-smb devstack@keystone.service[80185]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 06:55:08 2022] *** Aug 09 06:55:08.587430 dv-cinder-852514-1-smb devstack@keystone.service[80185]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 06:55:08.587430 dv-cinder-852514-1-smb devstack@keystone.service[80185]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 06:55:08.587430 dv-cinder-852514-1-smb devstack@keystone.service[80185]: nodename: dv-cinder-852514-1-smb Aug 09 06:55:08.587430 dv-cinder-852514-1-smb devstack@keystone.service[80185]: machine: x86_64 Aug 09 06:55:08.587430 dv-cinder-852514-1-smb devstack@keystone.service[80185]: clock source: unix Aug 09 06:55:08.587430 dv-cinder-852514-1-smb devstack@keystone.service[80185]: pcre jit disabled Aug 09 06:55:08.587430 dv-cinder-852514-1-smb devstack@keystone.service[80185]: detected number of CPU cores: 4 Aug 09 06:55:08.587430 dv-cinder-852514-1-smb devstack@keystone.service[80185]: current working directory: / Aug 09 06:55:08.587430 dv-cinder-852514-1-smb devstack@keystone.service[80185]: detected binary path: /usr/bin/uwsgi-core Aug 09 06:55:08.587959 dv-cinder-852514-1-smb devstack@keystone.service[80185]: your processes number limit is 47680 Aug 09 06:55:08.587959 dv-cinder-852514-1-smb devstack@keystone.service[80185]: your memory page size is 4096 bytes Aug 09 06:55:08.587959 dv-cinder-852514-1-smb devstack@keystone.service[80185]: detected max file descriptor number: 2048 Aug 09 06:55:08.587959 dv-cinder-852514-1-smb devstack@keystone.service[80185]: lock engine: pthread robust mutexes Aug 09 06:55:08.587959 dv-cinder-852514-1-smb devstack@keystone.service[80185]: thunder lock: enabled Aug 09 06:55:08.587959 dv-cinder-852514-1-smb devstack@keystone.service[80185]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 09 06:55:08.587959 dv-cinder-852514-1-smb devstack@keystone.service[80185]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 06:55:08.628671 dv-cinder-852514-1-smb devstack@keystone.service[80185]: Python main interpreter initialized at 0x557b3a7e79c0 Aug 09 06:55:08.628671 dv-cinder-852514-1-smb devstack@keystone.service[80185]: python threads support enabled Aug 09 06:55:08.628671 dv-cinder-852514-1-smb devstack@keystone.service[80185]: your server socket listen backlog is limited to 100 connections Aug 09 06:55:08.628671 dv-cinder-852514-1-smb devstack@keystone.service[80185]: your mercy for graceful operations on workers is 90 seconds Aug 09 06:55:08.629028 dv-cinder-852514-1-smb devstack@keystone.service[80185]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 06:55:08.629092 dv-cinder-852514-1-smb devstack@keystone.service[80185]: *** Operational MODE: preforking *** Aug 09 06:55:08.629369 dv-cinder-852514-1-smb devstack@keystone.service[80185]: *** uWSGI is running in multiple interpreter mode *** Aug 09 06:55:08.629369 dv-cinder-852514-1-smb devstack@keystone.service[80185]: spawned uWSGI master process (pid: 80185) Aug 09 06:55:08.631756 dv-cinder-852514-1-smb devstack@keystone.service[80185]: spawned uWSGI worker 1 (pid: 80233, cores: 1) Aug 09 06:55:08.631756 dv-cinder-852514-1-smb devstack@keystone.service[80185]: spawned uWSGI worker 2 (pid: 80234, cores: 1) Aug 09 06:55:08.631756 dv-cinder-852514-1-smb devstack@keystone.service[80185]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 06:55:08.629537 dv-cinder-852514-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 09 06:55:14.144116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 06:55:14.144116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: from cryptography.utils import int_from_bytes Aug 09 06:55:14.144931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 06:55:14.144931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: from cryptography.utils import int_from_bytes Aug 09 06:55:14.149933 dv-cinder-852514-1-smb devstack@keystone.service[80233]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 06:55:14.149933 dv-cinder-852514-1-smb devstack@keystone.service[80233]: from cryptography.utils import int_from_bytes Aug 09 06:55:14.150371 dv-cinder-852514-1-smb devstack@keystone.service[80233]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 06:55:14.150371 dv-cinder-852514-1-smb devstack@keystone.service[80233]: from cryptography.utils import int_from_bytes Aug 09 06:55:14.194450 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 06:55:14.194641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 06:55:14.194833 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] command line args: [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 06:55:14.195129 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 06:55:14.195305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ================================================================================ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 06:55:14.195556 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] admin_token = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.195797 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] config_dir = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.195983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.196169 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] config_source = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.196347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] debug = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.196543 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.197716 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.197716 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.197716 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.197716 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.197970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.197970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_config_append = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.198084 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.198262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_dir = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.198423 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.198654 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.198898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.198991 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 06:55:14.199111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 06:55:14.199228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.199327 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] command line args: [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 06:55:14.199404 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.199560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.199650 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 06:55:14.199733 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.199807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ================================================================================ {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 06:55:14.199963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.200055 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] admin_token = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.200203 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.200278 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] config_dir = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.200387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.200461 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.200572 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] config_source = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.200659 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.200762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] debug = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.200847 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.200958 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.201099 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.201178 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.201306 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.201408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.201546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.201648 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.201830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.201939 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.202077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.202443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.202630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] publish_errors = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.202752 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_config_append = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.202848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.202927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.203075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.203235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_dir = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.203343 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.203474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_file = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.203600 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.203717 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.203864 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.203972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.204111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] standard_threads = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.204221 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.204597 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.204683 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.204767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.204875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.204955 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.205027 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.205103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_journal = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.205213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.205293 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_json = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.205293 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_stderr = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.205424 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.205502 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_syslog = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.205573 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.205654 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.205730 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.205904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.205991 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.206124 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.206218 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.206378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.206465 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.206614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.206696 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.206862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.207005 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.207122 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.207392 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.207485 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.207569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] publish_errors = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.207676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.207786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.208013 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.208091 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.208190 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.208354 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.208433 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.208649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.208725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.208879 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] standard_threads = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.208969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.209107 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.209260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.209339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.209506 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.209589 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.209668 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] use_journal = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.209841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] use_json = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.209981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.210064 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] use_stderr = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.210136 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.210212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] use_syslog = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.210390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:55:14.210469 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.210641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.210720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.210879 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.210997 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.211158 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.211348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.211438 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.211632 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.211717 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.211867 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.211993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.212111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.212343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.212428 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.212587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.212692 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.212844 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.213022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.213102 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.213277 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.213354 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.213519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.213605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.213753 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.213889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.213996 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.214193 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.214278 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.214456 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.214541 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.214708 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.214819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.214963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.215129 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.215224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.215425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.215504 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.215692 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.215771 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.215960 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.216049 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.216210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.216289 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.216454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.216531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.216681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.216760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.216908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.216993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.217134 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.217214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.217361 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.217439 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.217625 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.217702 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.217860 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.218088 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.218309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.218396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.218549 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.218635 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.218775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.218859 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.219001 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.219076 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.219248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.219339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.219482 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.219561 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.219714 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.219801 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.219959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.220038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.220186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.220264 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.220418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.220497 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.220646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.220732 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.220875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.220954 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.221105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.221184 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.221334 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.221419 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.221558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.221635 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.221800 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.221879 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.222026 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.222103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.222259 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.222375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.222487 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.222557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.222722 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.222801 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.222958 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.223033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.223326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.223456 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.223604 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.223715 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.223824 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.223960 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.223960 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.224180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.224321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.224438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.224585 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.224694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.224802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.224948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.225057 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.225165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.225329 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.225438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.225594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.225716 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.225855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.225963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.226071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.226217 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.226217 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.226420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.226420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.226662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.226770 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.226903 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.227015 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.227184 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.227294 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.227436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.227436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.227641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.227750 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.227867 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.227976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.228082 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.228158 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.228230 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.228336 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.228418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.228491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.228562 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.228638 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.228754 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.228828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.228907 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.228980 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.229050 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.229121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.229191 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.229260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.229338 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.229446 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.229521 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.229670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.229750 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.229924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.230088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.230165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.230236 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.230356 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.230436 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.230587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.230676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.230832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.230927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.231065 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.231189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.231335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.231420 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.231575 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.231666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.231809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.231889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.232036 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.external = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.232114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.232264 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.232355 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.232491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.232576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.232718 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.232798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.232946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.233027 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.password = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.233178 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.233898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.token = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.234148 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.234394 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.234530 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.234647 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.234778 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.234888 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.235009 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.235179 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.235269 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.235395 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.235508 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.235654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.235741 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.235919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.236000 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.236161 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.236249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.236393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.external = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.236474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.236628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.236710 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.236877 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.236968 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.237118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.237199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.237352 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.237432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.password = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.237578 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.token = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.237664 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.237814 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.237895 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.238046 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.238126 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.238290 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.238378 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.238517 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.238599 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.238761 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.238842 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.239004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.239122 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.239256 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.239338 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.239490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.239571 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.239737 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.239833 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.239979 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.240067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.240223 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.240303 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.240458 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.240547 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.240686 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.240766 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.240918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.240997 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.241151 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.241238 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.241402 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.241484 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.241635 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.241717 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.241883 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.241970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.242114 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.242193 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.242361 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.242443 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.242594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.242683 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.242840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.242933 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.243095 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.243211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.243342 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.243433 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.243576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.243658 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.243820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.243899 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.244046 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.244133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.244279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.244360 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.244524 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.244605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.244749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.244826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.244982 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.245061 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.245212 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.245303 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.245438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.245521 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.245678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.245760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.245919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.245998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.246154 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.246235 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.246405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.246495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.246643 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.246722 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.246875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.246962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.247148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.247236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.247378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.247461 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.247604 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.247685 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.247836 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.247916 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.248063 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.248143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.248295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.248377 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.248532 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.248610 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.248780 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.249500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.249751 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.249992 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.250072 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.250247 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.250327 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.250496 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.250584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.250731 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.250812 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.250976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.251064 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.251247 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.251341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.251479 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.251560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.251713 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.251794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.251942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.252035 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.252179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.252266 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.252413 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.252490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.252642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.252738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.252875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.252956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.253109 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.253188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.253348 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.253436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.253592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.253671 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.253819 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.253898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.254045 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.254132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.254291 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.254371 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.254522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.254601 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.254755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.254845 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.254988 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.255068 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.255238 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.255319 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.255466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.255558 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.255699 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.255785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.255936 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.256017 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.256169 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.256256 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.256404 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.256484 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.256640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.256720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.256873 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.256962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.257105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.257185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.257331 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.257411 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.257563 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.257645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.257790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.257869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.258022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.258114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.258250 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.258338 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.258489 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.258568 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.258723 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.258803 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.258958 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.259040 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.259212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.259296 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.259451 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.259531 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.259677 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.259759 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.259920 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.259998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.260155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.260236 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.260390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.260472 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.260621 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.260701 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.260859 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.260939 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.261076 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.261156 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.261309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.261390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.261542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.261622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.261775 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.261857 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.262003 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.262083 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.262243 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.262322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.262476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.262565 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.262709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.262790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.262941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.263021 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.263206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.263291 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.263435 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.263513 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.263661 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.263740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.263896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.263979 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.264128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.264206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.264364 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.264445 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.264912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.265106 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.265200 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.265360 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.265442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.265612 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.265703 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.265846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.265926 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.266094 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.266175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.266322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.266415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.266556 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.266636 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.266788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] role.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.266869 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.267019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.267128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] role.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.267287 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.267369 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.267533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.267614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.267774 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.267868 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.268006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.268088 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.268243 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.268324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.268483 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.268638 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.268715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.268786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.268957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.269038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.269190 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.269278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.269418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.269498 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.269662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.269743 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.269894 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.269981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.270140 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.270230 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.270373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.270454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.270609 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.270759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.270840 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] role.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.270993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.271074 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] role.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.271262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.271357 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.271510 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.271592 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.271787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.271870 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.272032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.272122 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.272276 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.272357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.272521 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.272602 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.272765 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.272855 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.273009 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.273090 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.273243 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.273399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.273478 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.273557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.273694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.273774 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.273936 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.274015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.274179 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.274268 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.274421 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.274509 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.274657 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.274806 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.274891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.275037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.275183 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.275310 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.275391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.275559 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.275640 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.275804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.275888 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.276040 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.276119 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.276272 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.276360 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.276526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.276625 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.276762 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.276879 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.277008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.277119 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.277249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.277353 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.277494 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.277576 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.277727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.277815 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.277962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.278044 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.278195 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.278275 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.278439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.278528 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.278684 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.278766 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.278911 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.278992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.279178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.279275 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.279426 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.279506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.279662 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.279743 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.279908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.280000 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.280167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.280276 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.280448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.280689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.280868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.280949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.281124 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.281214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.281363 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.281444 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.281594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.281673 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.281835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.281924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.282069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.282150 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.282303 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.282382 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.282533 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.282621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.282765 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.282844 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.282998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.283078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.283262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.283355 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.283491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.283570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.283725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.283804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.283959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.284048 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.284123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 06:55:14.284266 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.connection = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.284521 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.284766 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.285003 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.285243 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.285477 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.285717 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.285951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.286184 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.286426 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.286660 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.286900 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.287154 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.287401 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.287635 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.287877 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.288108 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.288347 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.288580 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:55:14.288748 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 06:55:14.313822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.314048 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.314268 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.315481 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.315711 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.315936 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.323909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.325578 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.356077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.356302 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.356394 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.356535 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.409015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.411232 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.459607 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.459836 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.461768 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.462004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.523055 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.523310 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.523529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.523745 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.523828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.523959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.524045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.524171 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.524256 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.524385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.524601 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.524815 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.547751 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.548005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.548229 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.548315 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.548449 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.548536 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.548663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.548748 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.548871 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.548970 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.549079 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.549162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.549290 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.549509 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.559963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.560192 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.573363 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.573611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.573815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.573912 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.574036 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.574121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.574252 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.574335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.574458 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.574549 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.574667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.574750 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.574873 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.575106 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 06:55:14.591754 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.591961 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 06:55:14.592233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.592319 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.592440 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 06:55:14.592520 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 06:55:14.593282 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.593541 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.593725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.593810 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.593929 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 06:55:14.594021 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.594204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.594463 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.594716 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.594969 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.605290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.605576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.605842 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.606122 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.606206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.606434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.606704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.606985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.613060 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.614391 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.616117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.616405 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.616690 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.618857 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.618857 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.619039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.619149 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.619244 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.619323 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.619397 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.619471 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.619544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.619626 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.619702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.619776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.619848 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.619920 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.620001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.620001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.620001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.620001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.620249 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.643041 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.644582 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.644745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.644874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.646225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.646509 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.649442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.649726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.650005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.651058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.651368 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.651652 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.656696 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.656983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.658695 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.658985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.661022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.661269 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.661548 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.661829 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.662106 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.662382 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.662653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.662922 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.663076 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.663368 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.663663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.663945 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.664230 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.664512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.664789 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.665054 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.678431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.678706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.681313 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.681595 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.682590 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.685682 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.685769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.685991 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.689807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.690104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.691050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.694218 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.694468 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.697365 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.697650 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.697733 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.697948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.698246 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.698525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.698815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.700790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.701090 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.701376 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.701663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.701967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.703359 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.715549 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.715832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.716094 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.716356 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.719911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.720212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.720511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.720804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.723520 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.725059 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.725334 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.727632 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.728223 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.728509 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.728810 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.729096 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.729185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.729371 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.729455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.732234 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.732520 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.732816 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.733112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.733576 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.740769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.741055 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.741334 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.741613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.741890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.742163 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.742435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.744921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.745207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.745488 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.745771 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.746053 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.746330 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.746606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.759520 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.762447 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.764068 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.765480 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.767043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.767564 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.768550 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.768833 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.769127 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.770464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.772058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.773552 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.773836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.774134 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.775485 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.777088 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.780022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.780847 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.781129 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.781406 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.781488 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.783053 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.785992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.786283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.786566 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.786840 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.789350 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.789641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.789924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.794915 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.795237 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.795519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.797200 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.797484 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.797765 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.798043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.798317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.798589 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.798862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.799185 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.799560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.799840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.800113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.800384 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.800654 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.800925 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.802857 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 06:55:14.803165 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.803457 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.803735 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.804010 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.804290 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.804561 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.804835 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.805214 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.805496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.805767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.806040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.806314 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.806573 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 06:55:14.834707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557b3a7e79c0 pid: 80234 (default app) Aug 09 06:55:14.837948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d6962-00e6-466a-9c23-eb38e620367b None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:14.838234 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d6962-00e6-466a-9c23-eb38e620367b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:14.838504 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d6962-00e6-466a-9c23-eb38e620367b None None] PATH_INFO: `/v3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:14.841001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557b3a7e79c0 pid: 80233 (default app) Aug 09 06:55:14.842838 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Tue Aug 9 06:55:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:22.450545 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ebac2-e043-4a11-a7ea-155e408aba2b None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:22.451148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ebac2-e043-4a11-a7ea-155e408aba2b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:22.451148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ebac2-e043-4a11-a7ea-155e408aba2b None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:22.455746 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:55:22.460846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20620a51-236b-45c1-9f3f-8227c95a1936 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:22.461245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20620a51-236b-45c1-9f3f-8227c95a1936 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:22.461394 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20620a51-236b-45c1-9f3f-8227c95a1936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:22.530911 dv-cinder-852514-1-smb devstack@keystone.service[80234]: INFO dbcounter [None req-20620a51-236b-45c1-9f3f-8227c95a1936 None None] Registered counter for database keystone Aug 09 06:55:22.550225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG oslo_db.sqlalchemy.engines [None req-20620a51-236b-45c1-9f3f-8227c95a1936 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 06:55:22.556398 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writer thread running {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 06:55:22.733450 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG passlib.handlers.bcrypt [None req-20620a51-236b-45c1-9f3f-8227c95a1936 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80234) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 09 06:55:22.733866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG passlib.handlers.bcrypt [None req-20620a51-236b-45c1-9f3f-8227c95a1936 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80234) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 09 06:55:22.788735 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-20620a51-236b-45c1-9f3f-8227c95a1936 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:22.790332 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-20620a51-236b-45c1-9f3f-8227c95a1936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:22.919339 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 09 06:55:23.068571 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ebac2-e043-4a11-a7ea-155e408aba2b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:23.137784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: INFO dbcounter [None req-7f2ebac2-e043-4a11-a7ea-155e408aba2b None None] Registered counter for database keystone Aug 09 06:55:23.159576 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG oslo_db.sqlalchemy.engines [None req-7f2ebac2-e043-4a11-a7ea-155e408aba2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 06:55:23.165687 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writer thread running {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 06:55:23.282875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ebac2-e043-4a11-a7ea-155e408aba2b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:23.287052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db6db2-a12f-4b19-96e4-7767b21f5f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:23.287686 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db6db2-a12f-4b19-96e4-7767b21f5f29 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:23.287962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db6db2-a12f-4b19-96e4-7767b21f5f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:23.288232 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db6db2-a12f-4b19-96e4-7767b21f5f29 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:23.296500 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db6db2-a12f-4b19-96e4-7767b21f5f29 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:23.359922 dv-cinder-852514-1-smb devstack@keystone.service[80233]: WARNING keystone.common.rbac_enforcer.enforcer [None req-87db6db2-a12f-4b19-96e4-7767b21f5f29 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 09 06:55:23.360172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db6db2-a12f-4b19-96e4-7767b21f5f29 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:23.370334 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1324 bytes} [Tue Aug 9 06:55:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 06:55:23.377082 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20620a51-236b-45c1-9f3f-8227c95a1936 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:23.391487 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20620a51-236b-45c1-9f3f-8227c95a1936 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:23.396020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4505f-4445-4572-bd5a-7b7abf07f727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:23.397121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4505f-4445-4572-bd5a-7b7abf07f727 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:23.397402 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4505f-4445-4572-bd5a-7b7abf07f727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:23.397669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4505f-4445-4572-bd5a-7b7abf07f727 admin admin] PATH_INFO: `/v3/projects/7517e8deb7c2455e89af98b08782ec1d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:23.399106 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4505f-4445-4572-bd5a-7b7abf07f727 admin admin] RBAC: Authorizing `identity:get_project(project_id=7517e8deb7c2455e89af98b08782ec1d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:23.450744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: WARNING keystone.common.rbac_enforcer.enforcer [None req-35f4505f-4445-4572-bd5a-7b7abf07f727 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 09 06:55:23.451112 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4505f-4445-4572-bd5a-7b7abf07f727 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:23.456518 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 3/5] 10.222.0.40 () {56 vars in 1207 bytes} [Tue Aug 9 06:55:23 2022] GET /identity/v3/projects/7517e8deb7c2455e89af98b08782ec1d => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:25.435379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984fcb4-0c04-411f-a001-8d5f1cdb5942 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:25.435930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984fcb4-0c04-411f-a001-8d5f1cdb5942 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:25.435930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984fcb4-0c04-411f-a001-8d5f1cdb5942 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:25.440145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 3/6] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:25.445523 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268c963-39fc-4229-ac0b-256f70352a2c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:25.445918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268c963-39fc-4229-ac0b-256f70352a2c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:25.446062 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268c963-39fc-4229-ac0b-256f70352a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:25.468323 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9268c963-39fc-4229-ac0b-256f70352a2c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:25.469800 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9268c963-39fc-4229-ac0b-256f70352a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:25.477409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 09 06:55:25.499106 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984fcb4-0c04-411f-a001-8d5f1cdb5942 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:25.510865 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984fcb4-0c04-411f-a001-8d5f1cdb5942 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:25.515575 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79597131-4a3e-4f5b-960b-259ee9c1f051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:25.516164 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79597131-4a3e-4f5b-960b-259ee9c1f051 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:25.516444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79597131-4a3e-4f5b-960b-259ee9c1f051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:25.516716 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79597131-4a3e-4f5b-960b-259ee9c1f051 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:25.524223 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79597131-4a3e-4f5b-960b-259ee9c1f051 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:25.525966 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79597131-4a3e-4f5b-960b-259ee9c1f051 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:25.535312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1324 bytes} [Tue Aug 9 06:55:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 06:55:25.540474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268c963-39fc-4229-ac0b-256f70352a2c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:25.549265 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268c963-39fc-4229-ac0b-256f70352a2c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:25.553629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db7fa3-9a5a-43c7-96a9-6b1152a82209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:25.554239 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db7fa3-9a5a-43c7-96a9-6b1152a82209 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:25.554516 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db7fa3-9a5a-43c7-96a9-6b1152a82209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:25.554786 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db7fa3-9a5a-43c7-96a9-6b1152a82209 admin admin] PATH_INFO: `/v3/users/bcf6cd86a276482e8265d5687ef8c40a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:25.556128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db7fa3-9a5a-43c7-96a9-6b1152a82209 admin admin] RBAC: Authorizing `identity:get_user(user_id=bcf6cd86a276482e8265d5687ef8c40a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:25.557914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db7fa3-9a5a-43c7-96a9-6b1152a82209 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:25.559434 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 5/9] 10.222.0.40 () {56 vars in 1198 bytes} [Tue Aug 9 06:55:25 2022] GET /identity/v3/users/bcf6cd86a276482e8265d5687ef8c40a => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:27.627813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c7b18-f95e-4b4d-b26a-7cbe357191cc None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:27.628350 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c7b18-f95e-4b4d-b26a-7cbe357191cc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:27.628350 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c7b18-f95e-4b4d-b26a-7cbe357191cc None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:27.629685 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:27.635192 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c9075-def2-421c-8af4-a265e8264cb7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:27.635591 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c9075-def2-421c-8af4-a265e8264cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:27.635744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c9075-def2-421c-8af4-a265e8264cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:27.650942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00da268-8c00-4a57-8bec-56709eaf0725 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:27.651269 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00da268-8c00-4a57-8bec-56709eaf0725 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:27.651545 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00da268-8c00-4a57-8bec-56709eaf0725 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:27.652857 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 6/11] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:55:27.653896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4f3c9075-def2-421c-8af4-a265e8264cb7 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:27.655345 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4f3c9075-def2-421c-8af4-a265e8264cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:27.658028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a830b-e569-4220-af31-02034f1bf196 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:27.658311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a830b-e569-4220-af31-02034f1bf196 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:27.658587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a830b-e569-4220-af31-02034f1bf196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:27.701293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG passlib.handlers.bcrypt [None req-314a830b-e569-4220-af31-02034f1bf196 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80233) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 09 06:55:27.701749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG passlib.handlers.bcrypt [None req-314a830b-e569-4220-af31-02034f1bf196 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80233) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 09 06:55:27.735467 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:55:27.747393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-314a830b-e569-4220-af31-02034f1bf196 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:27.749497 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-314a830b-e569-4220-af31-02034f1bf196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:27.758187 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c9075-def2-421c-8af4-a265e8264cb7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:27.781811 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:27.848637 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:27.860427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c9075-def2-421c-8af4-a265e8264cb7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:27.870737 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a830b-e569-4220-af31-02034f1bf196 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:27.895844 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ccfbc-3136-45de-bec3-4f7b93efc4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:27.896409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ccfbc-3136-45de-bec3-4f7b93efc4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:27.896687 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ccfbc-3136-45de-bec3-4f7b93efc4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:27.896961 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ccfbc-3136-45de-bec3-4f7b93efc4e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:27.908838 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ccfbc-3136-45de-bec3-4f7b93efc4e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:27.917521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-fd2ccfbc-3136-45de-bec3-4f7b93efc4e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:55:27.917521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:27.917521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:27.917521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:27.917521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:27.917521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:27.917521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:27.917521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:27.917521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:27.917521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:27.917521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:27.917521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:27.917521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:27.917521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:27.917521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:27.917521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:27.918439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:27.918439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:27.918439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:27.918439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:27.918439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:27.918439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:27.918439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:27.918439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:27.918439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:27.918439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:27.918439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:27.918439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:27.918439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:27.918439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:27.918439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:27.918439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:27.919298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:27.919298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:27.919298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:27.919298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:27.919298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:27.919298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:27.919298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:27.919298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:27.919298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:27.919298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:27.919298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:55:27.919298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:55:27.919298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 7/14] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:55:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:55:27.931671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ccfbc-3136-45de-bec3-4f7b93efc4e8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:27.971691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a830b-e569-4220-af31-02034f1bf196 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:27.974726 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:28.009975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34773883-325f-4287-96ca-4a8fbd9e57ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:28.010822 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34773883-325f-4287-96ca-4a8fbd9e57ff None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:28.011127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34773883-325f-4287-96ca-4a8fbd9e57ff None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:28.011406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34773883-325f-4287-96ca-4a8fbd9e57ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:28.017773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:28.036164 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ccfbc-3136-45de-bec3-4f7b93efc4e8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:28.070198 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dfe75-82c0-427c-bfec-dd4be5c051d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:28.070789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dfe75-82c0-427c-bfec-dd4be5c051d4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:28.071060 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dfe75-82c0-427c-bfec-dd4be5c051d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:28.071383 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dfe75-82c0-427c-bfec-dd4be5c051d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:28.072038 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dfe75-82c0-427c-bfec-dd4be5c051d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:28.072334 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dfe75-82c0-427c-bfec-dd4be5c051d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:28.073706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dfe75-82c0-427c-bfec-dd4be5c051d4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:28.077491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34773883-325f-4287-96ca-4a8fbd9e57ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:28.078993 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34773883-325f-4287-96ca-4a8fbd9e57ff None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:28.084747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 8/15] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:55:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:55:28.090334 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dfe75-82c0-427c-bfec-dd4be5c051d4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:28.180985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:55:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 06:55:28.187684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34773883-325f-4287-96ca-4a8fbd9e57ff None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:28.190768 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:28.287905 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34773883-325f-4287-96ca-4a8fbd9e57ff None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:28.293702 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dfe75-82c0-427c-bfec-dd4be5c051d4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:28.320995 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6c318-d2f3-4bed-912c-c4028355626a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:28.321836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6c318-d2f3-4bed-912c-c4028355626a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:28.322114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6c318-d2f3-4bed-912c-c4028355626a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:28.322378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6c318-d2f3-4bed-912c-c4028355626a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:28.326466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fbd78-3e01-4b84-b3a3-ddbdbafdb14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:28.327638 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fbd78-3e01-4b84-b3a3-ddbdbafdb14d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:28.327915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fbd78-3e01-4b84-b3a3-ddbdbafdb14d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:28.328177 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fbd78-3e01-4b84-b3a3-ddbdbafdb14d None admin] PATH_INFO: `/v3/users/bcf6cd86a276482e8265d5687ef8c40a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:28.329283 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fbd78-3e01-4b84-b3a3-ddbdbafdb14d None admin] RBAC: Authorizing `identity:get_user(user_id=bcf6cd86a276482e8265d5687ef8c40a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:28.330966 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fbd78-3e01-4b84-b3a3-ddbdbafdb14d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:28.332566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 9/17] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:28 2022] GET /identity/v3/users/bcf6cd86a276482e8265d5687ef8c40a => generated 247 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:55:28.337873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fbd78-3e01-4b84-b3a3-ddbdbafdb14d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:28.341077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6c318-d2f3-4bed-912c-c4028355626a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:28.343185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6c318-d2f3-4bed-912c-c4028355626a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:28.352458 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:28.361409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-52b6c318-d2f3-4bed-912c-c4028355626a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:55:28.361409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:28.361409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:28.361409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:28.361409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:28.361409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:28.361409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:28.361409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:28.361409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:28.361409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:28.361409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:28.361409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:28.361409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:55:28.361409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:55:28.361409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:55:28.361409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:55:28.362410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:28.362410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:28.362410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:28.362410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:28.362410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:28.362410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:28.362410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:28.362410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:28.362410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:28.362410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:28.362410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:28.362410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:28.362410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:28.362410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:28.362410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:28.362410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:28.362410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:55:28.363701 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:55:28.363701 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:55:28.363701 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:55:28.363701 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 9/18] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:55:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:55:28.371275 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6c318-d2f3-4bed-912c-c4028355626a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:28.426228 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:28.440149 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fbd78-3e01-4b84-b3a3-ddbdbafdb14d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:28.470504 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6c318-d2f3-4bed-912c-c4028355626a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:28.474329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319e2cf-7ed3-4331-acaa-d57d05c9a85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:28.474962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319e2cf-7ed3-4331-acaa-d57d05c9a85d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:28.475262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319e2cf-7ed3-4331-acaa-d57d05c9a85d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:28.475535 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319e2cf-7ed3-4331-acaa-d57d05c9a85d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:28.476644 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319e2cf-7ed3-4331-acaa-d57d05c9a85d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:28.478092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319e2cf-7ed3-4331-acaa-d57d05c9a85d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:28.479688 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 10/19] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:55:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:55:28.486025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319e2cf-7ed3-4331-acaa-d57d05c9a85d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:28.504017 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac60d7f-10a5-4ec8-aac4-ea2e6e7499f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:28.504613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac60d7f-10a5-4ec8-aac4-ea2e6e7499f4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:28.504892 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac60d7f-10a5-4ec8-aac4-ea2e6e7499f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:28.505154 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac60d7f-10a5-4ec8-aac4-ea2e6e7499f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:28.505784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac60d7f-10a5-4ec8-aac4-ea2e6e7499f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:28.506080 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac60d7f-10a5-4ec8-aac4-ea2e6e7499f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:28.507463 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac60d7f-10a5-4ec8-aac4-ea2e6e7499f4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:28.524271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 10/20] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:55:28.569256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:28.590148 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319e2cf-7ed3-4331-acaa-d57d05c9a85d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:28.629549 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddecb8-801b-4971-8cb6-df66d98137e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:28.630338 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddecb8-801b-4971-8cb6-df66d98137e7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:28.630720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddecb8-801b-4971-8cb6-df66d98137e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:28.631000 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddecb8-801b-4971-8cb6-df66d98137e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:28.631768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddecb8-801b-4971-8cb6-df66d98137e7 None admin] RBAC: Adding query filter params (role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.domain.id=default, user.id=bcf6cd86a276482e8265d5687ef8c40a) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:28.632065 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddecb8-801b-4971-8cb6-df66d98137e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:28.633541 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddecb8-801b-4971-8cb6-df66d98137e7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:28.641322 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 11/21] 10.222.0.40 () {56 vars in 1322 bytes} [Tue Aug 9 06:55:28 2022] GET /identity/v3/role_assignments?user.id=bcf6cd86a276482e8265d5687ef8c40a&scope.domain.id=default&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:55:30.959967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e3bba-9d3d-4d11-9fa8-d4b884aee398 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:30.960959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e3bba-9d3d-4d11-9fa8-d4b884aee398 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:30.961447 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e3bba-9d3d-4d11-9fa8-d4b884aee398 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:30.962977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 11/22] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:30.968799 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99137fb1-69a6-47ad-ba65-b4080ad77f06 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:30.969578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99137fb1-69a6-47ad-ba65-b4080ad77f06 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:30.970037 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99137fb1-69a6-47ad-ba65-b4080ad77f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:31.000057 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-99137fb1-69a6-47ad-ba65-b4080ad77f06 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:31.001563 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-99137fb1-69a6-47ad-ba65-b4080ad77f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:31.037862 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef944a5c-23fd-4ac7-b516-6e352bd80acf None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:31.038475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef944a5c-23fd-4ac7-b516-6e352bd80acf None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:31.038936 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef944a5c-23fd-4ac7-b516-6e352bd80acf None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:31.040460 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 12/23] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:55:31.045703 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00deafec-1d0f-46e2-905c-72d9fecbb4c5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:31.046317 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00deafec-1d0f-46e2-905c-72d9fecbb4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:31.046779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00deafec-1d0f-46e2-905c-72d9fecbb4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:31.074491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-00deafec-1d0f-46e2-905c-72d9fecbb4c5 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:31.078202 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-00deafec-1d0f-46e2-905c-72d9fecbb4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:31.116078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 12/24] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:55:31.149780 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99137fb1-69a6-47ad-ba65-b4080ad77f06 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:31.178147 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 13/25] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:55:31.213614 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00deafec-1d0f-46e2-905c-72d9fecbb4c5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:31.316293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:31.328252 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:31.340258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99137fb1-69a6-47ad-ba65-b4080ad77f06 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:31.376158 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea2640-eeed-42b4-b611-6f901201836d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:31.376795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea2640-eeed-42b4-b611-6f901201836d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:31.377069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea2640-eeed-42b4-b611-6f901201836d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:31.377336 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea2640-eeed-42b4-b611-6f901201836d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:31.388417 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea2640-eeed-42b4-b611-6f901201836d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:31.390619 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea2640-eeed-42b4-b611-6f901201836d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:31.408305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-baea2640-eeed-42b4-b611-6f901201836d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:55:31.408305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:31.408305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:31.408305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:31.408305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:31.408305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:31.408305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:31.408305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:31.408305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:31.408305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:31.408305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:31.408305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:31.408305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:55:31.408305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:55:31.408305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:55:31.408305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:55:31.409396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:31.409396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:31.409396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:31.409396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:31.409396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:31.409396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:31.409396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:31.409396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:31.409396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:31.409396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:31.409396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:31.409396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:31.409396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:31.409396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:31.409396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:31.409396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:31.409396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:55:31.410409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:55:31.410409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:55:31.410409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:55:31.411847 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 13/26] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:55:31.413210 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9c245-ef23-438a-b00b-92b235da4b20 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:31.413623 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9c245-ef23-438a-b00b-92b235da4b20 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:31.414029 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9c245-ef23-438a-b00b-92b235da4b20 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:31.415423 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 14/27] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:31.419885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9c245-ef23-438a-b00b-92b235da4b20 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:31.527699 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9c245-ef23-438a-b00b-92b235da4b20 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:31.533032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00deafec-1d0f-46e2-905c-72d9fecbb4c5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:31.561917 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:31.565753 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8fe41-03d2-404c-a34d-fe1c6c945067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:31.566556 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8fe41-03d2-404c-a34d-fe1c6c945067 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:31.567033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8fe41-03d2-404c-a34d-fe1c6c945067 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:31.567636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8fe41-03d2-404c-a34d-fe1c6c945067 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:31.568446 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8fe41-03d2-404c-a34d-fe1c6c945067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:31.568963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8fe41-03d2-404c-a34d-fe1c6c945067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:31.570526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8fe41-03d2-404c-a34d-fe1c6c945067 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:31.589874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 15/28] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:31.591678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d10da-8232-4107-b237-e1ec48d4707f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:31.592152 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d10da-8232-4107-b237-e1ec48d4707f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:31.593214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d10da-8232-4107-b237-e1ec48d4707f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:31.612744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-435d10da-8232-4107-b237-e1ec48d4707f None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:31.614246 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-435d10da-8232-4107-b237-e1ec48d4707f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:31.649395 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433368e-1516-48ee-bd6c-e5ea6bf03297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:31.650033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433368e-1516-48ee-bd6c-e5ea6bf03297 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:31.650315 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433368e-1516-48ee-bd6c-e5ea6bf03297 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:31.650606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433368e-1516-48ee-bd6c-e5ea6bf03297 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:31.663126 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433368e-1516-48ee-bd6c-e5ea6bf03297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:31.669784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-7433368e-1516-48ee-bd6c-e5ea6bf03297 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:55:31.669784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:31.669784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:31.669784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:31.669784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:31.669784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:31.669784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:31.669784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:31.669784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:31.669784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:31.669784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:31.669784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:31.669784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:31.669784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:31.669784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:31.669784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:31.670680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:31.670680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:31.670680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:31.670680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:31.670680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:31.670680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:31.670680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:31.670680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:31.670680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:31.670680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:31.670680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:31.670680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:31.670680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:31.670680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:31.670680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:31.670680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:31.671763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:31.671763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:31.671763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:31.671763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:31.671763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:31.671763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:31.671763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:31.671763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:31.671763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:31.671763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:31.671763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:55:31.671763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:55:31.671763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 14/29] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:55:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 458 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:55:31.672468 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433368e-1516-48ee-bd6c-e5ea6bf03297 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:31.695587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 16/30] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:31.697026 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6146bd8-f00d-4a93-807c-323560da088a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:31.697904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6146bd8-f00d-4a93-807c-323560da088a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:31.698401 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6146bd8-f00d-4a93-807c-323560da088a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:31.700271 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 17/31] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:31.701147 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6146bd8-f00d-4a93-807c-323560da088a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:31.838348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6146bd8-f00d-4a93-807c-323560da088a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:31.858734 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:31.879396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b34be2-9dbd-4457-a3e4-250cf6f636ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:31.880913 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b34be2-9dbd-4457-a3e4-250cf6f636ab None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:31.881396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b34be2-9dbd-4457-a3e4-250cf6f636ab None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:31.881857 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b34be2-9dbd-4457-a3e4-250cf6f636ab None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:31.883176 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b34be2-9dbd-4457-a3e4-250cf6f636ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:31.883729 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b34be2-9dbd-4457-a3e4-250cf6f636ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:31.886062 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b34be2-9dbd-4457-a3e4-250cf6f636ab None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:31.898890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 18/32] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:55:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:31.900817 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775d9b-e582-4e9a-a6a8-02add09ac612 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:31.901238 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775d9b-e582-4e9a-a6a8-02add09ac612 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:31.902022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775d9b-e582-4e9a-a6a8-02add09ac612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:31.907955 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433368e-1516-48ee-bd6c-e5ea6bf03297 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:31.915343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:31.924721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d1775d9b-e582-4e9a-a6a8-02add09ac612 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:31.926645 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d1775d9b-e582-4e9a-a6a8-02add09ac612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:31.945764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbf24b-778b-4fa3-9452-12f6d12ba659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:31.946518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbf24b-778b-4fa3-9452-12f6d12ba659 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:31.946907 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbf24b-778b-4fa3-9452-12f6d12ba659 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:31.947311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbf24b-778b-4fa3-9452-12f6d12ba659 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:31.948273 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbf24b-778b-4fa3-9452-12f6d12ba659 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:31.949827 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbf24b-778b-4fa3-9452-12f6d12ba659 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:32.008568 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 19/33] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:32.010064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775d9b-e582-4e9a-a6a8-02add09ac612 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:32.116702 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775d9b-e582-4e9a-a6a8-02add09ac612 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:32.119984 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 15/34] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Aug 9 06:55:31 2022] POST /identity/v3/projects => generated 301 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:55:32.120586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbf24b-778b-4fa3-9452-12f6d12ba659 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:32.128407 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:32.158325 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238873b1-f556-42cd-9b38-23e1327ddc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:32.159432 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238873b1-f556-42cd-9b38-23e1327ddc29 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:32.159955 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238873b1-f556-42cd-9b38-23e1327ddc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:32.160511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238873b1-f556-42cd-9b38-23e1327ddc29 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:32.161393 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238873b1-f556-42cd-9b38-23e1327ddc29 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:32.163196 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238873b1-f556-42cd-9b38-23e1327ddc29 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:32.250001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbf24b-778b-4fa3-9452-12f6d12ba659 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:32.296007 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76cff5-f199-4eb9-b92c-e30f7da40a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:32.296668 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76cff5-f199-4eb9-b92c-e30f7da40a51 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:32.296959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76cff5-f199-4eb9-b92c-e30f7da40a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:32.297285 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76cff5-f199-4eb9-b92c-e30f7da40a51 None admin] PATH_INFO: `/v3/users/bcf6cd86a276482e8265d5687ef8c40a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:32.298938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76cff5-f199-4eb9-b92c-e30f7da40a51 None admin] RBAC: Authorizing `identity:get_user(user_id=bcf6cd86a276482e8265d5687ef8c40a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:32.300610 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76cff5-f199-4eb9-b92c-e30f7da40a51 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:32.302378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 16/35] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:32 2022] GET /identity/v3/users/bcf6cd86a276482e8265d5687ef8c40a => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:32.303264 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76cff5-f199-4eb9-b92c-e30f7da40a51 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:32.325881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 20/36] 10.222.0.40 () {60 vars in 1131 bytes} [Tue Aug 9 06:55:32 2022] POST /identity/v3/roles => generated 225 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:55:32.333071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c016a-740d-461b-bfe5-b42843116632 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:32.333626 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c016a-740d-461b-bfe5-b42843116632 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:32.334090 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c016a-740d-461b-bfe5-b42843116632 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:32.336051 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 21/37] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:32.336976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c016a-740d-461b-bfe5-b42843116632 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:32.342546 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:32.456271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76cff5-f199-4eb9-b92c-e30f7da40a51 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:32.481624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c016a-740d-461b-bfe5-b42843116632 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:32.504224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abc7dc-6819-4ea4-bf36-19b3a6bbcf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:32.505162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abc7dc-6819-4ea4-bf36-19b3a6bbcf1e None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:32.505446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abc7dc-6819-4ea4-bf36-19b3a6bbcf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:32.505721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abc7dc-6819-4ea4-bf36-19b3a6bbcf1e None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:32.506400 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abc7dc-6819-4ea4-bf36-19b3a6bbcf1e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:32.508379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abc7dc-6819-4ea4-bf36-19b3a6bbcf1e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:32.528229 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b37d4a-0bc8-4760-b796-fc07e4772ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:32.528882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b37d4a-0bc8-4760-b796-fc07e4772ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:32.529162 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b37d4a-0bc8-4760-b796-fc07e4772ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:32.529434 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b37d4a-0bc8-4760-b796-fc07e4772ef1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:32.531765 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 17/38] 10.222.0.40 () {60 vars in 1131 bytes} [Tue Aug 9 06:55:32 2022] POST /identity/v3/roles => generated 219 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:55:32.531889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b37d4a-0bc8-4760-b796-fc07e4772ef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:32.533065 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff62ce-fe82-4b45-806d-0798178b5058 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:32.533349 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff62ce-fe82-4b45-806d-0798178b5058 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:32.533533 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b37d4a-0bc8-4760-b796-fc07e4772ef1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:32.533634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff62ce-fe82-4b45-806d-0798178b5058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:32.535138 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 22/39] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:55:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:32.536339 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249c94f-e8bd-4eda-a513-6915f9b0a6a9 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:32.536635 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249c94f-e8bd-4eda-a513-6915f9b0a6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:32.536954 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249c94f-e8bd-4eda-a513-6915f9b0a6a9 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:32.538544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 23/40] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:32.543479 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249c94f-e8bd-4eda-a513-6915f9b0a6a9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:32.556933 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5dff62ce-fe82-4b45-806d-0798178b5058 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:32.558508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5dff62ce-fe82-4b45-806d-0798178b5058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:32.591409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:32.654105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 18/41] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:32.655870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371e067-0024-4bdf-b568-9098ba5fcf76 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:32.656393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371e067-0024-4bdf-b568-9098ba5fcf76 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:32.656863 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371e067-0024-4bdf-b568-9098ba5fcf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:32.677620 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249c94f-e8bd-4eda-a513-6915f9b0a6a9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:32.684391 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d371e067-0024-4bdf-b568-9098ba5fcf76 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:32.685628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d371e067-0024-4bdf-b568-9098ba5fcf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:32.699464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:32.717980 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdccfa-3cf4-4253-baa5-31b495bca905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:32.718653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdccfa-3cf4-4253-baa5-31b495bca905 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:32.719031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdccfa-3cf4-4253-baa5-31b495bca905 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:32.719260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdccfa-3cf4-4253-baa5-31b495bca905 None admin] PATH_INFO: `/v3/domains/default/users/bcf6cd86a276482e8265d5687ef8c40a/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:32.721727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cdccfa-3cf4-4253-baa5-31b495bca905 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bcf6cd86a276482e8265d5687ef8c40a, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:32.723730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cdccfa-3cf4-4253-baa5-31b495bca905 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:32.743279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 24/42] 10.222.0.40 () {58 vars in 1361 bytes} [Tue Aug 9 06:55:32 2022] PUT /identity/v3/domains/default/users/bcf6cd86a276482e8265d5687ef8c40a/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:55:32.744173 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdccfa-3cf4-4253-baa5-31b495bca905 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:32.782125 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 19/43] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:32.804152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371e067-0024-4bdf-b568-9098ba5fcf76 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:32.854248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:32.863763 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdccfa-3cf4-4253-baa5-31b495bca905 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:32.905373 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fff717-03be-4cef-baea-8c87e8c29452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:32.906674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fff717-03be-4cef-baea-8c87e8c29452 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:32.907196 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fff717-03be-4cef-baea-8c87e8c29452 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:32.907747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fff717-03be-4cef-baea-8c87e8c29452 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:32.909312 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fff717-03be-4cef-baea-8c87e8c29452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:32.911068 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fff717-03be-4cef-baea-8c87e8c29452 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:32.913240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 25/44] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:55:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:32.918194 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371e067-0024-4bdf-b568-9098ba5fcf76 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:32.918796 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fff717-03be-4cef-baea-8c87e8c29452 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:32.953695 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ab2e5-91f2-4314-a27c-93189edac315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:32.954314 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ab2e5-91f2-4314-a27c-93189edac315 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:32.954853 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ab2e5-91f2-4314-a27c-93189edac315 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:32.955161 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ab2e5-91f2-4314-a27c-93189edac315 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:32.955838 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ab2e5-91f2-4314-a27c-93189edac315 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:32.957225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ab2e5-91f2-4314-a27c-93189edac315 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:32.974305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 20/45] 10.222.0.40 () {60 vars in 1131 bytes} [Tue Aug 9 06:55:32 2022] POST /identity/v3/roles => generated 223 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:55:33.032028 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fff717-03be-4cef-baea-8c87e8c29452 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:33.069571 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95d9da-f39e-4b2c-ac06-06ee2224e80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:33.070198 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95d9da-f39e-4b2c-ac06-06ee2224e80d None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:33.070481 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95d9da-f39e-4b2c-ac06-06ee2224e80d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:33.070754 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95d9da-f39e-4b2c-ac06-06ee2224e80d None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:33.071455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95d9da-f39e-4b2c-ac06-06ee2224e80d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:33.072930 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95d9da-f39e-4b2c-ac06-06ee2224e80d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:33.105313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 26/46] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Aug 9 06:55:32 2022] POST /identity/v3/projects => generated 312 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 06:55:34.771878 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44bf8f-9a28-443f-8697-53aae9ea6611 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:34.772426 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44bf8f-9a28-443f-8697-53aae9ea6611 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:34.772426 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44bf8f-9a28-443f-8697-53aae9ea6611 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:34.773771 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 21/47] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:34.779021 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b10d28-43ba-4f39-94ff-9a90050e3f5e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:34.779442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b10d28-43ba-4f39-94ff-9a90050e3f5e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:34.780449 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b10d28-43ba-4f39-94ff-9a90050e3f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:34.798846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b5b10d28-43ba-4f39-94ff-9a90050e3f5e None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:34.800396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b5b10d28-43ba-4f39-94ff-9a90050e3f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:34.811738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:34.867757 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 27/48] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:34.891646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44bf8f-9a28-443f-8697-53aae9ea6611 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:34.900484 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:34.991298 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44bf8f-9a28-443f-8697-53aae9ea6611 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:35.023585 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1723700-72b5-435b-a30c-073d16433780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:35.024208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1723700-72b5-435b-a30c-073d16433780 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:35.024488 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1723700-72b5-435b-a30c-073d16433780 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:35.024760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1723700-72b5-435b-a30c-073d16433780 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:35.035465 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1723700-72b5-435b-a30c-073d16433780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:35.040088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-b1723700-72b5-435b-a30c-073d16433780 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:55:35.040088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:35.040088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:35.040088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:35.040088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:35.040088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:35.040088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:35.040088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:35.040088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:35.040088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:35.040088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:35.040088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:35.040088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:35.040088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:35.040088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:35.040088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:35.040937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:35.040937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:35.040937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:35.040937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:35.040937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:35.040937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:35.040937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:35.040937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:35.040937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:35.040937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:35.040937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:35.040937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:35.040937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:35.040937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:35.040937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:35.040937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:35.041762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:35.041762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:35.041762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:35.041762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:35.041762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:35.041762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:35.041762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:35.041762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:35.041762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:35.041762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:35.041762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:55:35.041762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:55:35.041762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 22/49] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:55:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:55:35.049071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b10d28-43ba-4f39-94ff-9a90050e3f5e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:35.120153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336cc7d-8ab3-4b00-9a86-25e01dd0f2df None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:35.120439 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336cc7d-8ab3-4b00-9a86-25e01dd0f2df None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:35.120713 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336cc7d-8ab3-4b00-9a86-25e01dd0f2df None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:35.122045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 23/50] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:55:35.126854 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208d970-7edd-4701-8ed4-c39c467c227c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:35.127160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208d970-7edd-4701-8ed4-c39c467c227c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:35.127435 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208d970-7edd-4701-8ed4-c39c467c227c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:35.145081 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b10d28-43ba-4f39-94ff-9a90050e3f5e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:35.145223 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1208d970-7edd-4701-8ed4-c39c467c227c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:35.146273 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1208d970-7edd-4701-8ed4-c39c467c227c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:35.178307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb22b8-10b0-44cb-86a5-2dfbfe87b33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:35.178917 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb22b8-10b0-44cb-86a5-2dfbfe87b33b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:35.179231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb22b8-10b0-44cb-86a5-2dfbfe87b33b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:35.179502 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb22b8-10b0-44cb-86a5-2dfbfe87b33b None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:35.180164 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb22b8-10b0-44cb-86a5-2dfbfe87b33b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:35.180462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb22b8-10b0-44cb-86a5-2dfbfe87b33b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:35.181855 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb22b8-10b0-44cb-86a5-2dfbfe87b33b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:35.190377 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 28/51] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:55:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:35.195885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb22b8-10b0-44cb-86a5-2dfbfe87b33b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:35.207024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:35.209640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:35.218275 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 24/52] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:55:35.240300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208d970-7edd-4701-8ed4-c39c467c227c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:35.296868 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb22b8-10b0-44cb-86a5-2dfbfe87b33b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:35.331983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0b787-a2db-40ee-a45a-bf6cc174e3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:35.332607 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0b787-a2db-40ee-a45a-bf6cc174e3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:35.332882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0b787-a2db-40ee-a45a-bf6cc174e3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:35.333151 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0b787-a2db-40ee-a45a-bf6cc174e3b5 None admin] PATH_INFO: `/v3/users/bcf6cd86a276482e8265d5687ef8c40a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:35.334281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0b787-a2db-40ee-a45a-bf6cc174e3b5 None admin] RBAC: Authorizing `identity:get_user(user_id=bcf6cd86a276482e8265d5687ef8c40a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:35.335749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0b787-a2db-40ee-a45a-bf6cc174e3b5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:35.337457 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 29/53] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:35 2022] GET /identity/v3/users/bcf6cd86a276482e8265d5687ef8c40a => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:55:35.342865 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0b787-a2db-40ee-a45a-bf6cc174e3b5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:35.342989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208d970-7edd-4701-8ed4-c39c467c227c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:35.377837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a441b8c-3781-4525-918f-7b157050d973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:35.378469 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a441b8c-3781-4525-918f-7b157050d973 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:35.378750 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a441b8c-3781-4525-918f-7b157050d973 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:35.379025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a441b8c-3781-4525-918f-7b157050d973 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:35.380179 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a441b8c-3781-4525-918f-7b157050d973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:35.381624 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a441b8c-3781-4525-918f-7b157050d973 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:35.383207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 25/54] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:55:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:55:35.389164 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a441b8c-3781-4525-918f-7b157050d973 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:35.418777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:35.442382 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0b787-a2db-40ee-a45a-bf6cc174e3b5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:35.450624 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:35.476321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32388bb4-f40d-4f49-8eac-3e75e3a5c6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:35.476956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32388bb4-f40d-4f49-8eac-3e75e3a5c6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:35.477233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32388bb4-f40d-4f49-8eac-3e75e3a5c6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:35.477506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32388bb4-f40d-4f49-8eac-3e75e3a5c6f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:35.478626 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32388bb4-f40d-4f49-8eac-3e75e3a5c6f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:35.480089 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32388bb4-f40d-4f49-8eac-3e75e3a5c6f1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:35.481637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 30/55] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:55:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:55:35.487860 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32388bb4-f40d-4f49-8eac-3e75e3a5c6f1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:35.488309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a441b8c-3781-4525-918f-7b157050d973 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:35.521145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6d45c-d5ad-4864-8423-ab7312daab5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:35.521746 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6d45c-d5ad-4864-8423-ab7312daab5f None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:35.522028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6d45c-d5ad-4864-8423-ab7312daab5f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:35.522303 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6d45c-d5ad-4864-8423-ab7312daab5f None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:35.522944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6d45c-d5ad-4864-8423-ab7312daab5f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:35.524380 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6d45c-d5ad-4864-8423-ab7312daab5f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:35.550165 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 26/56] 10.222.0.40 () {60 vars in 1140 bytes} [Tue Aug 9 06:55:35 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 06:55:35.586313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32388bb4-f40d-4f49-8eac-3e75e3a5c6f1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:35.623731 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba38a9-867a-4fef-9d7a-33cb448d48cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:35.624436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba38a9-867a-4fef-9d7a-33cb448d48cd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:35.624721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba38a9-867a-4fef-9d7a-33cb448d48cd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:35.624994 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba38a9-867a-4fef-9d7a-33cb448d48cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:35.625730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba38a9-867a-4fef-9d7a-33cb448d48cd None admin] RBAC: Adding query filter params (role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.domain.id=default, user.id=bcf6cd86a276482e8265d5687ef8c40a) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:35.626043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba38a9-867a-4fef-9d7a-33cb448d48cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:35.627582 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba38a9-867a-4fef-9d7a-33cb448d48cd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:35.634431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 31/57] 10.222.0.40 () {56 vars in 1322 bytes} [Tue Aug 9 06:55:35 2022] GET /identity/v3/role_assignments?user.id=bcf6cd86a276482e8265d5687ef8c40a&scope.domain.id=default&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:55:37.575582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73932e-a4b1-4a53-b34b-9030644888e1 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:37.576105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73932e-a4b1-4a53-b34b-9030644888e1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:37.576105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73932e-a4b1-4a53-b34b-9030644888e1 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:37.578144 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 27/58] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:37.583579 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9acc85-f5e3-4fb3-b235-072b25879965 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:37.584000 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9acc85-f5e3-4fb3-b235-072b25879965 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:37.584136 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9acc85-f5e3-4fb3-b235-072b25879965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:37.602263 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2c9acc85-f5e3-4fb3-b235-072b25879965 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:37.603481 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2c9acc85-f5e3-4fb3-b235-072b25879965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:37.605391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:37.668474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 32/59] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:37.693013 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73932e-a4b1-4a53-b34b-9030644888e1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:37.792124 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73932e-a4b1-4a53-b34b-9030644888e1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:37.807074 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:37.825265 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6824e6-3256-4b07-ba2d-f1eef6732e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:37.825927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6824e6-3256-4b07-ba2d-f1eef6732e0f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:37.826159 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6824e6-3256-4b07-ba2d-f1eef6732e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:37.827022 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6824e6-3256-4b07-ba2d-f1eef6732e0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:37.828142 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6824e6-3256-4b07-ba2d-f1eef6732e0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:37.829824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6824e6-3256-4b07-ba2d-f1eef6732e0f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:37.831401 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 28/60] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:55:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:37.836840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9acc85-f5e3-4fb3-b235-072b25879965 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:37.930230 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9acc85-f5e3-4fb3-b235-072b25879965 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:37.963613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039527c0-8bcb-4733-8bd2-fa4002d83367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:37.964213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039527c0-8bcb-4733-8bd2-fa4002d83367 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:37.964491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039527c0-8bcb-4733-8bd2-fa4002d83367 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:37.964763 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039527c0-8bcb-4733-8bd2-fa4002d83367 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:37.965393 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039527c0-8bcb-4733-8bd2-fa4002d83367 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:37.966824 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039527c0-8bcb-4733-8bd2-fa4002d83367 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:37.980815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:37.993919 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 33/61] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Aug 9 06:55:37 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:55:40.896633 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8ea16-c6de-42d2-add8-ec5a70bf90f5 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:40.897126 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8ea16-c6de-42d2-add8-ec5a70bf90f5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:40.897126 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8ea16-c6de-42d2-add8-ec5a70bf90f5 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:40.898426 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 29/62] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:40.903867 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5557ca0-a45e-4173-ae62-673a57cb7454 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:40.904257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5557ca0-a45e-4173-ae62-673a57cb7454 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:40.904418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5557ca0-a45e-4173-ae62-673a57cb7454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:40.926330 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e5557ca0-a45e-4173-ae62-673a57cb7454 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:40.927543 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e5557ca0-a45e-4173-ae62-673a57cb7454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:41.021452 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 34/63] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:41.056836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8ea16-c6de-42d2-add8-ec5a70bf90f5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:41.182395 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8ea16-c6de-42d2-add8-ec5a70bf90f5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:41.216937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8308cb-fa24-4dcf-8c56-ab7a4245ee79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:41.217852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8308cb-fa24-4dcf-8c56-ab7a4245ee79 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:41.218137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8308cb-fa24-4dcf-8c56-ab7a4245ee79 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:41.218415 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8308cb-fa24-4dcf-8c56-ab7a4245ee79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:41.228868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8308cb-fa24-4dcf-8c56-ab7a4245ee79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:41.240063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-db8308cb-fa24-4dcf-8c56-ab7a4245ee79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:55:41.240063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:41.240063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:41.240063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:41.240063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:41.240063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:41.240063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:41.240063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:41.240063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:41.240063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:41.240063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:41.240063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:41.240063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:41.240063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:41.240063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:41.240063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:41.240942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:41.240942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:41.240942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:41.240942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:41.240942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:41.240942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:41.240942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:41.240942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:41.240942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:41.240942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:41.240942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:41.240942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:41.240942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:41.240942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:41.240942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:41.240942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:41.241702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:41.241702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:41.241702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:41.241702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:41.241702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:41.241702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:41.241702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:41.241702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:41.241702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:41.241702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:41.241702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:55:41.241702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:55:41.241702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 30/64] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:55:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:55:41.247428 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5557ca0-a45e-4173-ae62-673a57cb7454 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:41.408013 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa2201-48ab-422f-8aed-4a462816b257 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:41.408302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa2201-48ab-422f-8aed-4a462816b257 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:41.408577 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa2201-48ab-422f-8aed-4a462816b257 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:41.410059 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 31/65] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:41.415312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd962466-0a08-4173-9a61-f89bf5aa5da3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:41.415594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd962466-0a08-4173-9a61-f89bf5aa5da3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:41.415867 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd962466-0a08-4173-9a61-f89bf5aa5da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:41.416934 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5557ca0-a45e-4173-ae62-673a57cb7454 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:41.443649 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:41.450301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-bd962466-0a08-4173-9a61-f89bf5aa5da3 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:41.452126 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bd962466-0a08-4173-9a61-f89bf5aa5da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:41.464484 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e8592-bef8-49ef-9f47-b26efb4f466a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:41.468691 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e8592-bef8-49ef-9f47-b26efb4f466a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:41.469206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e8592-bef8-49ef-9f47-b26efb4f466a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:41.469657 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e8592-bef8-49ef-9f47-b26efb4f466a None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:41.470502 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e8592-bef8-49ef-9f47-b26efb4f466a None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:41.470981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e8592-bef8-49ef-9f47-b26efb4f466a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:41.472570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e8592-bef8-49ef-9f47-b26efb4f466a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:41.490425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 35/66] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:55:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:41.498097 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e8592-bef8-49ef-9f47-b26efb4f466a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:41.539817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:41.599180 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 32/67] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:41.603447 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb43be-9156-4bc4-b013-f0fba26cb174 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:41.603906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb43be-9156-4bc4-b013-f0fba26cb174 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:41.604373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb43be-9156-4bc4-b013-f0fba26cb174 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:41.605825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 33/68] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:41.612466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae0df9-3b6c-4c93-acfc-38bb875827d4 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:41.612750 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae0df9-3b6c-4c93-acfc-38bb875827d4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:41.613023 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae0df9-3b6c-4c93-acfc-38bb875827d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:41.638998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-51ae0df9-3b6c-4c93-acfc-38bb875827d4 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:41.640680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-51ae0df9-3b6c-4c93-acfc-38bb875827d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:41.677911 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e8592-bef8-49ef-9f47-b26efb4f466a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:41.715164 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b3d20-c588-4eeb-acae-42b1996c1f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:41.715729 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b3d20-c588-4eeb-acae-42b1996c1f4f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:41.716006 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b3d20-c588-4eeb-acae-42b1996c1f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:41.716278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b3d20-c588-4eeb-acae-42b1996c1f4f None admin] PATH_INFO: `/v3/users/b2506581a1e24052a065de1a855734fd` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:41.729471 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 34/69] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:41.730725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cf8c0-0c6b-447d-bcc6-dd411d29d2d2 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:41.731016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cf8c0-0c6b-447d-bcc6-dd411d29d2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:41.731323 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cf8c0-0c6b-447d-bcc6-dd411d29d2d2 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:41.732088 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b3d20-c588-4eeb-acae-42b1996c1f4f None admin] RBAC: Authorizing `identity:get_user(user_id=b2506581a1e24052a065de1a855734fd)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:41.733286 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 35/70] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:41.734081 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cf8c0-0c6b-447d-bcc6-dd411d29d2d2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:41.736631 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b3d20-c588-4eeb-acae-42b1996c1f4f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:41.738287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 36/71] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:41 2022] GET /identity/v3/users/b2506581a1e24052a065de1a855734fd => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:41.739489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e8c16-c6e8-4996-94c0-a40dd906da3a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:41.739777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e8c16-c6e8-4996-94c0-a40dd906da3a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:41.740054 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e8c16-c6e8-4996-94c0-a40dd906da3a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:41.741287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 37/72] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:41.742289 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6dceb-a784-443d-b6a3-7814d2f71283 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:41.742578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6dceb-a784-443d-b6a3-7814d2f71283 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:41.742846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6dceb-a784-443d-b6a3-7814d2f71283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:41.764946 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-47e6dceb-a784-443d-b6a3-7814d2f71283 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:41.766131 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-47e6dceb-a784-443d-b6a3-7814d2f71283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:41.806284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:41.833257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 38/73] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:41.834465 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba327d-8489-44df-a748-301202d085dc None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:41.834749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba327d-8489-44df-a748-301202d085dc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:41.835024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba327d-8489-44df-a748-301202d085dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:41.851691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cf8c0-0c6b-447d-bcc6-dd411d29d2d2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:41.852284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4bba327d-8489-44df-a748-301202d085dc None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:41.853462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4bba327d-8489-44df-a748-301202d085dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:41.854115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:41.887078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed660553-b342-4391-8c5c-87fa71f7208b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:41.887718 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed660553-b342-4391-8c5c-87fa71f7208b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:41.887995 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed660553-b342-4391-8c5c-87fa71f7208b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:41.888262 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed660553-b342-4391-8c5c-87fa71f7208b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:41.898623 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed660553-b342-4391-8c5c-87fa71f7208b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:41.903263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-ed660553-b342-4391-8c5c-87fa71f7208b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:55:41.903263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:41.903263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:41.903263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:41.903263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:41.903263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:41.903263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:41.903263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:41.903263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:41.903263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:41.903263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:41.903263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:41.903263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:41.903263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:41.903263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:41.903263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:41.904155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:41.904155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:41.904155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:41.904155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:41.904155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:41.904155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:41.904155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:41.904155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:41.904155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:41.904155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:41.904155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:41.904155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:41.904155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:41.904155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:41.904155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:41.904155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:41.905225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:41.905225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:41.905225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:41.905225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:41.905225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:41.905225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:41.905225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:41.905225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:41.905225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:41.905225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:41.905225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:55:41.905225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:55:41.905225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 36/74] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:55:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:55:41.905862 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed660553-b342-4391-8c5c-87fa71f7208b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:41.923330 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 39/75] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:41.924107 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba327d-8489-44df-a748-301202d085dc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:42.010074 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed660553-b342-4391-8c5c-87fa71f7208b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:42.022556 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba327d-8489-44df-a748-301202d085dc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:42.025258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:42.054870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecdb92-be30-48f1-84e8-50a59df35539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:42.055585 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecdb92-be30-48f1-84e8-50a59df35539 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:42.055861 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecdb92-be30-48f1-84e8-50a59df35539 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:42.056128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecdb92-be30-48f1-84e8-50a59df35539 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:42.060260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398a88e-4970-4986-93ed-258cf08f4e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:42.061005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398a88e-4970-4986-93ed-258cf08f4e41 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:42.061005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398a88e-4970-4986-93ed-258cf08f4e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:42.061616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398a88e-4970-4986-93ed-258cf08f4e41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:42.072818 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398a88e-4970-4986-93ed-258cf08f4e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:42.078222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d398a88e-4970-4986-93ed-258cf08f4e41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:55:42.078222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:42.078222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:42.078222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:42.078222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:42.078222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:42.078222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:42.078222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:42.078222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:42.078222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:42.078222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:42.078222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:42.078222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:42.078222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:42.078222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:42.078222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:42.079111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:42.079111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:42.079111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:42.079111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:42.079111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:42.079111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:42.079111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:42.079111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:42.079111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:42.079111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:42.079111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:42.079111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:42.079111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:42.079111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:42.079111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:42.079111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:42.080175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:42.080175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:42.080175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:42.080175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:42.080175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:42.080175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:42.080175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:42.080175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:42.080175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:42.080175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:42.080175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:55:42.080175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:55:42.080175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 40/76] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:55:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:55:42.080816 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398a88e-4970-4986-93ed-258cf08f4e41 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:42.086903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:42.123819 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ecdb92-be30-48f1-84e8-50a59df35539 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:42.125296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ecdb92-be30-48f1-84e8-50a59df35539 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:42.177337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398a88e-4970-4986-93ed-258cf08f4e41 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:42.211290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21546dc-0686-4260-9036-6ae27be420dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:42.211910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21546dc-0686-4260-9036-6ae27be420dd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:42.212197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21546dc-0686-4260-9036-6ae27be420dd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:42.212456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21546dc-0686-4260-9036-6ae27be420dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:42.213541 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21546dc-0686-4260-9036-6ae27be420dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:42.214974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21546dc-0686-4260-9036-6ae27be420dd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:42.216537 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 41/77] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:55:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:42.217509 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21546dc-0686-4260-9036-6ae27be420dd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:42.227588 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 37/78] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:55:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:55:42.228428 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecdb92-be30-48f1-84e8-50a59df35539 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:42.252702 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:42.287709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:42.324293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ecdb92-be30-48f1-84e8-50a59df35539 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:42.324909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21546dc-0686-4260-9036-6ae27be420dd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:42.362370 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e039a16-ba17-49aa-b1a5-0648839721e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:42.362974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e039a16-ba17-49aa-b1a5-0648839721e4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:42.363274 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e039a16-ba17-49aa-b1a5-0648839721e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:42.363548 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e039a16-ba17-49aa-b1a5-0648839721e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:42.364207 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e039a16-ba17-49aa-b1a5-0648839721e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:42.364505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e039a16-ba17-49aa-b1a5-0648839721e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:42.365882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e039a16-ba17-49aa-b1a5-0648839721e4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:42.370397 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093a3e8-7de3-4f59-af31-5e96b193634c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:42.371023 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093a3e8-7de3-4f59-af31-5e96b193634c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:42.371334 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093a3e8-7de3-4f59-af31-5e96b193634c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:42.371664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093a3e8-7de3-4f59-af31-5e96b193634c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:42.373622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 42/79] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:55:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:42.378481 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e039a16-ba17-49aa-b1a5-0648839721e4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:42.382153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093a3e8-7de3-4f59-af31-5e96b193634c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:42.386898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3093a3e8-7de3-4f59-af31-5e96b193634c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:55:42.386898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:42.386898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:42.386898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:42.386898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:42.386898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:42.386898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:42.386898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:42.386898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:42.386898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:42.386898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:42.386898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:42.386898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:42.386898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:42.386898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:42.386898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:42.387852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:42.387852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:42.387852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:42.387852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:42.387852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:42.387852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:42.387852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:42.387852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:42.387852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:42.387852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:42.387852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:42.387852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:42.387852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:42.387852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:42.387852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:42.387852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:42.388602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:42.388602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:42.388602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:42.388602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:42.388602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:42.388602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:42.388602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:42.388602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:42.388602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:42.388602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:42.388602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:55:42.388602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:55:42.388602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 38/80] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:55:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:55:42.389680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093a3e8-7de3-4f59-af31-5e96b193634c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:42.470695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:42.477377 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e039a16-ba17-49aa-b1a5-0648839721e4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:42.490048 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093a3e8-7de3-4f59-af31-5e96b193634c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:42.510652 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058f346-d0e9-421b-9bc5-f8857e635c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:42.511284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058f346-d0e9-421b-9bc5-f8857e635c69 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:42.511567 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058f346-d0e9-421b-9bc5-f8857e635c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:42.511841 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058f346-d0e9-421b-9bc5-f8857e635c69 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:42.512485 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:42.512591 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058f346-d0e9-421b-9bc5-f8857e635c69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:42.512788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058f346-d0e9-421b-9bc5-f8857e635c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:42.514495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058f346-d0e9-421b-9bc5-f8857e635c69 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:42.522316 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 43/81] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:55:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:42.526931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058f346-d0e9-421b-9bc5-f8857e635c69 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:42.527037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7aa98-8851-4967-aa27-61f0865103a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:42.527037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7aa98-8851-4967-aa27-61f0865103a0 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:42.527037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7aa98-8851-4967-aa27-61f0865103a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:42.527037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7aa98-8851-4967-aa27-61f0865103a0 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:42.527380 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7aa98-8851-4967-aa27-61f0865103a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:42.527380 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7aa98-8851-4967-aa27-61f0865103a0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:42.553953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 39/82] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Aug 9 06:55:42 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:55:42.554699 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7aa98-8851-4967-aa27-61f0865103a0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:42.671896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058f346-d0e9-421b-9bc5-f8857e635c69 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:42.678727 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7aa98-8851-4967-aa27-61f0865103a0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:42.708526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59836877-e84f-4387-875a-ebcbf11bd8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:42.709168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59836877-e84f-4387-875a-ebcbf11bd8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:42.709449 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59836877-e84f-4387-875a-ebcbf11bd8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:42.709729 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59836877-e84f-4387-875a-ebcbf11bd8b6 None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:42.710975 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59836877-e84f-4387-875a-ebcbf11bd8b6 None admin] RBAC: Authorizing `identity:get_project(project_id=b4ee993851d3477d921a816e3f05a39d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:42.712466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59836877-e84f-4387-875a-ebcbf11bd8b6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:42.714105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 44/83] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:55:42 2022] GET /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:42.719100 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59836877-e84f-4387-875a-ebcbf11bd8b6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:42.724035 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3378e-b7e3-4276-b7f6-b19f0a793a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:42.724681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3378e-b7e3-4276-b7f6-b19f0a793a0b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:42.724962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3378e-b7e3-4276-b7f6-b19f0a793a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:42.725237 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3378e-b7e3-4276-b7f6-b19f0a793a0b None admin] PATH_INFO: `/v3/users/b2506581a1e24052a065de1a855734fd` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:42.726390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3378e-b7e3-4276-b7f6-b19f0a793a0b None admin] RBAC: Authorizing `identity:get_user(user_id=b2506581a1e24052a065de1a855734fd)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:42.727961 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3378e-b7e3-4276-b7f6-b19f0a793a0b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:42.729822 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 40/84] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:42 2022] GET /identity/v3/users/b2506581a1e24052a065de1a855734fd => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:42.730284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3378e-b7e3-4276-b7f6-b19f0a793a0b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:42.749837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:42.789323 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:42.841130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59836877-e84f-4387-875a-ebcbf11bd8b6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:42.860657 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3378e-b7e3-4276-b7f6-b19f0a793a0b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:42.881049 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764d22f-2f4d-456e-9cb7-188e5b2cb3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:42.881666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764d22f-2f4d-456e-9cb7-188e5b2cb3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:42.881946 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764d22f-2f4d-456e-9cb7-188e5b2cb3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:42.882221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764d22f-2f4d-456e-9cb7-188e5b2cb3d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:42.882885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764d22f-2f4d-456e-9cb7-188e5b2cb3d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:42.883331 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764d22f-2f4d-456e-9cb7-188e5b2cb3d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:42.884730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764d22f-2f4d-456e-9cb7-188e5b2cb3d3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:42.893792 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 45/85] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:55:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:42.894623 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764d22f-2f4d-456e-9cb7-188e5b2cb3d3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:42.900099 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf170d-0e63-4c9a-92e8-c470d3d5d2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:42.901316 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf170d-0e63-4c9a-92e8-c470d3d5d2bb None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:42.901778 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf170d-0e63-4c9a-92e8-c470d3d5d2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:42.902239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf170d-0e63-4c9a-92e8-c470d3d5d2bb None admin] PATH_INFO: `/v3/users/bcf6cd86a276482e8265d5687ef8c40a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:42.903667 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf170d-0e63-4c9a-92e8-c470d3d5d2bb None admin] RBAC: Authorizing `identity:get_user(user_id=bcf6cd86a276482e8265d5687ef8c40a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:42.905609 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf170d-0e63-4c9a-92e8-c470d3d5d2bb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:42.907596 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 41/86] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:42 2022] GET /identity/v3/users/bcf6cd86a276482e8265d5687ef8c40a => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:42.908606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf170d-0e63-4c9a-92e8-c470d3d5d2bb None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:42.996504 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:43.016006 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764d22f-2f4d-456e-9cb7-188e5b2cb3d3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:43.046649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf170d-0e63-4c9a-92e8-c470d3d5d2bb None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:43.061872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa4a99-c3ce-4146-91e5-27a89a126858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:43.063288 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa4a99-c3ce-4146-91e5-27a89a126858 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:43.064244 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa4a99-c3ce-4146-91e5-27a89a126858 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:43.064832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa4a99-c3ce-4146-91e5-27a89a126858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:43.065846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa4a99-c3ce-4146-91e5-27a89a126858 None admin] RBAC: Adding query filter params (role.id=decfb257a46442b8b4637f8c95c9967b, scope.project.id=b4ee993851d3477d921a816e3f05a39d, user.id=b2506581a1e24052a065de1a855734fd) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:43.066616 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:43.066991 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa4a99-c3ce-4146-91e5-27a89a126858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:43.069343 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa4a99-c3ce-4146-91e5-27a89a126858 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:43.078893 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 46/87] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:55:42 2022] GET /identity/v3/role_assignments?user.id=b2506581a1e24052a065de1a855734fd&scope.project.id=b4ee993851d3477d921a816e3f05a39d&role.id=decfb257a46442b8b4637f8c95c9967b => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:43.080982 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa4a99-c3ce-4146-91e5-27a89a126858 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:43.088103 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa0971-9817-4bdd-8a95-de07a481d8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:43.088828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa0971-9817-4bdd-8a95-de07a481d8ab None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:43.089183 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa0971-9817-4bdd-8a95-de07a481d8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:43.089551 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa0971-9817-4bdd-8a95-de07a481d8ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:43.172189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa0971-9817-4bdd-8a95-de07a481d8ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:43.173862 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa0971-9817-4bdd-8a95-de07a481d8ab None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:43.229695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa4a99-c3ce-4146-91e5-27a89a126858 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:43.292526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8c016-f770-4346-b81d-bfdb69a82415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:43.293450 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8c016-f770-4346-b81d-bfdb69a82415 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:43.294037 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8c016-f770-4346-b81d-bfdb69a82415 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:43.294557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8c016-f770-4346-b81d-bfdb69a82415 None admin] PATH_INFO: `/v3/users/b2506581a1e24052a065de1a855734fd` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:43.297465 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe8c016-f770-4346-b81d-bfdb69a82415 None admin] RBAC: Authorizing `identity:get_user(user_id=b2506581a1e24052a065de1a855734fd)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:43.299019 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe8c016-f770-4346-b81d-bfdb69a82415 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:43.301209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 47/88] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:43 2022] GET /identity/v3/users/b2506581a1e24052a065de1a855734fd => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:43.302170 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8c016-f770-4346-b81d-bfdb69a82415 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:43.313672 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 42/89] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:55:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:55:43.315228 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa0971-9817-4bdd-8a95-de07a481d8ab None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:43.334706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:43.341302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:43.454107 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8c016-f770-4346-b81d-bfdb69a82415 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:43.473282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa0971-9817-4bdd-8a95-de07a481d8ab None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:43.501784 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312835e-0ee4-4624-a9d0-e5ea52de1338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:43.502403 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312835e-0ee4-4624-a9d0-e5ea52de1338 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:43.502680 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312835e-0ee4-4624-a9d0-e5ea52de1338 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:43.503028 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312835e-0ee4-4624-a9d0-e5ea52de1338 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:43.543653 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948918e1-77f7-46a3-8c8b-b9563b33f55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:43.544368 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948918e1-77f7-46a3-8c8b-b9563b33f55e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:43.544649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948918e1-77f7-46a3-8c8b-b9563b33f55e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:43.544917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948918e1-77f7-46a3-8c8b-b9563b33f55e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:43.625651 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312835e-0ee4-4624-a9d0-e5ea52de1338 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:43.627203 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312835e-0ee4-4624-a9d0-e5ea52de1338 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:43.651868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948918e1-77f7-46a3-8c8b-b9563b33f55e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:43.654881 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948918e1-77f7-46a3-8c8b-b9563b33f55e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:43.664030 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:43.684908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:43.798254 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 48/90] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:55:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:55:43.799212 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312835e-0ee4-4624-a9d0-e5ea52de1338 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:43.846734 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 43/91] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:55:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:55:43.847617 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948918e1-77f7-46a3-8c8b-b9563b33f55e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:43.899726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312835e-0ee4-4624-a9d0-e5ea52de1338 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:43.930492 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:43.936180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d9c7a-2a72-4621-a323-469040d81006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:43.936827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d9c7a-2a72-4621-a323-469040d81006 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:43.937064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d9c7a-2a72-4621-a323-469040d81006 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:43.937406 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d9c7a-2a72-4621-a323-469040d81006 None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:43.938641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d9c7a-2a72-4621-a323-469040d81006 None admin] RBAC: Authorizing `identity:get_project(project_id=b4ee993851d3477d921a816e3f05a39d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:43.940194 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d9c7a-2a72-4621-a323-469040d81006 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:43.941848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 49/92] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:55:43 2022] GET /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:43.942701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d9c7a-2a72-4621-a323-469040d81006 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:44.049356 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d9c7a-2a72-4621-a323-469040d81006 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:44.088015 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948918e1-77f7-46a3-8c8b-b9563b33f55e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:44.104904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914aae35-b545-4afa-a2f1-41d4afcd5b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:44.105552 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aae35-b545-4afa-a2f1-41d4afcd5b69 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:44.105679 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:44.105842 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aae35-b545-4afa-a2f1-41d4afcd5b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:44.106334 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aae35-b545-4afa-a2f1-41d4afcd5b69 None admin] PATH_INFO: `/v3/projects/399b874cda444e5aaab1d85d5d2842f4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:44.111827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914aae35-b545-4afa-a2f1-41d4afcd5b69 None admin] RBAC: Authorizing `identity:get_project(project_id=399b874cda444e5aaab1d85d5d2842f4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:44.113295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914aae35-b545-4afa-a2f1-41d4afcd5b69 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:44.115038 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 50/93] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:55:43 2022] GET /identity/v3/projects/399b874cda444e5aaab1d85d5d2842f4 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:44.115913 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914aae35-b545-4afa-a2f1-41d4afcd5b69 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:44.131101 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666da83-4a88-4cfb-ad7b-02f8334c2416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:44.131761 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666da83-4a88-4cfb-ad7b-02f8334c2416 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:44.132043 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666da83-4a88-4cfb-ad7b-02f8334c2416 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:44.132316 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666da83-4a88-4cfb-ad7b-02f8334c2416 None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:44.133519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666da83-4a88-4cfb-ad7b-02f8334c2416 None admin] RBAC: Authorizing `identity:get_project(project_id=b4ee993851d3477d921a816e3f05a39d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:44.134982 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666da83-4a88-4cfb-ad7b-02f8334c2416 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:44.137043 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 44/94] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:55:43 2022] GET /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:44.137860 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666da83-4a88-4cfb-ad7b-02f8334c2416 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:44.217077 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:44.303512 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914aae35-b545-4afa-a2f1-41d4afcd5b69 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:44.313547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666da83-4a88-4cfb-ad7b-02f8334c2416 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:44.357427 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10ad6a-66ea-4d45-a968-666c84c081a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:44.358567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10ad6a-66ea-4d45-a968-666c84c081a0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:44.358836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10ad6a-66ea-4d45-a968-666c84c081a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:44.359119 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10ad6a-66ea-4d45-a968-666c84c081a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:44.359853 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10ad6a-66ea-4d45-a968-666c84c081a0 None admin] RBAC: Adding query filter params (role.id=decfb257a46442b8b4637f8c95c9967b, scope.project.id=399b874cda444e5aaab1d85d5d2842f4, user.id=b2506581a1e24052a065de1a855734fd) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:44.360160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10ad6a-66ea-4d45-a968-666c84c081a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:44.361588 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10ad6a-66ea-4d45-a968-666c84c081a0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:44.372333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9dfc6-84c3-4e5a-a0ca-7a3c92f1114d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:44.372947 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9dfc6-84c3-4e5a-a0ca-7a3c92f1114d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:44.373849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9dfc6-84c3-4e5a-a0ca-7a3c92f1114d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:44.374192 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9dfc6-84c3-4e5a-a0ca-7a3c92f1114d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:44.374915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9dfc6-84c3-4e5a-a0ca-7a3c92f1114d None admin] RBAC: Adding query filter params (role.id=617e0c2609e3413ea3273113659bccbc, scope.project.id=b4ee993851d3477d921a816e3f05a39d, user.id=b2506581a1e24052a065de1a855734fd) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:44.375253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9dfc6-84c3-4e5a-a0ca-7a3c92f1114d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:44.376682 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9dfc6-84c3-4e5a-a0ca-7a3c92f1114d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:44.381335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 45/95] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:55:44 2022] GET /identity/v3/role_assignments?user.id=b2506581a1e24052a065de1a855734fd&scope.project.id=399b874cda444e5aaab1d85d5d2842f4&role.id=decfb257a46442b8b4637f8c95c9967b => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:44.382150 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10ad6a-66ea-4d45-a968-666c84c081a0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:44.387295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 51/96] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:55:44 2022] GET /identity/v3/role_assignments?user.id=b2506581a1e24052a065de1a855734fd&scope.project.id=b4ee993851d3477d921a816e3f05a39d&role.id=617e0c2609e3413ea3273113659bccbc => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:44.479469 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:44.558638 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10ad6a-66ea-4d45-a968-666c84c081a0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:44.609459 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b5e38-ff1c-4757-882f-f0adca82ab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:44.610097 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b5e38-ff1c-4757-882f-f0adca82ab7a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:44.610380 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b5e38-ff1c-4757-882f-f0adca82ab7a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:44.610664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b5e38-ff1c-4757-882f-f0adca82ab7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:44.611454 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b5e38-ff1c-4757-882f-f0adca82ab7a None admin] RBAC: Adding query filter params (role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.project.id=b4ee993851d3477d921a816e3f05a39d, user.id=bcf6cd86a276482e8265d5687ef8c40a) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:44.611771 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b5e38-ff1c-4757-882f-f0adca82ab7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:44.613259 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b5e38-ff1c-4757-882f-f0adca82ab7a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:44.626466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 46/97] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:55:44 2022] GET /identity/v3/role_assignments?user.id=bcf6cd86a276482e8265d5687ef8c40a&scope.project.id=b4ee993851d3477d921a816e3f05a39d&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:45.151598 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fb119-968a-43d1-a1d1-b749e5dc49ff None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:45.152153 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fb119-968a-43d1-a1d1-b749e5dc49ff None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:45.152153 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fb119-968a-43d1-a1d1-b749e5dc49ff None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:45.153675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 52/98] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:45.159075 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625eb477-49ab-44d5-8c77-64ac49bc79ca None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:45.159533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625eb477-49ab-44d5-8c77-64ac49bc79ca None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:45.159675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625eb477-49ab-44d5-8c77-64ac49bc79ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:45.169895 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827abd2-e570-4a51-99c1-43ef1b8045b7 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:45.170209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827abd2-e570-4a51-99c1-43ef1b8045b7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:45.170491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827abd2-e570-4a51-99c1-43ef1b8045b7 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:45.172021 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 53/99] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:55:45.182465 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-625eb477-49ab-44d5-8c77-64ac49bc79ca None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:45.184790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8bc74-b9b8-4911-b5c0-f312f933c757 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:45.185071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8bc74-b9b8-4911-b5c0-f312f933c757 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:45.185342 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8bc74-b9b8-4911-b5c0-f312f933c757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:45.190919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-625eb477-49ab-44d5-8c77-64ac49bc79ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:45.214354 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3ba8bc74-b9b8-4911-b5c0-f312f933c757 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:45.215601 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3ba8bc74-b9b8-4911-b5c0-f312f933c757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:45.316851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 54/100] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:55:45.340624 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 47/101] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:45.356716 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8bc74-b9b8-4911-b5c0-f312f933c757 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:45.383663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625eb477-49ab-44d5-8c77-64ac49bc79ca None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:45.453721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:45.471948 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:45.541846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625eb477-49ab-44d5-8c77-64ac49bc79ca None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:45.565333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8bc74-b9b8-4911-b5c0-f312f933c757 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:45.587096 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288c26e-adcc-4aae-a594-e873627da512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:45.587749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288c26e-adcc-4aae-a594-e873627da512 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:45.588032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288c26e-adcc-4aae-a594-e873627da512 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:45.588305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288c26e-adcc-4aae-a594-e873627da512 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:45.605639 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288c26e-adcc-4aae-a594-e873627da512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:45.619920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-8288c26e-adcc-4aae-a594-e873627da512 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 06:55:45.619920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:45.619920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:45.619920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:45.619920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:45.619920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:45.619920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:45.619920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:45.619920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:45.619920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:45.619920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:45.619920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:45.619920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:45.619920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:45.619920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:45.619920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:45.620826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:45.620826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:45.620826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:45.620826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:45.620826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:45.620826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:45.620826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:45.620826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:45.620826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:45.620826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:45.620826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:45.620826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:45.620826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:45.620826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:45.620826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:45.620826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:45.621567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:45.621567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:45.621567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:45.621567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:45.621567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:45.621567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:45.621567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:45.621567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:45.621567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:45.621567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:45.621567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 06:55:45.621567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:55:45.621567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 48/102] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:55:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:55:45.640143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288c26e-adcc-4aae-a594-e873627da512 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:45.689454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188be65-5e51-40ee-8689-0d5ce07b3089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:45.690108 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188be65-5e51-40ee-8689-0d5ce07b3089 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:45.690391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188be65-5e51-40ee-8689-0d5ce07b3089 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:45.690666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188be65-5e51-40ee-8689-0d5ce07b3089 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:45.695786 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188be65-5e51-40ee-8689-0d5ce07b3089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:45.697250 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188be65-5e51-40ee-8689-0d5ce07b3089 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:45.698841 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 55/103] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:55:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:45.705672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188be65-5e51-40ee-8689-0d5ce07b3089 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:45.796107 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288c26e-adcc-4aae-a594-e873627da512 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:45.797737 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:45.856336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8394a33-a39f-4155-ace9-606e8b7b7fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:45.856953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8394a33-a39f-4155-ace9-606e8b7b7fea None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:45.857238 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8394a33-a39f-4155-ace9-606e8b7b7fea None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:45.858274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8394a33-a39f-4155-ace9-606e8b7b7fea None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:45.859058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8394a33-a39f-4155-ace9-606e8b7b7fea None admin] RBAC: Adding query filter params (name=reader) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:45.859390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8394a33-a39f-4155-ace9-606e8b7b7fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:45.860763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8394a33-a39f-4155-ace9-606e8b7b7fea None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:45.880675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 49/104] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:55:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:45.886768 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8394a33-a39f-4155-ace9-606e8b7b7fea None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:45.918497 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188be65-5e51-40ee-8689-0d5ce07b3089 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:45.958060 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:46.000178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200386fa-3645-4087-8343-c37df24ea0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:46.000802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200386fa-3645-4087-8343-c37df24ea0a1 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:46.001078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200386fa-3645-4087-8343-c37df24ea0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:46.001355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200386fa-3645-4087-8343-c37df24ea0a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:46.002011 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200386fa-3645-4087-8343-c37df24ea0a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:46.003499 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200386fa-3645-4087-8343-c37df24ea0a1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:46.015942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8394a33-a39f-4155-ace9-606e8b7b7fea None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:46.060580 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63140fa-0047-4be7-9712-7047c86b0162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:46.061736 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 56/105] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Aug 9 06:55:45 2022] POST /identity/v3/projects => generated 302 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:55:46.062081 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63140fa-0047-4be7-9712-7047c86b0162 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:46.062294 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63140fa-0047-4be7-9712-7047c86b0162 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:46.062610 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63140fa-0047-4be7-9712-7047c86b0162 None admin] PATH_INFO: `/v3/users/a0cb17df5b74453893c7bebc2423e39f` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:46.069882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753921-c566-4339-91fb-e45476f10f31 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:46.070891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753921-c566-4339-91fb-e45476f10f31 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:46.070891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753921-c566-4339-91fb-e45476f10f31 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:46.073141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 57/106] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:46 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:46.079421 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ef000-0ff9-4703-bd09-e6f34631064b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:46.080267 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ef000-0ff9-4703-bd09-e6f34631064b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:46.080713 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ef000-0ff9-4703-bd09-e6f34631064b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:46.110106 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63140fa-0047-4be7-9712-7047c86b0162 None admin] RBAC: Authorizing `identity:get_user(user_id=a0cb17df5b74453893c7bebc2423e39f)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:46.111824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63140fa-0047-4be7-9712-7047c86b0162 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:46.113578 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 50/107] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:45 2022] GET /identity/v3/users/a0cb17df5b74453893c7bebc2423e39f => generated 289 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:55:46.115509 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6f3ef000-0ff9-4703-bd09-e6f34631064b None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:46.116980 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6f3ef000-0ff9-4703-bd09-e6f34631064b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:46.130492 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63140fa-0047-4be7-9712-7047c86b0162 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:46.207465 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:46.302113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 58/108] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:55:46.334561 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ef000-0ff9-4703-bd09-e6f34631064b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:46.354713 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63140fa-0047-4be7-9712-7047c86b0162 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:46.425770 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691152c-d6c9-493b-b661-2092680c4d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:46.426386 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691152c-d6c9-493b-b661-2092680c4d69 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:46.426667 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691152c-d6c9-493b-b661-2092680c4d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:46.426940 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691152c-d6c9-493b-b661-2092680c4d69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:46.516214 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691152c-d6c9-493b-b661-2092680c4d69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:46.517681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691152c-d6c9-493b-b661-2092680c4d69 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:46.537729 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:46.541570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ef000-0ff9-4703-bd09-e6f34631064b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:46.544224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:46.582444 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e84e81-5f2a-4716-9fa9-1b41105c3043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:46.582991 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e84e81-5f2a-4716-9fa9-1b41105c3043 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:46.583310 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e84e81-5f2a-4716-9fa9-1b41105c3043 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:46.583582 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e84e81-5f2a-4716-9fa9-1b41105c3043 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:46.599167 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e84e81-5f2a-4716-9fa9-1b41105c3043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:46.604043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c2e84e81-5f2a-4716-9fa9-1b41105c3043 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:55:46.604043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:46.604043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:46.604043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:46.604043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:46.604043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:46.604043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:46.604043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:46.604043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:46.604043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:46.604043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:46.604043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:46.604043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:46.604043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:46.604043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:46.604043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:46.604908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:46.604908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:46.604908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:46.604908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:46.604908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:46.604908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:46.604908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:46.604908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:46.604908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:46.604908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:46.604908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:46.604908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:46.604908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:46.604908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:46.604908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:46.604908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:46.605689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:46.605689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:46.605689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:46.605689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:46.605689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:46.605689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:46.605689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:46.605689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:46.605689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:46.605689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:46.605689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:55:46.605689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:55:46.605689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 59/109] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:55:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:55:46.614791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e84e81-5f2a-4716-9fa9-1b41105c3043 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:46.694893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 51/110] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:55:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:55:46.700101 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691152c-d6c9-493b-b661-2092680c4d69 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:46.757148 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e84e81-5f2a-4716-9fa9-1b41105c3043 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:46.792337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081d0b8-3908-4c3a-8041-5f52231e817f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:46.792953 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081d0b8-3908-4c3a-8041-5f52231e817f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:46.793231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081d0b8-3908-4c3a-8041-5f52231e817f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:46.793502 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081d0b8-3908-4c3a-8041-5f52231e817f None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:46.794159 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081d0b8-3908-4c3a-8041-5f52231e817f None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:46.794460 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081d0b8-3908-4c3a-8041-5f52231e817f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:46.796302 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081d0b8-3908-4c3a-8041-5f52231e817f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:46.804616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 60/111] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:55:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:46.812662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081d0b8-3908-4c3a-8041-5f52231e817f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:46.836047 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:46.883626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691152c-d6c9-493b-b661-2092680c4d69 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:46.927253 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:46.941594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6b077-cf4e-4767-a736-aa6bf82bb78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:46.942284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6b077-cf4e-4767-a736-aa6bf82bb78e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:46.942629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6b077-cf4e-4767-a736-aa6bf82bb78e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:46.942906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6b077-cf4e-4767-a736-aa6bf82bb78e None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:46.944591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6b077-cf4e-4767-a736-aa6bf82bb78e None admin] RBAC: Authorizing `identity:get_project(project_id=b4ee993851d3477d921a816e3f05a39d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:46.946173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6b077-cf4e-4767-a736-aa6bf82bb78e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:46.947969 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 52/112] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:55:46 2022] GET /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:55:46.954294 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6b077-cf4e-4767-a736-aa6bf82bb78e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:46.977294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081d0b8-3908-4c3a-8041-5f52231e817f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:47.064979 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8077a-cd76-4072-99b8-4c7126b315ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:47.065988 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8077a-cd76-4072-99b8-4c7126b315ca None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:47.066496 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8077a-cd76-4072-99b8-4c7126b315ca None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:47.066971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8077a-cd76-4072-99b8-4c7126b315ca None admin] PATH_INFO: `/v3/users/b2506581a1e24052a065de1a855734fd` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:47.071821 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8077a-cd76-4072-99b8-4c7126b315ca None admin] RBAC: Authorizing `identity:get_user(user_id=b2506581a1e24052a065de1a855734fd)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:47.073553 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8077a-cd76-4072-99b8-4c7126b315ca None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:47.075453 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 61/113] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:46 2022] GET /identity/v3/users/b2506581a1e24052a065de1a855734fd => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:47.082412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8077a-cd76-4072-99b8-4c7126b315ca None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:47.163213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6b077-cf4e-4767-a736-aa6bf82bb78e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:47.224989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef4947-b1f7-497a-89b6-9812a53a5fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:47.225617 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef4947-b1f7-497a-89b6-9812a53a5fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:47.225873 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef4947-b1f7-497a-89b6-9812a53a5fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:47.226144 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef4947-b1f7-497a-89b6-9812a53a5fb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:47.226878 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef4947-b1f7-497a-89b6-9812a53a5fb6 None admin] RBAC: Adding query filter params (role.id=3a56edec1d804398814836d8f3aeb8cb, scope.project.id=b4ee993851d3477d921a816e3f05a39d, user.id=a0cb17df5b74453893c7bebc2423e39f) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:47.227205 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef4947-b1f7-497a-89b6-9812a53a5fb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:47.229533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef4947-b1f7-497a-89b6-9812a53a5fb6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:47.244340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 53/114] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:55:46 2022] GET /identity/v3/role_assignments?user.id=a0cb17df5b74453893c7bebc2423e39f&scope.project.id=b4ee993851d3477d921a816e3f05a39d&role.id=3a56edec1d804398814836d8f3aeb8cb => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:47.257781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:47.276233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8077a-cd76-4072-99b8-4c7126b315ca None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:47.319522 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133c71a-6aa2-4bc0-9f7f-52c41f956cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:47.320973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133c71a-6aa2-4bc0-9f7f-52c41f956cda None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:47.321454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133c71a-6aa2-4bc0-9f7f-52c41f956cda None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:47.321962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133c71a-6aa2-4bc0-9f7f-52c41f956cda None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:47.327830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133c71a-6aa2-4bc0-9f7f-52c41f956cda None admin] RBAC: Authorizing `identity:get_project(project_id=b4ee993851d3477d921a816e3f05a39d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:47.329536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133c71a-6aa2-4bc0-9f7f-52c41f956cda None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:47.331697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 62/115] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:55:47 2022] GET /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:55:47.337641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef4947-b1f7-497a-89b6-9812a53a5fb6 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:47.412579 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:47.463624 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef4947-b1f7-497a-89b6-9812a53a5fb6 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:47.495735 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e666eb-f4b2-4f5a-8fa9-5800135c8e12 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:47.496035 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e666eb-f4b2-4f5a-8fa9-5800135c8e12 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:47.496297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e666eb-f4b2-4f5a-8fa9-5800135c8e12 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:47.497912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 63/116] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:47.504131 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44338df-f217-4a8b-8b2d-6de82fcdcdef None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:47.504412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44338df-f217-4a8b-8b2d-6de82fcdcdef None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:47.504688 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44338df-f217-4a8b-8b2d-6de82fcdcdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:47.511704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e27da-8c37-4604-88d1-757fa7a9332e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:47.512394 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e27da-8c37-4604-88d1-757fa7a9332e None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:47.512675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e27da-8c37-4604-88d1-757fa7a9332e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:47.512953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e27da-8c37-4604-88d1-757fa7a9332e None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d/users/b2506581a1e24052a065de1a855734fd/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:47.521071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e27da-8c37-4604-88d1-757fa7a9332e None admin] RBAC: Authorizing `identity:create_grant(project_id=b4ee993851d3477d921a816e3f05a39d, user_id=b2506581a1e24052a065de1a855734fd, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:47.522580 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e27da-8c37-4604-88d1-757fa7a9332e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:47.533506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e44338df-f217-4a8b-8b2d-6de82fcdcdef None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:47.534801 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e44338df-f217-4a8b-8b2d-6de82fcdcdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:47.550246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 54/117] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:55:47 2022] PUT /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d/users/b2506581a1e24052a065de1a855734fd/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:55:47.564338 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d995b-dadf-47b3-aa26-951a89be08f4 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:47.564644 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d995b-dadf-47b3-aa26-951a89be08f4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:47.564902 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d995b-dadf-47b3-aa26-951a89be08f4 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:47.566269 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 55/118] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:47.577906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f2776-38ca-4de8-b546-90584175dd6a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:47.578211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f2776-38ca-4de8-b546-90584175dd6a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:47.578468 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f2776-38ca-4de8-b546-90584175dd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:47.600865 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-bf9f2776-38ca-4de8-b546-90584175dd6a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:47.602119 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bf9f2776-38ca-4de8-b546-90584175dd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:47.644163 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 64/119] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:55:47.681976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 56/120] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:47.683555 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44338df-f217-4a8b-8b2d-6de82fcdcdef None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:47.790298 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f2776-38ca-4de8-b546-90584175dd6a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:47.810187 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:47.840746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44338df-f217-4a8b-8b2d-6de82fcdcdef None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:47.883792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:47.905322 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e11339-b31d-438e-a9fa-67c8fa61a31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:47.905976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e11339-b31d-438e-a9fa-67c8fa61a31f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:47.906260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e11339-b31d-438e-a9fa-67c8fa61a31f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:47.906539 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e11339-b31d-438e-a9fa-67c8fa61a31f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:47.940032 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e11339-b31d-438e-a9fa-67c8fa61a31f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:47.942009 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f2776-38ca-4de8-b546-90584175dd6a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:47.945008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b9e11339-b31d-438e-a9fa-67c8fa61a31f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:55:47.945008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:47.945008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:47.945008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:47.945008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:47.945008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:47.945008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:47.945008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:47.945008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:47.945008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:47.945008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:47.945008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:47.945008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:47.945008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:47.945008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:47.945008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:47.945881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:47.945881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:47.945881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:47.945881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:47.945881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:47.945881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:47.945881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:47.945881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:47.945881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:47.945881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:47.945881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:47.945881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:47.945881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:47.945881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:47.945881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:47.945881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:47.946634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:47.946634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:47.946634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:47.946634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:47.946634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:47.946634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:47.946634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:47.946634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:47.946634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:47.946634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:47.946634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:55:47.946634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:55:47.946634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 65/121] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:55:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:55:47.952385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c588b4-d71d-4fb1-8ea4-38fd9d65aa7e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:47.952765 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c588b4-d71d-4fb1-8ea4-38fd9d65aa7e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:47.952949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c588b4-d71d-4fb1-8ea4-38fd9d65aa7e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:47.954291 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 66/122] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:47.958949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c588b4-d71d-4fb1-8ea4-38fd9d65aa7e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:47.997073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accea68d-af7e-4d15-b0b1-e66fdf86367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:47.997956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accea68d-af7e-4d15-b0b1-e66fdf86367d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:47.998458 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accea68d-af7e-4d15-b0b1-e66fdf86367d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:47.998889 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accea68d-af7e-4d15-b0b1-e66fdf86367d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:48.018640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accea68d-af7e-4d15-b0b1-e66fdf86367d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:48.025846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-accea68d-af7e-4d15-b0b1-e66fdf86367d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:55:48.025846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:48.025846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:48.025846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:48.025846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:48.025846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:48.025846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:48.025846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:48.025846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:48.025846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:48.025846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:48.025846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:48.025846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:48.025846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:48.025846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:48.025846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:48.026732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:48.026732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:48.026732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:48.026732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:48.026732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:48.026732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:48.026732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:48.026732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:48.026732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:48.026732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:48.026732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:48.026732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:48.026732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:48.026732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:48.026732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:48.026732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:48.027523 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:48.027523 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:48.027523 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:48.027523 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:48.027523 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:48.027523 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:48.027523 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:48.027523 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:48.027523 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:48.027523 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:48.027523 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:55:48.027523 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:55:48.028111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 57/123] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:55:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:55:48.029817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233aa90-a452-48f3-8f88-5100076e0701 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:48.035708 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233aa90-a452-48f3-8f88-5100076e0701 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:48.036120 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233aa90-a452-48f3-8f88-5100076e0701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:48.056099 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4233aa90-a452-48f3-8f88-5100076e0701 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:48.057518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4233aa90-a452-48f3-8f88-5100076e0701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:48.124997 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c588b4-d71d-4fb1-8ea4-38fd9d65aa7e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:48.159011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 58/124] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:48.161348 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233aa90-a452-48f3-8f88-5100076e0701 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:48.198194 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d52a0c-6be3-42c9-8d6c-6522fb6daa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:48.198860 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d52a0c-6be3-42c9-8d6c-6522fb6daa4b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:48.199165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d52a0c-6be3-42c9-8d6c-6522fb6daa4b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:48.202244 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d52a0c-6be3-42c9-8d6c-6522fb6daa4b None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:48.202994 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d52a0c-6be3-42c9-8d6c-6522fb6daa4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:48.203343 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d52a0c-6be3-42c9-8d6c-6522fb6daa4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:48.205742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d52a0c-6be3-42c9-8d6c-6522fb6daa4b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:48.215016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 67/125] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:55:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:55:48.220231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d52a0c-6be3-42c9-8d6c-6522fb6daa4b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:48.237078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:48.242853 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:48.371247 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d52a0c-6be3-42c9-8d6c-6522fb6daa4b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:48.385904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233aa90-a452-48f3-8f88-5100076e0701 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:48.426820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c088c57-097e-4eb2-a8bc-88358c713657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:48.427483 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c088c57-097e-4eb2-a8bc-88358c713657 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:48.427767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c088c57-097e-4eb2-a8bc-88358c713657 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:48.428046 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c088c57-097e-4eb2-a8bc-88358c713657 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:48.428718 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c088c57-097e-4eb2-a8bc-88358c713657 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:48.429028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c088c57-097e-4eb2-a8bc-88358c713657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:48.430398 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c088c57-097e-4eb2-a8bc-88358c713657 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:48.438797 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923ac0f-1b93-40a2-94d6-335cb2f0931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:48.439476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923ac0f-1b93-40a2-94d6-335cb2f0931a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:48.439763 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923ac0f-1b93-40a2-94d6-335cb2f0931a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:48.440042 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923ac0f-1b93-40a2-94d6-335cb2f0931a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:48.440140 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 59/126] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:55:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:48.440902 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c088c57-097e-4eb2-a8bc-88358c713657 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:48.468271 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d923ac0f-1b93-40a2-94d6-335cb2f0931a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:48.473566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d923ac0f-1b93-40a2-94d6-335cb2f0931a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:55:48.473566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:48.473566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:48.473566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:48.473566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:48.473566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:48.473566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:48.473566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:48.473566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:48.473566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:48.473566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:48.473566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:48.473566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:48.473566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:48.473566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:48.473566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:48.474422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:48.474422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:48.474422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:48.474422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:48.474422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:48.474422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:48.474422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:48.474422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:48.474422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:48.474422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:48.474422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:48.474422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:48.474422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:48.474422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:48.474422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:48.474422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:48.475221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:48.475221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:48.475221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:48.475221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:48.475221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:48.475221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:48.475221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:48.475221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:48.475221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:48.475221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:48.475221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:55:48.475221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:55:48.475221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 68/127] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:55:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:55:48.481551 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923ac0f-1b93-40a2-94d6-335cb2f0931a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:48.568046 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:48.570217 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:48.580897 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c088c57-097e-4eb2-a8bc-88358c713657 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:48.624809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278a74c-9836-49db-9f2f-cc3ce67a65fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:48.625370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278a74c-9836-49db-9f2f-cc3ce67a65fe None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:48.625650 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278a74c-9836-49db-9f2f-cc3ce67a65fe None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:48.625921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278a74c-9836-49db-9f2f-cc3ce67a65fe None admin] PATH_INFO: `/v3/users/b2506581a1e24052a065de1a855734fd` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:48.635213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278a74c-9836-49db-9f2f-cc3ce67a65fe None admin] RBAC: Authorizing `identity:get_user(user_id=b2506581a1e24052a065de1a855734fd)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:48.636681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278a74c-9836-49db-9f2f-cc3ce67a65fe None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:48.638475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 60/128] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:48 2022] GET /identity/v3/users/b2506581a1e24052a065de1a855734fd => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:48.643579 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278a74c-9836-49db-9f2f-cc3ce67a65fe None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:48.643710 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923ac0f-1b93-40a2-94d6-335cb2f0931a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:48.684447 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b3d24-d815-4bff-9452-b20482256368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:48.685101 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b3d24-d815-4bff-9452-b20482256368 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:48.685381 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b3d24-d815-4bff-9452-b20482256368 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:48.686262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b3d24-d815-4bff-9452-b20482256368 None admin] PATH_INFO: `/v3/users/bcf6cd86a276482e8265d5687ef8c40a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:48.687448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b3d24-d815-4bff-9452-b20482256368 None admin] RBAC: Authorizing `identity:get_user(user_id=bcf6cd86a276482e8265d5687ef8c40a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:48.688908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b3d24-d815-4bff-9452-b20482256368 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:48.690472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 69/129] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:48 2022] GET /identity/v3/users/bcf6cd86a276482e8265d5687ef8c40a => generated 247 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:48.691269 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b3d24-d815-4bff-9452-b20482256368 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:48.820706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b3d24-d815-4bff-9452-b20482256368 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:48.829124 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278a74c-9836-49db-9f2f-cc3ce67a65fe None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:48.864267 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395faed1-8ffb-435f-8c2f-e4c3b58c374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:48.864465 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721e460-d29a-4b3a-815a-db757f0d9246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:48.864894 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395faed1-8ffb-435f-8c2f-e4c3b58c374e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:48.864996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e460-d29a-4b3a-815a-db757f0d9246 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:48.865181 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395faed1-8ffb-435f-8c2f-e4c3b58c374e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:48.865275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e460-d29a-4b3a-815a-db757f0d9246 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:48.865465 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395faed1-8ffb-435f-8c2f-e4c3b58c374e None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:48.865557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e460-d29a-4b3a-815a-db757f0d9246 None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:48.866136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395faed1-8ffb-435f-8c2f-e4c3b58c374e None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:48.866448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395faed1-8ffb-435f-8c2f-e4c3b58c374e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:48.866653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721e460-d29a-4b3a-815a-db757f0d9246 None admin] RBAC: Authorizing `identity:get_project(project_id=b4ee993851d3477d921a816e3f05a39d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:48.867989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395faed1-8ffb-435f-8c2f-e4c3b58c374e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:48.868092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721e460-d29a-4b3a-815a-db757f0d9246 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:48.870022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 70/130] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:55:48 2022] GET /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:48.870799 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721e460-d29a-4b3a-815a-db757f0d9246 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:48.876927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 61/131] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:55:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:48.877683 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395faed1-8ffb-435f-8c2f-e4c3b58c374e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:48.881438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:48.910131 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:48.989245 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395faed1-8ffb-435f-8c2f-e4c3b58c374e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:49.026031 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301f1e7-5cc8-4c28-be81-86f37b758a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:49.027040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301f1e7-5cc8-4c28-be81-86f37b758a1d None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:49.027528 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301f1e7-5cc8-4c28-be81-86f37b758a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:49.027949 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301f1e7-5cc8-4c28-be81-86f37b758a1d None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d/users/b2506581a1e24052a065de1a855734fd/roles/617e0c2609e3413ea3273113659bccbc` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:49.030969 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301f1e7-5cc8-4c28-be81-86f37b758a1d None admin] RBAC: Authorizing `identity:create_grant(project_id=b4ee993851d3477d921a816e3f05a39d, user_id=b2506581a1e24052a065de1a855734fd, role_id=617e0c2609e3413ea3273113659bccbc)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:49.032659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301f1e7-5cc8-4c28-be81-86f37b758a1d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:49.052741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 62/132] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:55:48 2022] PUT /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d/users/b2506581a1e24052a065de1a855734fd/roles/617e0c2609e3413ea3273113659bccbc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:55:49.055355 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301f1e7-5cc8-4c28-be81-86f37b758a1d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:49.081663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721e460-d29a-4b3a-815a-db757f0d9246 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:49.145932 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef507e2-e105-4b79-b76e-5dd3aa8b7660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:49.147233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef507e2-e105-4b79-b76e-5dd3aa8b7660 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:49.147233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef507e2-e105-4b79-b76e-5dd3aa8b7660 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:49.147233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef507e2-e105-4b79-b76e-5dd3aa8b7660 None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:49.148657 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef507e2-e105-4b79-b76e-5dd3aa8b7660 None admin] RBAC: Authorizing `identity:get_project(project_id=b4ee993851d3477d921a816e3f05a39d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:49.150270 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef507e2-e105-4b79-b76e-5dd3aa8b7660 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:49.152057 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 71/133] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:55:48 2022] GET /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:49.161274 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef507e2-e105-4b79-b76e-5dd3aa8b7660 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:49.170996 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:49.190515 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301f1e7-5cc8-4c28-be81-86f37b758a1d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:49.229942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b63eb9-210e-49f5-88ea-b3544c4f18f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:49.230999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b63eb9-210e-49f5-88ea-b3544c4f18f8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:49.231537 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b63eb9-210e-49f5-88ea-b3544c4f18f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:49.232116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b63eb9-210e-49f5-88ea-b3544c4f18f8 None admin] PATH_INFO: `/v3/users/b2506581a1e24052a065de1a855734fd` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:49.234070 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b63eb9-210e-49f5-88ea-b3544c4f18f8 None admin] RBAC: Authorizing `identity:get_user(user_id=b2506581a1e24052a065de1a855734fd)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:49.235853 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b63eb9-210e-49f5-88ea-b3544c4f18f8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:49.237727 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 63/134] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:49 2022] GET /identity/v3/users/b2506581a1e24052a065de1a855734fd => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:49.243319 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b63eb9-210e-49f5-88ea-b3544c4f18f8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:49.301363 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:49.344876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef507e2-e105-4b79-b76e-5dd3aa8b7660 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:49.375829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b63eb9-210e-49f5-88ea-b3544c4f18f8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:49.397265 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e85dc1-73a7-4cb1-8a33-85e3302d56f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:49.399109 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e85dc1-73a7-4cb1-8a33-85e3302d56f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:49.399850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e85dc1-73a7-4cb1-8a33-85e3302d56f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:49.400326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e85dc1-73a7-4cb1-8a33-85e3302d56f1 None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d/users/bcf6cd86a276482e8265d5687ef8c40a/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:49.403533 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e85dc1-73a7-4cb1-8a33-85e3302d56f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4ee993851d3477d921a816e3f05a39d, user_id=bcf6cd86a276482e8265d5687ef8c40a, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:49.406323 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e85dc1-73a7-4cb1-8a33-85e3302d56f1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:49.414885 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ef766-6fed-4245-8e13-17c9e3779955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:49.415714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ef766-6fed-4245-8e13-17c9e3779955 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:49.416005 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ef766-6fed-4245-8e13-17c9e3779955 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:49.416309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ef766-6fed-4245-8e13-17c9e3779955 None admin] PATH_INFO: `/v3/projects/399b874cda444e5aaab1d85d5d2842f4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:49.417553 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ef766-6fed-4245-8e13-17c9e3779955 None admin] RBAC: Authorizing `identity:get_project(project_id=399b874cda444e5aaab1d85d5d2842f4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:49.419209 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ef766-6fed-4245-8e13-17c9e3779955 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:49.422229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 64/135] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:55:49 2022] GET /identity/v3/projects/399b874cda444e5aaab1d85d5d2842f4 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:49.425636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 72/136] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:55:49 2022] PUT /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d/users/bcf6cd86a276482e8265d5687ef8c40a/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:55:49.430847 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ef766-6fed-4245-8e13-17c9e3779955 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:49.471207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:49.476760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c74c79-6682-4216-8664-15105ee7bf75 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:49.477434 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c74c79-6682-4216-8664-15105ee7bf75 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:49.477918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c74c79-6682-4216-8664-15105ee7bf75 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:49.483702 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 73/137] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:49.489064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b47d11-cee2-45b3-810a-5f36302dc662 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:49.489611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b47d11-cee2-45b3-810a-5f36302dc662 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:49.490077 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b47d11-cee2-45b3-810a-5f36302dc662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:49.529244 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f2b47d11-cee2-45b3-810a-5f36302dc662 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:49.531525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f2b47d11-cee2-45b3-810a-5f36302dc662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:49.598672 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ef766-6fed-4245-8e13-17c9e3779955 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:49.640836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263efa6-708d-4f93-a075-9d93583ce4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:49.641860 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263efa6-708d-4f93-a075-9d93583ce4cc None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:49.642358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263efa6-708d-4f93-a075-9d93583ce4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:49.642829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263efa6-708d-4f93-a075-9d93583ce4cc None admin] PATH_INFO: `/v3/projects/399b874cda444e5aaab1d85d5d2842f4/users/b2506581a1e24052a065de1a855734fd/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:49.645148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263efa6-708d-4f93-a075-9d93583ce4cc None admin] RBAC: Authorizing `identity:create_grant(project_id=399b874cda444e5aaab1d85d5d2842f4, user_id=b2506581a1e24052a065de1a855734fd, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:49.647045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263efa6-708d-4f93-a075-9d93583ce4cc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:49.647705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 74/138] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:49.673591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 65/139] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:55:49 2022] PUT /identity/v3/projects/399b874cda444e5aaab1d85d5d2842f4/users/b2506581a1e24052a065de1a855734fd/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:55:49.693736 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b47d11-cee2-45b3-810a-5f36302dc662 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:49.763485 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:49.814248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b47d11-cee2-45b3-810a-5f36302dc662 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:49.859119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29312b2e-a669-4d26-b226-1d467abf8038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:49.859791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29312b2e-a669-4d26-b226-1d467abf8038 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:49.860071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29312b2e-a669-4d26-b226-1d467abf8038 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:49.860344 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29312b2e-a669-4d26-b226-1d467abf8038 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:49.861511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29312b2e-a669-4d26-b226-1d467abf8038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:49.863011 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29312b2e-a669-4d26-b226-1d467abf8038 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:49.865005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 75/140] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:55:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:49.870710 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263efa6-708d-4f93-a075-9d93583ce4cc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:49.981039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:50.004290 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263efa6-708d-4f93-a075-9d93583ce4cc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:50.042929 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5c471-e43d-4f50-b1f2-669edfabdb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:50.043967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5c471-e43d-4f50-b1f2-669edfabdb08 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:50.044496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5c471-e43d-4f50-b1f2-669edfabdb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:50.045526 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5c471-e43d-4f50-b1f2-669edfabdb08 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:50.046452 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5c471-e43d-4f50-b1f2-669edfabdb08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:50.048119 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5c471-e43d-4f50-b1f2-669edfabdb08 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:50.079238 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 66/141] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Aug 9 06:55:49 2022] POST /identity/v3/users => generated 283 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:55:50.199120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790f5df-b9fa-4b80-92cc-19b61c03abcb None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:50.199500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790f5df-b9fa-4b80-92cc-19b61c03abcb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:50.199675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790f5df-b9fa-4b80-92cc-19b61c03abcb None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:50.201696 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 76/142] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:50.208037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8efeb4-3a47-47fc-bf3d-9c5a502139c8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:50.208649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8efeb4-3a47-47fc-bf3d-9c5a502139c8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:50.209125 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8efeb4-3a47-47fc-bf3d-9c5a502139c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:50.235239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4b8efeb4-3a47-47fc-bf3d-9c5a502139c8 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:50.236783 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4b8efeb4-3a47-47fc-bf3d-9c5a502139c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:50.318596 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8b9e4-3a19-40a0-984c-2f8ec16bc355 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:50.318918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8b9e4-3a19-40a0-984c-2f8ec16bc355 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:50.319253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8b9e4-3a19-40a0-984c-2f8ec16bc355 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:50.320596 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 77/143] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:50.327862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb2b24-3537-406e-a2e5-c9beebb690a3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:50.328829 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb2b24-3537-406e-a2e5-c9beebb690a3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:50.330191 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb2b24-3537-406e-a2e5-c9beebb690a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:50.334344 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 67/144] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:50.359491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ecdb2b24-3537-406e-a2e5-c9beebb690a3 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:50.360698 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ecdb2b24-3537-406e-a2e5-c9beebb690a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:50.374234 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8efeb4-3a47-47fc-bf3d-9c5a502139c8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:50.448083 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:50.455022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 78/145] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:50.489818 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb2b24-3537-406e-a2e5-c9beebb690a3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:50.490383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8efeb4-3a47-47fc-bf3d-9c5a502139c8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:50.532254 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041cb2e-60ee-4182-a904-962785d60d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:50.533266 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041cb2e-60ee-4182-a904-962785d60d6c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:50.533746 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041cb2e-60ee-4182-a904-962785d60d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:50.534337 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041cb2e-60ee-4182-a904-962785d60d6c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:50.552881 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041cb2e-60ee-4182-a904-962785d60d6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:50.562172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-6041cb2e-60ee-4182-a904-962785d60d6c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 06:55:50.562172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:50.562172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:50.562172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:50.562172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:50.562172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:50.562172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:50.562172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:50.562172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:50.562172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:50.562172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:50.562172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:50.562172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:50.562172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:50.562172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:50.562172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:50.563105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:50.563105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:50.563105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:50.563105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:50.563105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:50.563105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:50.563105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:50.563105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:50.563105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:50.563105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:50.563105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:50.563105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:50.563105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:50.563105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:50.563105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:50.563105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:50.564351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:50.564351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:50.564351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:50.564351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:50.564351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:50.564351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:50.564351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:50.564351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:50.564351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:50.564351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:50.564351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 06:55:50.564351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:55:50.564351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 68/146] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:55:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:55:50.571183 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041cb2e-60ee-4182-a904-962785d60d6c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:50.576825 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:50.635109 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb2b24-3537-406e-a2e5-c9beebb690a3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:50.690584 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09057f78-b702-490c-9286-9b93908cf810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:50.690584 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09057f78-b702-490c-9286-9b93908cf810 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:50.690873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09057f78-b702-490c-9286-9b93908cf810 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:50.691105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09057f78-b702-490c-9286-9b93908cf810 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:50.708700 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09057f78-b702-490c-9286-9b93908cf810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:50.723948 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041cb2e-60ee-4182-a904-962785d60d6c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:50.724971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-09057f78-b702-490c-9286-9b93908cf810 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:55:50.724971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:50.724971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:50.724971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:50.724971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:50.724971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:50.724971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:50.724971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:50.724971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:50.724971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:50.724971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:50.724971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:50.724971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:50.724971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:50.724971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:50.724971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:50.725820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:50.725820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:50.725820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:50.725820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:50.725820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:50.725820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:50.725820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:50.725820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:50.725820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:50.725820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:50.725820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:50.725820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:50.725820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:50.725820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:50.725820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:50.725820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:50.726575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:50.726575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:50.726575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:50.726575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:50.726575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:50.726575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:50.726575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:50.726575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:50.726575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:50.726575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:50.726575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:55:50.726575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:55:50.728865 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 79/147] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:55:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:55:50.739363 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09057f78-b702-490c-9286-9b93908cf810 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:50.782368 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:50.804075 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c4a02-e01f-4600-ab9a-806e77e8bf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:50.805074 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c4a02-e01f-4600-ab9a-806e77e8bf42 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:50.805584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c4a02-e01f-4600-ab9a-806e77e8bf42 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:50.806055 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c4a02-e01f-4600-ab9a-806e77e8bf42 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:50.811373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c4a02-e01f-4600-ab9a-806e77e8bf42 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:50.811929 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c4a02-e01f-4600-ab9a-806e77e8bf42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:50.814483 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c4a02-e01f-4600-ab9a-806e77e8bf42 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:50.834860 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 69/148] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:55:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:50.840974 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c4a02-e01f-4600-ab9a-806e77e8bf42 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:50.880847 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09057f78-b702-490c-9286-9b93908cf810 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:50.907592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:50.923242 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562fb42-d952-477a-8947-f28be43783c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:50.923866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562fb42-d952-477a-8947-f28be43783c4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:50.924150 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562fb42-d952-477a-8947-f28be43783c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:50.924939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562fb42-d952-477a-8947-f28be43783c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:50.925612 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562fb42-d952-477a-8947-f28be43783c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:50.925918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562fb42-d952-477a-8947-f28be43783c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:50.927356 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562fb42-d952-477a-8947-f28be43783c4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:50.939414 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 80/149] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:55:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:55:50.950854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562fb42-d952-477a-8947-f28be43783c4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:51.108454 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c4a02-e01f-4600-ab9a-806e77e8bf42 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:51.155661 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562fb42-d952-477a-8947-f28be43783c4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:51.172330 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb9783-acd3-4f01-9ea4-d9d24a2136d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:51.173476 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb9783-acd3-4f01-9ea4-d9d24a2136d8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:51.173950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb9783-acd3-4f01-9ea4-d9d24a2136d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:51.174416 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb9783-acd3-4f01-9ea4-d9d24a2136d8 None admin] PATH_INFO: `/v3/users/a0cb17df5b74453893c7bebc2423e39f` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:51.176553 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb9783-acd3-4f01-9ea4-d9d24a2136d8 None admin] RBAC: Authorizing `identity:get_user(user_id=a0cb17df5b74453893c7bebc2423e39f)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:51.179213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb9783-acd3-4f01-9ea4-d9d24a2136d8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:51.182673 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 70/150] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:50 2022] GET /identity/v3/users/a0cb17df5b74453893c7bebc2423e39f => generated 289 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:51.188029 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb9783-acd3-4f01-9ea4-d9d24a2136d8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:51.211815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb03d5-304a-4974-9ec4-52326b6013bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:51.212464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb03d5-304a-4974-9ec4-52326b6013bb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:51.212744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb03d5-304a-4974-9ec4-52326b6013bb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:51.213019 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb03d5-304a-4974-9ec4-52326b6013bb None admin] PATH_INFO: `/v3/users/b2506581a1e24052a065de1a855734fd` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:51.214307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb03d5-304a-4974-9ec4-52326b6013bb None admin] RBAC: Authorizing `identity:get_user(user_id=b2506581a1e24052a065de1a855734fd)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:51.215770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb03d5-304a-4974-9ec4-52326b6013bb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:51.218506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 81/151] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:50 2022] GET /identity/v3/users/b2506581a1e24052a065de1a855734fd => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:51.228057 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb03d5-304a-4974-9ec4-52326b6013bb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:51.328861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:51.336781 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:51.406417 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb03d5-304a-4974-9ec4-52326b6013bb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:51.449545 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb9783-acd3-4f01-9ea4-d9d24a2136d8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:51.499976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df267b-3fc1-41e3-a526-f45cfd9c6a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:51.500694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df267b-3fc1-41e3-a526-f45cfd9c6a07 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:51.500973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df267b-3fc1-41e3-a526-f45cfd9c6a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:51.501243 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df267b-3fc1-41e3-a526-f45cfd9c6a07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:51.531557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad1c47-8671-4f0f-9b31-8187fb1d0f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:51.532204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad1c47-8671-4f0f-9b31-8187fb1d0f7d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:51.532483 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad1c47-8671-4f0f-9b31-8187fb1d0f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:51.532758 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad1c47-8671-4f0f-9b31-8187fb1d0f7d None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:51.533898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad1c47-8671-4f0f-9b31-8187fb1d0f7d None admin] RBAC: Authorizing `identity:get_project(project_id=b4ee993851d3477d921a816e3f05a39d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:51.535350 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad1c47-8671-4f0f-9b31-8187fb1d0f7d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:51.536984 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 71/152] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:55:51 2022] GET /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d => generated 298 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:55:51.542854 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad1c47-8671-4f0f-9b31-8187fb1d0f7d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:51.645918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df267b-3fc1-41e3-a526-f45cfd9c6a07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:51.647409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df267b-3fc1-41e3-a526-f45cfd9c6a07 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:51.744069 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad1c47-8671-4f0f-9b31-8187fb1d0f7d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:51.746381 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:51.813694 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:51.833310 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087044c-097b-4ea6-a6a2-32f0221fdad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:51.833986 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087044c-097b-4ea6-a6a2-32f0221fdad4 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:51.834261 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087044c-097b-4ea6-a6a2-32f0221fdad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:51.834546 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087044c-097b-4ea6-a6a2-32f0221fdad4 None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d/users/a0cb17df5b74453893c7bebc2423e39f/roles/3a56edec1d804398814836d8f3aeb8cb` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:51.840332 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087044c-097b-4ea6-a6a2-32f0221fdad4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4ee993851d3477d921a816e3f05a39d, user_id=a0cb17df5b74453893c7bebc2423e39f, role_id=3a56edec1d804398814836d8f3aeb8cb)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:51.841802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087044c-097b-4ea6-a6a2-32f0221fdad4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:51.875490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 82/153] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:55:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:55:51.880423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 72/154] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:55:51 2022] PUT /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d/users/a0cb17df5b74453893c7bebc2423e39f/roles/3a56edec1d804398814836d8f3aeb8cb => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:55:51.882365 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df267b-3fc1-41e3-a526-f45cfd9c6a07 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:52.066403 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df267b-3fc1-41e3-a526-f45cfd9c6a07 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:52.115817 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78c23c-b5da-466d-b0a3-8ea7ac4a5bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:52.116466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78c23c-b5da-466d-b0a3-8ea7ac4a5bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:52.116740 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78c23c-b5da-466d-b0a3-8ea7ac4a5bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:52.117006 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78c23c-b5da-466d-b0a3-8ea7ac4a5bb2 None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:52.118167 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78c23c-b5da-466d-b0a3-8ea7ac4a5bb2 None admin] RBAC: Authorizing `identity:get_project(project_id=b4ee993851d3477d921a816e3f05a39d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:52.119661 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78c23c-b5da-466d-b0a3-8ea7ac4a5bb2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:52.121297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 83/155] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:55:51 2022] GET /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:52.128204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087044c-097b-4ea6-a6a2-32f0221fdad4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:52.330048 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087044c-097b-4ea6-a6a2-32f0221fdad4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:52.376143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3804d-03dc-492a-9b1d-fad067f2ed19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:52.377607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3804d-03dc-492a-9b1d-fad067f2ed19 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:52.378101 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3804d-03dc-492a-9b1d-fad067f2ed19 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:52.378581 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3804d-03dc-492a-9b1d-fad067f2ed19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:52.379550 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3804d-03dc-492a-9b1d-fad067f2ed19 None admin] RBAC: Adding query filter params (role.id=decfb257a46442b8b4637f8c95c9967b, scope.project.id=b4ee993851d3477d921a816e3f05a39d, user.id=b2506581a1e24052a065de1a855734fd) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:52.380071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3804d-03dc-492a-9b1d-fad067f2ed19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:52.381690 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3804d-03dc-492a-9b1d-fad067f2ed19 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:52.389149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 73/156] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:55:52 2022] GET /identity/v3/role_assignments?user.id=b2506581a1e24052a065de1a855734fd&scope.project.id=b4ee993851d3477d921a816e3f05a39d&role.id=decfb257a46442b8b4637f8c95c9967b => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:53.199400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744aa4-a6a7-4858-b12b-2c1aae1fd188 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:53.199945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744aa4-a6a7-4858-b12b-2c1aae1fd188 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:53.199945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744aa4-a6a7-4858-b12b-2c1aae1fd188 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:53.201602 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 84/157] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:53.206833 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17855d37-811c-47c2-8515-29b29b065cf1 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:53.207149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17855d37-811c-47c2-8515-29b29b065cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:53.207493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17855d37-811c-47c2-8515-29b29b065cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:53.233251 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-17855d37-811c-47c2-8515-29b29b065cf1 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:53.234451 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-17855d37-811c-47c2-8515-29b29b065cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:53.292612 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:53.319631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 74/158] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:53.342788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c995c02-5d70-409f-8cfc-d258a214f2da None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:53.343409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c995c02-5d70-409f-8cfc-d258a214f2da None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:53.343893 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c995c02-5d70-409f-8cfc-d258a214f2da None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:53.345428 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 85/159] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:53.351007 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f87783-3d64-48be-a15b-f7a7b231cd59 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:53.351522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f87783-3d64-48be-a15b-f7a7b231cd59 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:53.351940 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f87783-3d64-48be-a15b-f7a7b231cd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:53.368523 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c995c02-5d70-409f-8cfc-d258a214f2da None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:53.371512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e5f87783-3d64-48be-a15b-f7a7b231cd59 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:53.372878 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e5f87783-3d64-48be-a15b-f7a7b231cd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:53.408252 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:53.479971 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 75/160] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:53.481310 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081c8d5-e1ac-46d7-a2e8-db91935e26e5 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:53.481650 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081c8d5-e1ac-46d7-a2e8-db91935e26e5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:53.481916 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081c8d5-e1ac-46d7-a2e8-db91935e26e5 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:53.483281 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 76/161] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:53.492439 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d61228-6928-4842-8881-bd9630f61a44 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:53.492710 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d61228-6928-4842-8881-bd9630f61a44 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:53.492984 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d61228-6928-4842-8881-bd9630f61a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:53.522904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-78d61228-6928-4842-8881-bd9630f61a44 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:53.524157 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-78d61228-6928-4842-8881-bd9630f61a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:53.595762 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c995c02-5d70-409f-8cfc-d258a214f2da None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:53.645333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03faa9c2-6390-42f2-9bdc-7500921deab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:53.645333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faa9c2-6390-42f2-9bdc-7500921deab3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:53.645733 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faa9c2-6390-42f2-9bdc-7500921deab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:53.646133 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faa9c2-6390-42f2-9bdc-7500921deab3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:53.669656 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03faa9c2-6390-42f2-9bdc-7500921deab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:53.680970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-03faa9c2-6390-42f2-9bdc-7500921deab3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:55:53.680970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:53.680970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:53.680970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:53.680970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:53.680970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:53.680970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:53.680970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:53.680970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:53.680970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:53.680970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:53.680970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:53.680970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:53.680970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:53.680970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:53.680970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:53.681891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:53.681891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:53.681891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:53.681891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:53.681891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:53.681891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:53.681891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:53.681891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:53.681891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:53.681891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:53.681891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:53.681891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:53.681891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:53.681891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:53.681891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:53.681891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:53.688012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:53.688012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:53.688012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:53.688012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:53.688012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:53.688012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:53.688012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:53.688012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:53.688012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:53.688012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:53.688012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:55:53.688012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:55:53.688012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 86/162] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:55:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:55:53.688012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03faa9c2-6390-42f2-9bdc-7500921deab3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:53.719259 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 77/163] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:53.720529 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d61228-6928-4842-8881-bd9630f61a44 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:53.836006 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:53.842896 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:53.858052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03faa9c2-6390-42f2-9bdc-7500921deab3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:53.906430 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd696f-88c2-4af6-9ef4-45744e0236f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:53.907104 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd696f-88c2-4af6-9ef4-45744e0236f4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:53.907389 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd696f-88c2-4af6-9ef4-45744e0236f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:53.907658 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd696f-88c2-4af6-9ef4-45744e0236f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:53.933375 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd696f-88c2-4af6-9ef4-45744e0236f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:53.943998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-29fd696f-88c2-4af6-9ef4-45744e0236f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:55:53.943998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:53.943998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:53.943998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:53.943998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:53.943998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:53.943998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:53.943998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:53.943998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:53.943998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:53.943998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:53.943998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:53.943998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:53.943998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:53.943998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:53.943998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:53.945689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:53.945689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:53.945689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:53.945689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:53.945689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:53.945689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:53.945689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:53.945689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:53.945689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:53.945689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:53.945689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:53.945689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:53.945689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:53.945689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:53.945689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:53.945689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:53.946455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:53.946455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:53.946455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:53.946455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:53.946455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:53.946455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:53.946455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:53.946455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:53.946455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:53.946455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:53.946455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:55:53.946455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:55:53.946455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 87/164] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:55:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:55:53.946455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd696f-88c2-4af6-9ef4-45744e0236f4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:53.977188 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d61228-6928-4842-8881-bd9630f61a44 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:54.057518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc24787-e2bf-433c-ac9b-a8d5025704cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:54.058142 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc24787-e2bf-433c-ac9b-a8d5025704cd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:54.058419 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc24787-e2bf-433c-ac9b-a8d5025704cd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:54.058688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc24787-e2bf-433c-ac9b-a8d5025704cd None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:54.059396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc24787-e2bf-433c-ac9b-a8d5025704cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:54.059697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc24787-e2bf-433c-ac9b-a8d5025704cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:54.061852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc24787-e2bf-433c-ac9b-a8d5025704cd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:54.089112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 78/165] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:55:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:54.089998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc24787-e2bf-433c-ac9b-a8d5025704cd None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:54.174685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd696f-88c2-4af6-9ef4-45744e0236f4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:54.223344 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3dd90-e2dd-433a-8776-8962a5a59296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:54.224843 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3dd90-e2dd-433a-8776-8962a5a59296 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:54.225314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3dd90-e2dd-433a-8776-8962a5a59296 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:54.225772 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3dd90-e2dd-433a-8776-8962a5a59296 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:54.251796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc24787-e2bf-433c-ac9b-a8d5025704cd None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:54.256858 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:54.262462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:54.267610 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3dd90-e2dd-433a-8776-8962a5a59296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:54.273603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-66a3dd90-e2dd-433a-8776-8962a5a59296 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:55:54.273603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:54.273603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:54.273603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:54.273603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:54.273603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:54.273603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:54.273603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:54.273603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:54.273603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:54.273603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:54.273603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:54.273603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:54.273603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:54.273603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:54.273603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:54.274831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:54.274831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:54.274831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:54.274831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:54.274831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:54.274831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:54.274831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:54.274831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:54.274831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:54.274831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:54.274831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:54.274831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:54.274831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:54.274831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:54.274831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:54.274831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:54.275826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:54.275826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:54.275826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:54.275826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:54.275826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:54.275826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:54.275826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:54.275826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:54.275826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:54.275826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:54.275826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:55:54.275826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:55:54.287380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 88/166] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:55:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:55:54.288500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3dd90-e2dd-433a-8776-8962a5a59296 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:54.331403 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c54d1-98e0-4b8d-9c5c-c33b3532704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:54.332406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c54d1-98e0-4b8d-9c5c-c33b3532704b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:54.332699 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c54d1-98e0-4b8d-9c5c-c33b3532704b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:54.332972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c54d1-98e0-4b8d-9c5c-c33b3532704b None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:54.333657 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c54d1-98e0-4b8d-9c5c-c33b3532704b None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:54.333959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c54d1-98e0-4b8d-9c5c-c33b3532704b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:54.335364 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c54d1-98e0-4b8d-9c5c-c33b3532704b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:54.357861 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 79/167] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:55:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:54.358688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c54d1-98e0-4b8d-9c5c-c33b3532704b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:54.487639 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3dd90-e2dd-433a-8776-8962a5a59296 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:54.547508 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfabd2b-5bfe-438b-bfe3-efa5575a6336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:54.548159 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfabd2b-5bfe-438b-bfe3-efa5575a6336 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:54.548435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfabd2b-5bfe-438b-bfe3-efa5575a6336 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:54.548703 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfabd2b-5bfe-438b-bfe3-efa5575a6336 None admin] PATH_INFO: `/v3/users/b2506581a1e24052a065de1a855734fd` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:54.549966 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfabd2b-5bfe-438b-bfe3-efa5575a6336 None admin] RBAC: Authorizing `identity:get_user(user_id=b2506581a1e24052a065de1a855734fd)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:54.551470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfabd2b-5bfe-438b-bfe3-efa5575a6336 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:54.553250 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 89/168] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:54 2022] GET /identity/v3/users/b2506581a1e24052a065de1a855734fd => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:54.554024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfabd2b-5bfe-438b-bfe3-efa5575a6336 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:54.613068 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c54d1-98e0-4b8d-9c5c-c33b3532704b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:54.679956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:54.690894 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2435d5-a469-41da-af35-d50590a9313a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:54.691655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2435d5-a469-41da-af35-d50590a9313a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:54.691938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2435d5-a469-41da-af35-d50590a9313a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:54.692213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2435d5-a469-41da-af35-d50590a9313a None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:54.692882 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2435d5-a469-41da-af35-d50590a9313a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:54.693186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2435d5-a469-41da-af35-d50590a9313a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:54.694550 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2435d5-a469-41da-af35-d50590a9313a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:54.710908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 80/169] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:55:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:54.711523 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2435d5-a469-41da-af35-d50590a9313a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:54.753525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfabd2b-5bfe-438b-bfe3-efa5575a6336 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:54.771482 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:54.825101 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0732b3-fd98-4881-ad6f-bfced46e9bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:54.825817 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0732b3-fd98-4881-ad6f-bfced46e9bef None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:54.826156 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0732b3-fd98-4881-ad6f-bfced46e9bef None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:54.826428 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0732b3-fd98-4881-ad6f-bfced46e9bef None admin] PATH_INFO: `/v3/users/b2506581a1e24052a065de1a855734fd` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:54.828949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0732b3-fd98-4881-ad6f-bfced46e9bef None admin] RBAC: Authorizing `identity:get_user(user_id=b2506581a1e24052a065de1a855734fd)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:54.830653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0732b3-fd98-4881-ad6f-bfced46e9bef None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:54.833070 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 90/170] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:54 2022] GET /identity/v3/users/b2506581a1e24052a065de1a855734fd => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:54.833851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0732b3-fd98-4881-ad6f-bfced46e9bef None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:54.949131 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2435d5-a469-41da-af35-d50590a9313a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:55.005640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b256d-5aaf-4160-a321-d3cb24df9519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:55.006354 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b256d-5aaf-4160-a321-d3cb24df9519 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:55.006655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b256d-5aaf-4160-a321-d3cb24df9519 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:55.007006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b256d-5aaf-4160-a321-d3cb24df9519 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:55.026596 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0732b3-fd98-4881-ad6f-bfced46e9bef None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:55.069499 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f2c8b-b7fb-4c76-bf0c-17c4d44567c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:55.070465 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f2c8b-b7fb-4c76-bf0c-17c4d44567c3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:55.070749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f2c8b-b7fb-4c76-bf0c-17c4d44567c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:55.071309 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f2c8b-b7fb-4c76-bf0c-17c4d44567c3 None admin] PATH_INFO: `/v3/users/bcf6cd86a276482e8265d5687ef8c40a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:55.072624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f2c8b-b7fb-4c76-bf0c-17c4d44567c3 None admin] RBAC: Authorizing `identity:get_user(user_id=bcf6cd86a276482e8265d5687ef8c40a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:55.074729 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f2c8b-b7fb-4c76-bf0c-17c4d44567c3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:55.076913 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 91/171] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:54 2022] GET /identity/v3/users/bcf6cd86a276482e8265d5687ef8c40a => generated 247 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:55.079451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f2c8b-b7fb-4c76-bf0c-17c4d44567c3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:55.082612 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:55.085137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b256d-5aaf-4160-a321-d3cb24df9519 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:55.086420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b256d-5aaf-4160-a321-d3cb24df9519 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:55.115415 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:55.192657 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f2c8b-b7fb-4c76-bf0c-17c4d44567c3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:55.196383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 81/172] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:55:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:55:55.197629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a9255-7f97-4217-b925-4cdf32b30595 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:55.197907 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a9255-7f97-4217-b925-4cdf32b30595 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:55.198175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a9255-7f97-4217-b925-4cdf32b30595 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:55.204258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 82/173] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:55.205680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbe17a-f331-45f7-be80-e30f2eb4b37b None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:55.205963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbe17a-f331-45f7-be80-e30f2eb4b37b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:55.206228 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbe17a-f331-45f7-be80-e30f2eb4b37b None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:55.207615 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 83/174] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:55.215960 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbe17a-f331-45f7-be80-e30f2eb4b37b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:55.236918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1899949-a75e-458b-b312-fe12a5ec3cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:55.238136 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1899949-a75e-458b-b312-fe12a5ec3cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:55.238414 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1899949-a75e-458b-b312-fe12a5ec3cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:55.238680 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1899949-a75e-458b-b312-fe12a5ec3cd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:55.316422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1899949-a75e-458b-b312-fe12a5ec3cd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:55.317871 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1899949-a75e-458b-b312-fe12a5ec3cd7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:55.319634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbe17a-f331-45f7-be80-e30f2eb4b37b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:55.319894 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:55.347374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:55.359345 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4fbf7-1768-46b6-803a-8a2a2437a8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:55.359948 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4fbf7-1768-46b6-803a-8a2a2437a8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:55.360232 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4fbf7-1768-46b6-803a-8a2a2437a8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:55.360497 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4fbf7-1768-46b6-803a-8a2a2437a8e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:55.423631 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 92/175] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:55:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:55:55.424465 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1899949-a75e-458b-b312-fe12a5ec3cd7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:55.431810 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4fbf7-1768-46b6-803a-8a2a2437a8e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:55.433651 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4fbf7-1768-46b6-803a-8a2a2437a8e2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:55.522868 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1899949-a75e-458b-b312-fe12a5ec3cd7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:55.524371 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:55.531122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 84/176] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:55:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:55:55.532201 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60836a0-1cc6-4caa-a18c-57ca54c2eb05 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:55.532486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60836a0-1cc6-4caa-a18c-57ca54c2eb05 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:55.532760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60836a0-1cc6-4caa-a18c-57ca54c2eb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:55.549666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e60836a0-1cc6-4caa-a18c-57ca54c2eb05 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:55.550847 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e60836a0-1cc6-4caa-a18c-57ca54c2eb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:55.558638 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6a2ea-fe8a-4581-b25f-7c21d90f771a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:55.559297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6a2ea-fe8a-4581-b25f-7c21d90f771a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:55.559578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6a2ea-fe8a-4581-b25f-7c21d90f771a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:55.559860 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6a2ea-fe8a-4581-b25f-7c21d90f771a None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:55.560998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6a2ea-fe8a-4581-b25f-7c21d90f771a None admin] RBAC: Authorizing `identity:get_project(project_id=b4ee993851d3477d921a816e3f05a39d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:55.562449 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6a2ea-fe8a-4581-b25f-7c21d90f771a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:55.564106 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 93/177] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:55:55 2022] GET /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:55.565203 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6d9a4-12d7-4ec1-a491-dc2e6c6d0e7d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:55.565486 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6d9a4-12d7-4ec1-a491-dc2e6c6d0e7d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:55.565759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6d9a4-12d7-4ec1-a491-dc2e6c6d0e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:55.572355 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:55.583266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f8e6d9a4-12d7-4ec1-a491-dc2e6c6d0e7d None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:55.584439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f8e6d9a4-12d7-4ec1-a491-dc2e6c6d0e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:55.618743 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 85/178] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:55.620377 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14abc5-a0b0-45ce-a604-603e9d0cab03 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:55.620654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14abc5-a0b0-45ce-a604-603e9d0cab03 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:55.620917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14abc5-a0b0-45ce-a604-603e9d0cab03 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:55.622315 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 86/179] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:55.623213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3c733-d56b-4008-94c0-1ede1c2e687c None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:55.623488 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3c733-d56b-4008-94c0-1ede1c2e687c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:55.623756 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3c733-d56b-4008-94c0-1ede1c2e687c None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:55.624930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 87/180] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:55.625609 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3c733-d56b-4008-94c0-1ede1c2e687c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:55.660603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 94/181] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:55.661446 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6d9a4-12d7-4ec1-a491-dc2e6c6d0e7d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:55.728870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3c733-d56b-4008-94c0-1ede1c2e687c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:55.762154 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844bead-de56-43d5-881e-6f8ee58135a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:55.762772 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844bead-de56-43d5-881e-6f8ee58135a7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:55.763047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844bead-de56-43d5-881e-6f8ee58135a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:55.763363 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844bead-de56-43d5-881e-6f8ee58135a7 None admin] PATH_INFO: `/v3/projects/399b874cda444e5aaab1d85d5d2842f4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:55.765013 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:55.765126 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844bead-de56-43d5-881e-6f8ee58135a7 None admin] RBAC: Authorizing `identity:get_project(project_id=399b874cda444e5aaab1d85d5d2842f4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:55.766524 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844bead-de56-43d5-881e-6f8ee58135a7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:55.768383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 88/182] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:55:55 2022] GET /identity/v3/projects/399b874cda444e5aaab1d85d5d2842f4 => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:55.769141 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844bead-de56-43d5-881e-6f8ee58135a7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:55.771233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6d9a4-12d7-4ec1-a491-dc2e6c6d0e7d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:55.794029 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:55.805071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed079fab-f417-4157-9a66-80cf4d157f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:55.805725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed079fab-f417-4157-9a66-80cf4d157f01 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:55.806002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed079fab-f417-4157-9a66-80cf4d157f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:55.806272 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed079fab-f417-4157-9a66-80cf4d157f01 None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:55.807410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed079fab-f417-4157-9a66-80cf4d157f01 None admin] RBAC: Authorizing `identity:get_project(project_id=b4ee993851d3477d921a816e3f05a39d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:55.808853 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed079fab-f417-4157-9a66-80cf4d157f01 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:55.815859 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 95/183] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:55:55 2022] GET /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:55.815859 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2d5cb-ca55-446d-893f-43878d47dc5e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:55.815859 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2d5cb-ca55-446d-893f-43878d47dc5e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:55.815859 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2d5cb-ca55-446d-893f-43878d47dc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:55.831715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4fa2d5cb-ca55-446d-893f-43878d47dc5e None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:55.832890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4fa2d5cb-ca55-446d-893f-43878d47dc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:55.867869 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844bead-de56-43d5-881e-6f8ee58135a7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:55.896240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 96/184] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:55.897449 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83342499-0838-41fa-8f05-a69fe3be72eb None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:55.897741 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83342499-0838-41fa-8f05-a69fe3be72eb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:55.897993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83342499-0838-41fa-8f05-a69fe3be72eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:55.901663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6151246-833b-4d90-a09f-dc7d125073c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:55.902418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6151246-833b-4d90-a09f-dc7d125073c2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:55.902849 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6151246-833b-4d90-a09f-dc7d125073c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:55.903281 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6151246-833b-4d90-a09f-dc7d125073c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:55.904671 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6151246-833b-4d90-a09f-dc7d125073c2 None admin] RBAC: Adding query filter params (role.id=617e0c2609e3413ea3273113659bccbc, scope.project.id=b4ee993851d3477d921a816e3f05a39d, user.id=b2506581a1e24052a065de1a855734fd) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:55.905142 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6151246-833b-4d90-a09f-dc7d125073c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:55.906630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6151246-833b-4d90-a09f-dc7d125073c2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:55.913042 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 89/185] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:55:55 2022] GET /identity/v3/role_assignments?user.id=b2506581a1e24052a065de1a855734fd&scope.project.id=b4ee993851d3477d921a816e3f05a39d&role.id=617e0c2609e3413ea3273113659bccbc => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:55.913818 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6151246-833b-4d90-a09f-dc7d125073c2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:55.925133 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-83342499-0838-41fa-8f05-a69fe3be72eb None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:55.926442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-83342499-0838-41fa-8f05-a69fe3be72eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:56.011429 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 97/186] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:55:56.012064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83342499-0838-41fa-8f05-a69fe3be72eb None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:56.030328 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:56.043815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:56.048051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6151246-833b-4d90-a09f-dc7d125073c2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:56.085929 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c112dd3-167e-44d2-81de-5baac9ca3adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:56.086727 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112dd3-167e-44d2-81de-5baac9ca3adc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:56.086834 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112dd3-167e-44d2-81de-5baac9ca3adc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:56.087128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112dd3-167e-44d2-81de-5baac9ca3adc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:56.101690 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c112dd3-167e-44d2-81de-5baac9ca3adc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:56.106931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-9c112dd3-167e-44d2-81de-5baac9ca3adc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:55:56.106931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:56.106931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:56.106931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:56.106931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:56.106931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:56.106931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:56.106931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:56.106931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:56.106931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:56.106931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:56.106931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:56.106931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:56.106931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:56.106931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:56.106931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:56.108724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:56.108724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:56.108724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:56.108724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:56.108724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:56.108724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:56.108724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:56.108724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:56.108724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:56.108724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:56.108724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:56.108724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:56.108724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:56.108724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:56.108724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:56.108724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:56.109533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:56.109533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:56.109533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:56.109533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:56.109533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:56.109533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:56.109533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:56.109533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:56.109533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:56.109533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:56.109533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:55:56.109533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:55:56.109533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 90/187] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:55:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:55:56.111936 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c112dd3-167e-44d2-81de-5baac9ca3adc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:56.130752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83342499-0838-41fa-8f05-a69fe3be72eb None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:56.166077 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27272cfa-a3f9-4a80-9e94-e93fc704c4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:56.166707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27272cfa-a3f9-4a80-9e94-e93fc704c4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:56.166983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27272cfa-a3f9-4a80-9e94-e93fc704c4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:56.167297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27272cfa-a3f9-4a80-9e94-e93fc704c4c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:56.168390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27272cfa-a3f9-4a80-9e94-e93fc704c4c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:56.170525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27272cfa-a3f9-4a80-9e94-e93fc704c4c4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:56.172236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 98/188] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:55:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:56.172993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27272cfa-a3f9-4a80-9e94-e93fc704c4c4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:56.223489 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c112dd3-167e-44d2-81de-5baac9ca3adc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:56.255870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ce2f3-0bf2-4b90-a255-7f2f290eaa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:56.256511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ce2f3-0bf2-4b90-a255-7f2f290eaa1f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:56.256786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ce2f3-0bf2-4b90-a255-7f2f290eaa1f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:56.257053 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ce2f3-0bf2-4b90-a255-7f2f290eaa1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:56.257776 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ce2f3-0bf2-4b90-a255-7f2f290eaa1f None admin] RBAC: Adding query filter params (role.id=decfb257a46442b8b4637f8c95c9967b, scope.project.id=399b874cda444e5aaab1d85d5d2842f4, user.id=b2506581a1e24052a065de1a855734fd) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:56.258080 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ce2f3-0bf2-4b90-a255-7f2f290eaa1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:56.259542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ce2f3-0bf2-4b90-a255-7f2f290eaa1f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:56.265840 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 91/189] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:55:56 2022] GET /identity/v3/role_assignments?user.id=b2506581a1e24052a065de1a855734fd&scope.project.id=399b874cda444e5aaab1d85d5d2842f4&role.id=decfb257a46442b8b4637f8c95c9967b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:56.266087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:56.266608 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ce2f3-0bf2-4b90-a255-7f2f290eaa1f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:56.283236 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:56.288236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27272cfa-a3f9-4a80-9e94-e93fc704c4c4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:56.328558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24ed21-e5a1-4d89-b311-66e7b8d01ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:56.329097 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24ed21-e5a1-4d89-b311-66e7b8d01ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:56.329375 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24ed21-e5a1-4d89-b311-66e7b8d01ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:56.329912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24ed21-e5a1-4d89-b311-66e7b8d01ff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:56.330761 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24ed21-e5a1-4d89-b311-66e7b8d01ff4 None admin] RBAC: Adding query filter params (role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.project.id=b4ee993851d3477d921a816e3f05a39d, user.id=bcf6cd86a276482e8265d5687ef8c40a) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:56.331071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24ed21-e5a1-4d89-b311-66e7b8d01ff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:56.332603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24ed21-e5a1-4d89-b311-66e7b8d01ff4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:56.351118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 99/190] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:55:56 2022] GET /identity/v3/role_assignments?user.id=bcf6cd86a276482e8265d5687ef8c40a&scope.project.id=b4ee993851d3477d921a816e3f05a39d&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:56.351118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24ed21-e5a1-4d89-b311-66e7b8d01ff4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:56.384359 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ce2f3-0bf2-4b90-a255-7f2f290eaa1f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:56.426738 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f2146-77d4-4994-8dfb-42dc158bfa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:56.427504 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f2146-77d4-4994-8dfb-42dc158bfa97 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:56.427779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f2146-77d4-4994-8dfb-42dc158bfa97 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:56.428048 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f2146-77d4-4994-8dfb-42dc158bfa97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:56.444802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f2146-77d4-4994-8dfb-42dc158bfa97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:56.450235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3d8f2146-77d4-4994-8dfb-42dc158bfa97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:55:56.450235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:56.450235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:56.450235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:56.450235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:56.450235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:56.450235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:56.450235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:56.450235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:56.450235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:56.450235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:56.450235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:56.450235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:56.450235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:56.450235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:56.450235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:56.451340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:56.451340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:56.451340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:56.451340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:56.451340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:56.451340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:56.451340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:56.451340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:56.451340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:56.451340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:56.451340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:56.451340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:56.451340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:56.451340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:56.451340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:56.451340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:56.452208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:56.452208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:56.452208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:56.452208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:56.452208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:56.452208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:56.452208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:56.452208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:56.452208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:56.452208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:56.452208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:55:56.452208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:55:56.452208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 92/191] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:55:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:55:56.452879 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f2146-77d4-4994-8dfb-42dc158bfa97 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:56.506583 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24ed21-e5a1-4d89-b311-66e7b8d01ff4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:56.549823 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5ab10-b4aa-47ce-8a46-32118d994144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:56.550340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:56.551336 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5ab10-b4aa-47ce-8a46-32118d994144 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:56.551635 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5ab10-b4aa-47ce-8a46-32118d994144 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:56.551936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5ab10-b4aa-47ce-8a46-32118d994144 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:56.564559 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5ab10-b4aa-47ce-8a46-32118d994144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:56.569712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-53a5ab10-b4aa-47ce-8a46-32118d994144 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 06:55:56.569712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:56.569712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:56.569712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:56.569712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:56.569712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:56.569712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:56.569712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:56.569712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:56.569712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:56.569712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:56.569712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:56.569712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:56.569712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:56.569712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:56.569712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:56.570616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:56.570616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:56.570616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:56.570616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:56.570616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:56.570616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:56.570616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:56.570616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:56.570616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:56.570616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:56.570616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:56.570616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:56.570616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:56.570616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:56.570616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:56.570616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:56.571456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:56.571456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:56.571456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:56.571456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:56.571456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:56.571456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:56.571456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:56.571456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:56.571456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:56.571456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:56.571456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 06:55:56.571456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:55:56.571456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 100/192] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:55:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:55:56.575971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5ab10-b4aa-47ce-8a46-32118d994144 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:56.588008 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f2146-77d4-4994-8dfb-42dc158bfa97 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:56.602824 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:56.627482 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af028b-a6cd-42e6-be6d-f757b9198644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:56.628787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af028b-a6cd-42e6-be6d-f757b9198644 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:56.629269 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af028b-a6cd-42e6-be6d-f757b9198644 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:56.629607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af028b-a6cd-42e6-be6d-f757b9198644 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:56.630340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af028b-a6cd-42e6-be6d-f757b9198644 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:56.630706 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af028b-a6cd-42e6-be6d-f757b9198644 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:56.632193 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af028b-a6cd-42e6-be6d-f757b9198644 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:56.640533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 93/193] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:55:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:56.641399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af028b-a6cd-42e6-be6d-f757b9198644 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:56.683951 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5ab10-b4aa-47ce-8a46-32118d994144 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:56.715881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b58f89-c67d-4c41-b03a-60d28f60e15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:56.716482 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b58f89-c67d-4c41-b03a-60d28f60e15f None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:56.717285 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b58f89-c67d-4c41-b03a-60d28f60e15f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:56.717555 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b58f89-c67d-4c41-b03a-60d28f60e15f None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:56.718326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b58f89-c67d-4c41-b03a-60d28f60e15f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:56.719795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b58f89-c67d-4c41-b03a-60d28f60e15f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:56.739473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af028b-a6cd-42e6-be6d-f757b9198644 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:56.743863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 101/194] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Aug 9 06:55:56 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:55:56.751036 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b58f89-c67d-4c41-b03a-60d28f60e15f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:56.794735 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d5221-c0fe-4fda-b638-88d2078c8992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:56.796607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d5221-c0fe-4fda-b638-88d2078c8992 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:56.796892 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d5221-c0fe-4fda-b638-88d2078c8992 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:56.797169 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d5221-c0fe-4fda-b638-88d2078c8992 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:56.797869 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d5221-c0fe-4fda-b638-88d2078c8992 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:56.798174 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d5221-c0fe-4fda-b638-88d2078c8992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:56.799629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d5221-c0fe-4fda-b638-88d2078c8992 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:56.801284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:56.815351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 94/195] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:55:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:56.821069 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d5221-c0fe-4fda-b638-88d2078c8992 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:56.840625 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:56.869484 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b58f89-c67d-4c41-b03a-60d28f60e15f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:56.910450 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819069f5-2e24-44c4-a42b-0cb59c640711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:56.910450 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819069f5-2e24-44c4-a42b-0cb59c640711 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:56.910450 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819069f5-2e24-44c4-a42b-0cb59c640711 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:56.910763 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819069f5-2e24-44c4-a42b-0cb59c640711 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:56.911974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819069f5-2e24-44c4-a42b-0cb59c640711 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:56.911974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819069f5-2e24-44c4-a42b-0cb59c640711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:56.913066 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819069f5-2e24-44c4-a42b-0cb59c640711 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:56.923862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 102/196] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:55:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:56.924227 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819069f5-2e24-44c4-a42b-0cb59c640711 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:56.939048 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d5221-c0fe-4fda-b638-88d2078c8992 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:56.981771 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29965ea-09fd-4a77-9357-03af91bbc855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:56.983064 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29965ea-09fd-4a77-9357-03af91bbc855 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:56.983373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29965ea-09fd-4a77-9357-03af91bbc855 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:56.983901 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29965ea-09fd-4a77-9357-03af91bbc855 None admin] PATH_INFO: `/v3/users/5872a614b1274088850fa862ef8dd891` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:57.000847 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29965ea-09fd-4a77-9357-03af91bbc855 None admin] RBAC: Authorizing `identity:get_user(user_id=5872a614b1274088850fa862ef8dd891)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:57.002560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29965ea-09fd-4a77-9357-03af91bbc855 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:57.004466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 95/197] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:56 2022] GET /identity/v3/users/5872a614b1274088850fa862ef8dd891 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:57.005133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29965ea-09fd-4a77-9357-03af91bbc855 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:57.043172 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819069f5-2e24-44c4-a42b-0cb59c640711 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:57.078013 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:57.094103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b84b93-ed68-4131-a7df-97145e7d7751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:57.095210 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b84b93-ed68-4131-a7df-97145e7d7751 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:57.095649 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b84b93-ed68-4131-a7df-97145e7d7751 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:57.096997 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b84b93-ed68-4131-a7df-97145e7d7751 None admin] PATH_INFO: `/v3/users/5872a614b1274088850fa862ef8dd891` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:57.100196 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b84b93-ed68-4131-a7df-97145e7d7751 None admin] RBAC: Authorizing `identity:get_user(user_id=5872a614b1274088850fa862ef8dd891)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:57.101780 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b84b93-ed68-4131-a7df-97145e7d7751 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:57.105284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 103/198] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:56 2022] GET /identity/v3/users/5872a614b1274088850fa862ef8dd891 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:57.105284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b84b93-ed68-4131-a7df-97145e7d7751 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:57.119736 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:57.133977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29965ea-09fd-4a77-9357-03af91bbc855 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:57.174093 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5d591-2b8d-4451-b4ae-1112282a46d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:57.175046 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5d591-2b8d-4451-b4ae-1112282a46d4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:57.175357 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5d591-2b8d-4451-b4ae-1112282a46d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:57.175630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5d591-2b8d-4451-b4ae-1112282a46d4 None admin] PATH_INFO: `/v3/users/a0cb17df5b74453893c7bebc2423e39f` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:57.177057 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5d591-2b8d-4451-b4ae-1112282a46d4 None admin] RBAC: Authorizing `identity:get_user(user_id=a0cb17df5b74453893c7bebc2423e39f)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:57.179305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5d591-2b8d-4451-b4ae-1112282a46d4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:57.181046 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 96/199] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:57 2022] GET /identity/v3/users/a0cb17df5b74453893c7bebc2423e39f => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:57.183886 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5d591-2b8d-4451-b4ae-1112282a46d4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:57.241623 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b84b93-ed68-4131-a7df-97145e7d7751 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:57.291638 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cf552-0717-445a-8376-d9f34d429f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:57.292898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cf552-0717-445a-8376-d9f34d429f68 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:57.293170 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cf552-0717-445a-8376-d9f34d429f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:57.293434 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cf552-0717-445a-8376-d9f34d429f68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:57.299416 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5d591-2b8d-4451-b4ae-1112282a46d4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:57.324421 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:57.343397 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dcaaf-b29b-40c6-8361-3395821a4aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:57.344313 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dcaaf-b29b-40c6-8361-3395821a4aad None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:57.344735 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dcaaf-b29b-40c6-8361-3395821a4aad None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:57.345143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dcaaf-b29b-40c6-8361-3395821a4aad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:57.376390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560cf552-0717-445a-8376-d9f34d429f68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:57.377859 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560cf552-0717-445a-8376-d9f34d429f68 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:57.386219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:57.428432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573dcaaf-b29b-40c6-8361-3395821a4aad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:57.430507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573dcaaf-b29b-40c6-8361-3395821a4aad None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:57.482812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 104/200] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:55:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:55:57.488212 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cf552-0717-445a-8376-d9f34d429f68 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:57.543224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 97/201] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:55:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:55:57.544449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dcaaf-b29b-40c6-8361-3395821a4aad None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:57.570689 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:57.593697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cf552-0717-445a-8376-d9f34d429f68 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:57.603834 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:57.641641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dd3ae-31eb-4cea-97c9-053c9a7c765f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:57.642253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dd3ae-31eb-4cea-97c9-053c9a7c765f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:57.642530 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dd3ae-31eb-4cea-97c9-053c9a7c765f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:57.642798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dd3ae-31eb-4cea-97c9-053c9a7c765f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:57.683382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dcaaf-b29b-40c6-8361-3395821a4aad None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:57.727072 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f85fbb-c56b-4816-aefe-6eb984ede260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:57.728078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f85fbb-c56b-4816-aefe-6eb984ede260 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:57.728809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f85fbb-c56b-4816-aefe-6eb984ede260 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:57.729285 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f85fbb-c56b-4816-aefe-6eb984ede260 None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:57.731585 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f85fbb-c56b-4816-aefe-6eb984ede260 None admin] RBAC: Authorizing `identity:get_project(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:57.732081 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770dd3ae-31eb-4cea-97c9-053c9a7c765f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:57.733588 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f85fbb-c56b-4816-aefe-6eb984ede260 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:57.734052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770dd3ae-31eb-4cea-97c9-053c9a7c765f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:57.736188 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 98/202] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:55:57 2022] GET /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:57.737159 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f85fbb-c56b-4816-aefe-6eb984ede260 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:57.850324 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:57.859637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 105/203] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:55:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:55:57.860492 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dd3ae-31eb-4cea-97c9-053c9a7c765f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:57.865520 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f85fbb-c56b-4816-aefe-6eb984ede260 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:57.869497 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:57.904635 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6446d-4f5d-4326-b8a6-54f2becbdb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:57.905258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6446d-4f5d-4326-b8a6-54f2becbdb06 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:57.905535 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6446d-4f5d-4326-b8a6-54f2becbdb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:57.905802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6446d-4f5d-4326-b8a6-54f2becbdb06 None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:57.906910 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6446d-4f5d-4326-b8a6-54f2becbdb06 None admin] RBAC: Authorizing `identity:get_project(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:57.908386 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6446d-4f5d-4326-b8a6-54f2becbdb06 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:57.910301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 99/204] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:55:57 2022] GET /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:57.911180 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6446d-4f5d-4326-b8a6-54f2becbdb06 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:57.986264 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dd3ae-31eb-4cea-97c9-053c9a7c765f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:58.026980 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d576c8-b2f7-431a-b6ce-97f59890ee66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:58.027712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d576c8-b2f7-431a-b6ce-97f59890ee66 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:58.027991 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d576c8-b2f7-431a-b6ce-97f59890ee66 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:58.028318 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d576c8-b2f7-431a-b6ce-97f59890ee66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:58.029191 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d576c8-b2f7-431a-b6ce-97f59890ee66 None admin] RBAC: Adding query filter params (role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506, user.id=5872a614b1274088850fa862ef8dd891) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:58.029493 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d576c8-b2f7-431a-b6ce-97f59890ee66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:58.031535 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d576c8-b2f7-431a-b6ce-97f59890ee66 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:58.033860 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6446d-4f5d-4326-b8a6-54f2becbdb06 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:58.038077 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 106/205] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:55:57 2022] GET /identity/v3/role_assignments?user.id=5872a614b1274088850fa862ef8dd891&scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:58.038704 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d576c8-b2f7-431a-b6ce-97f59890ee66 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:58.075035 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d861ef0-5f5b-4f79-b03e-bf8aa9a547ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:58.076782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d861ef0-5f5b-4f79-b03e-bf8aa9a547ad None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:58.077531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d861ef0-5f5b-4f79-b03e-bf8aa9a547ad None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:58.078158 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d861ef0-5f5b-4f79-b03e-bf8aa9a547ad None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:58.079958 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d861ef0-5f5b-4f79-b03e-bf8aa9a547ad None admin] RBAC: Authorizing `identity:get_project(project_id=b4ee993851d3477d921a816e3f05a39d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:58.081952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d861ef0-5f5b-4f79-b03e-bf8aa9a547ad None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:58.084090 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 100/206] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:55:57 2022] GET /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:58.090120 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d861ef0-5f5b-4f79-b03e-bf8aa9a547ad None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:58.146510 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:58.183542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:58.210063 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d576c8-b2f7-431a-b6ce-97f59890ee66 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:58.249956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d1abe-1234-4c8d-b2e8-23447d69a721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:58.250744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d1abe-1234-4c8d-b2e8-23447d69a721 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:58.251266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d1abe-1234-4c8d-b2e8-23447d69a721 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:58.251639 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d1abe-1234-4c8d-b2e8-23447d69a721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:58.252852 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d1abe-1234-4c8d-b2e8-23447d69a721 None admin] RBAC: Adding query filter params (role.id=617e0c2609e3413ea3273113659bccbc, scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506, user.id=5872a614b1274088850fa862ef8dd891) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:58.253291 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d1abe-1234-4c8d-b2e8-23447d69a721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:58.255201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d1abe-1234-4c8d-b2e8-23447d69a721 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:58.265969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 107/207] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:55:58 2022] GET /identity/v3/role_assignments?user.id=5872a614b1274088850fa862ef8dd891&scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506&role.id=617e0c2609e3413ea3273113659bccbc => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:58.295358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d861ef0-5f5b-4f79-b03e-bf8aa9a547ad None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:58.335924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269a32e-98e4-463c-8381-cfc46e53f4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:58.336899 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269a32e-98e4-463c-8381-cfc46e53f4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:58.337453 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269a32e-98e4-463c-8381-cfc46e53f4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:58.337921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269a32e-98e4-463c-8381-cfc46e53f4a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:58.338890 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269a32e-98e4-463c-8381-cfc46e53f4a9 None admin] RBAC: Adding query filter params (role.id=3a56edec1d804398814836d8f3aeb8cb, scope.project.id=b4ee993851d3477d921a816e3f05a39d, user.id=a0cb17df5b74453893c7bebc2423e39f) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:58.339448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269a32e-98e4-463c-8381-cfc46e53f4a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:58.341163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269a32e-98e4-463c-8381-cfc46e53f4a9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:58.348689 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 101/208] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:55:58 2022] GET /identity/v3/role_assignments?user.id=a0cb17df5b74453893c7bebc2423e39f&scope.project.id=b4ee993851d3477d921a816e3f05a39d&role.id=3a56edec1d804398814836d8f3aeb8cb => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:55:58.988674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c920b0-76df-4657-ad08-7f7c780bc800 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:58.989183 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c920b0-76df-4657-ad08-7f7c780bc800 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:58.989259 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c920b0-76df-4657-ad08-7f7c780bc800 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:58.990548 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 108/209] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:55:58.995731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba74210-6dd8-4bb0-ae56-3ddf44fd496d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:58.996151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba74210-6dd8-4bb0-ae56-3ddf44fd496d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:58.996339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba74210-6dd8-4bb0-ae56-3ddf44fd496d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:59.016511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-dba74210-6dd8-4bb0-ae56-3ddf44fd496d None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:59.017686 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-dba74210-6dd8-4bb0-ae56-3ddf44fd496d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:59.087997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 102/210] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:55:59.111346 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c920b0-76df-4657-ad08-7f7c780bc800 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:59.144111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0a7be-9287-4136-ac20-323b0da55da3 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:59.144393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0a7be-9287-4136-ac20-323b0da55da3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:59.144665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0a7be-9287-4136-ac20-323b0da55da3 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:59.146156 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 103/211] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:55:59.150965 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082087b7-c25d-4f09-87dc-22d6b4428b97 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:59.151272 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082087b7-c25d-4f09-87dc-22d6b4428b97 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:59.151536 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082087b7-c25d-4f09-87dc-22d6b4428b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:59.170655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-082087b7-c25d-4f09-87dc-22d6b4428b97 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:55:59.172315 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-082087b7-c25d-4f09-87dc-22d6b4428b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:55:59.191412 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:59.242870 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c920b0-76df-4657-ad08-7f7c780bc800 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:59.257567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 104/212] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:55:59.282802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082087b7-c25d-4f09-87dc-22d6b4428b97 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:59.284321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b51e3d-a6e8-4075-8b4d-293f92864736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:59.285499 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b51e3d-a6e8-4075-8b4d-293f92864736 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:59.286858 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b51e3d-a6e8-4075-8b4d-293f92864736 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:59.287342 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b51e3d-a6e8-4075-8b4d-293f92864736 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:59.289376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:59.304002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b51e3d-a6e8-4075-8b4d-293f92864736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:55:59.311155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b0b51e3d-a6e8-4075-8b4d-293f92864736 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:55:59.311155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:55:59.311155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:55:59.311155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:55:59.311155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:55:59.311155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:55:59.311155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:55:59.311155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:55:59.311155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:55:59.311155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:55:59.311155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:55:59.311155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:55:59.311155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:55:59.311155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:55:59.311155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:55:59.311155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:55:59.312018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:55:59.312018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:55:59.312018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:55:59.312018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:55:59.312018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:55:59.312018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:55:59.312018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:55:59.312018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:55:59.312018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:55:59.312018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:55:59.312018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:55:59.312018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:55:59.312018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:55:59.312018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:55:59.312018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:55:59.312018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:55:59.312835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:55:59.312835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:55:59.312835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:55:59.312835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:55:59.312835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:55:59.312835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:55:59.312835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:55:59.312835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:55:59.312835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:55:59.312835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:55:59.312835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:55:59.312835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:55:59.315266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 109/213] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:55:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:55:59.321023 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b51e3d-a6e8-4075-8b4d-293f92864736 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:59.392750 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082087b7-c25d-4f09-87dc-22d6b4428b97 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:59.429621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0bf20-7209-4d26-885a-7c238d1d4180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:59.430441 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0bf20-7209-4d26-885a-7c238d1d4180 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:59.430820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0bf20-7209-4d26-885a-7c238d1d4180 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:59.431271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0bf20-7209-4d26-885a-7c238d1d4180 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:59.432507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0bf20-7209-4d26-885a-7c238d1d4180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:59.434052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0bf20-7209-4d26-885a-7c238d1d4180 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:59.435150 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b51e3d-a6e8-4075-8b4d-293f92864736 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:59.441331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 105/214] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:55:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:55:59.442932 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0bf20-7209-4d26-885a-7c238d1d4180 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:59.464396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:59.475402 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aeb82-ebf0-4c5e-9e87-7a97a0dcddb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:59.476302 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aeb82-ebf0-4c5e-9e87-7a97a0dcddb7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:59.476715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aeb82-ebf0-4c5e-9e87-7a97a0dcddb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:59.477157 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aeb82-ebf0-4c5e-9e87-7a97a0dcddb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:59.477976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3aeb82-ebf0-4c5e-9e87-7a97a0dcddb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:55:59.478511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3aeb82-ebf0-4c5e-9e87-7a97a0dcddb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:59.480191 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3aeb82-ebf0-4c5e-9e87-7a97a0dcddb7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:59.489295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 110/215] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:55:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:55:59.494901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aeb82-ebf0-4c5e-9e87-7a97a0dcddb7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:59.551492 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0bf20-7209-4d26-885a-7c238d1d4180 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:59.555063 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:59.602550 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a20f9d-392a-4843-9fac-ffdf511eceef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:59.603208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a20f9d-392a-4843-9fac-ffdf511eceef None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:59.603487 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a20f9d-392a-4843-9fac-ffdf511eceef None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:59.603759 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a20f9d-392a-4843-9fac-ffdf511eceef None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:59.603966 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aeb82-ebf0-4c5e-9e87-7a97a0dcddb7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:59.604590 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a20f9d-392a-4843-9fac-ffdf511eceef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:59.606398 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a20f9d-392a-4843-9fac-ffdf511eceef None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:59.642501 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 106/216] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Aug 9 06:55:59 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:55:59.645682 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ea2be-152c-4e3b-bebf-30d2b35162e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:59.646397 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ea2be-152c-4e3b-bebf-30d2b35162e2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:59.646743 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ea2be-152c-4e3b-bebf-30d2b35162e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:59.647077 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ea2be-152c-4e3b-bebf-30d2b35162e2 None admin] PATH_INFO: `/v3/users/3fc673afbd2c448387ef5fdbd8faac76` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:59.671364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ea2be-152c-4e3b-bebf-30d2b35162e2 None admin] RBAC: Authorizing `identity:get_user(user_id=3fc673afbd2c448387ef5fdbd8faac76)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:59.673328 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ea2be-152c-4e3b-bebf-30d2b35162e2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:59.675440 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 111/217] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:55:59 2022] GET /identity/v3/users/3fc673afbd2c448387ef5fdbd8faac76 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:55:59.684294 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a20f9d-392a-4843-9fac-ffdf511eceef None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:55:59.773230 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:59.804681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a20f9d-392a-4843-9fac-ffdf511eceef None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:55:59.840862 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722775f-51ff-4753-b131-56b409ef171e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:55:59.841496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722775f-51ff-4753-b131-56b409ef171e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:55:59.841982 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722775f-51ff-4753-b131-56b409ef171e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:55:59.843456 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722775f-51ff-4753-b131-56b409ef171e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:55:59.917355 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722775f-51ff-4753-b131-56b409ef171e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:55:59.918807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722775f-51ff-4753-b131-56b409ef171e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:55:59.999487 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:00.028855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 107/218] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:55:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:00.035594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ea2be-152c-4e3b-bebf-30d2b35162e2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:00.162457 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ea2be-152c-4e3b-bebf-30d2b35162e2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:00.181936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:00.205531 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee46f82-792b-4a8c-a920-5bdc92f4dc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:00.206165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee46f82-792b-4a8c-a920-5bdc92f4dc49 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:00.206442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee46f82-792b-4a8c-a920-5bdc92f4dc49 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:00.206715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee46f82-792b-4a8c-a920-5bdc92f4dc49 None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:00.207936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee46f82-792b-4a8c-a920-5bdc92f4dc49 None admin] RBAC: Authorizing `identity:get_project(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:00.209418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee46f82-792b-4a8c-a920-5bdc92f4dc49 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:00.215207 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 112/219] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:00 2022] GET /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:00.217550 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722775f-51ff-4753-b131-56b409ef171e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:00.376317 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722775f-51ff-4753-b131-56b409ef171e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:00.384476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd4c5e-b5e0-4a45-b64a-13fd2744c0e9 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:00.384761 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd4c5e-b5e0-4a45-b64a-13fd2744c0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:00.385027 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd4c5e-b5e0-4a45-b64a-13fd2744c0e9 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:00.386498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 113/220] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:56:00.392040 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd78a20-dc21-4d64-bea7-a059d5a3124f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:00.392326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd78a20-dc21-4d64-bea7-a059d5a3124f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:00.392600 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd78a20-dc21-4d64-bea7-a059d5a3124f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:00.414736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03968ac2-a487-48f0-857b-4ed7478461cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:00.415363 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03968ac2-a487-48f0-857b-4ed7478461cb None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:00.415641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03968ac2-a487-48f0-857b-4ed7478461cb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:00.415911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03968ac2-a487-48f0-857b-4ed7478461cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:00.416631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03968ac2-a487-48f0-857b-4ed7478461cb None admin] RBAC: Adding query filter params (role.id=decfb257a46442b8b4637f8c95c9967b, scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506, user.id=3fc673afbd2c448387ef5fdbd8faac76) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:00.416936 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03968ac2-a487-48f0-857b-4ed7478461cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:00.418465 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03968ac2-a487-48f0-857b-4ed7478461cb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:00.424861 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 108/221] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:56:00 2022] GET /identity/v3/role_assignments?user.id=3fc673afbd2c448387ef5fdbd8faac76&scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506&role.id=decfb257a46442b8b4637f8c95c9967b => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:00.429700 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ffd78a20-dc21-4d64-bea7-a059d5a3124f None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:00.430912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ffd78a20-dc21-4d64-bea7-a059d5a3124f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:00.553683 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 114/222] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:56:00.576678 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03968ac2-a487-48f0-857b-4ed7478461cb None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:00.618263 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377dcd3-3e9d-4637-b234-ca6b36e391dd None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:00.618708 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377dcd3-3e9d-4637-b234-ca6b36e391dd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:00.619076 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377dcd3-3e9d-4637-b234-ca6b36e391dd None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:00.620838 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 115/223] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:00.626919 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e316a5c-eb23-4eaa-95ea-553cf19b8078 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:00.627272 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e316a5c-eb23-4eaa-95ea-553cf19b8078 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:00.627640 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e316a5c-eb23-4eaa-95ea-553cf19b8078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:00.643455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:00.649716 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9e316a5c-eb23-4eaa-95ea-553cf19b8078 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:00.651441 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9e316a5c-eb23-4eaa-95ea-553cf19b8078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:00.747594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03968ac2-a487-48f0-857b-4ed7478461cb None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:00.781678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 116/224] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:00.788475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10878b3f-eb42-4cfc-ab45-7ae4c45040cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:00.789201 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10878b3f-eb42-4cfc-ab45-7ae4c45040cd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:00.789572 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10878b3f-eb42-4cfc-ab45-7ae4c45040cd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:00.789911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10878b3f-eb42-4cfc-ab45-7ae4c45040cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:00.808250 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10878b3f-eb42-4cfc-ab45-7ae4c45040cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:00.814626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-10878b3f-eb42-4cfc-ab45-7ae4c45040cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:56:00.814626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:00.814626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:00.814626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:00.814626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:00.814626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:00.814626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:00.814626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:00.814626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:00.814626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:00.814626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:00.814626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:00.814626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:00.814626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:00.814626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:00.814626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:00.815582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:00.815582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:00.815582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:00.815582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:00.815582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:00.815582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:00.815582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:00.815582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:00.815582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:00.815582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:00.815582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:00.815582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:00.815582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:00.815582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:00.815582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:00.815582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:00.816405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:00.816405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:00.816405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:00.816405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:00.816405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:00.816405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:00.816405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:00.816405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:00.816405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:00.816405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:00.816405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:56:00.816405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:00.824964 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 109/225] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:56:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:00.826766 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e316a5c-eb23-4eaa-95ea-553cf19b8078 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:00.831152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10878b3f-eb42-4cfc-ab45-7ae4c45040cd None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:00.887143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:00.938550 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10878b3f-eb42-4cfc-ab45-7ae4c45040cd None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:00.951703 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:00.976889 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c9053-873c-4f79-a21b-3c67d4368973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:00.977838 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9053-873c-4f79-a21b-3c67d4368973 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:00.978309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9053-873c-4f79-a21b-3c67d4368973 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:00.978794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9053-873c-4f79-a21b-3c67d4368973 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:00.979797 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c9053-873c-4f79-a21b-3c67d4368973 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:00.980430 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c9053-873c-4f79-a21b-3c67d4368973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:00.982041 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c9053-873c-4f79-a21b-3c67d4368973 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:00.992507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 110/226] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:00.999826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c9053-873c-4f79-a21b-3c67d4368973 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:01.037229 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e316a5c-eb23-4eaa-95ea-553cf19b8078 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:01.089834 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd936d90-f7a4-47cf-83dc-340a661268dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:01.090798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd936d90-f7a4-47cf-83dc-340a661268dd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:01.091333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd936d90-f7a4-47cf-83dc-340a661268dd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:01.092355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd936d90-f7a4-47cf-83dc-340a661268dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:01.104239 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd936d90-f7a4-47cf-83dc-340a661268dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:01.109805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-cd936d90-f7a4-47cf-83dc-340a661268dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:56:01.109805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:01.109805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:01.109805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:01.109805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:01.109805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:01.109805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:01.109805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:01.109805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:01.109805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:01.109805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:01.109805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:01.109805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:01.109805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:01.109805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:01.109805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:01.110676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:01.110676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:01.110676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:01.110676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:01.110676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:01.110676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:01.110676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:01.110676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:01.110676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:01.110676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:01.110676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:01.110676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:01.110676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:01.110676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:01.110676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:01.110676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:01.111500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:01.111500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:01.111500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:01.111500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:01.111500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:01.111500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:01.111500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:01.111500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:01.111500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:01.111500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:01.111500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:56:01.111500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:01.114676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 117/227] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:56:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:01.120645 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd936d90-f7a4-47cf-83dc-340a661268dd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:01.162741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c9053-873c-4f79-a21b-3c67d4368973 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:01.231137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb662d3-06c3-4f5d-85f6-815c6e637255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:01.231137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb662d3-06c3-4f5d-85f6-815c6e637255 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:01.231137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb662d3-06c3-4f5d-85f6-815c6e637255 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:01.231137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb662d3-06c3-4f5d-85f6-815c6e637255 None admin] PATH_INFO: `/v3/users/5872a614b1274088850fa862ef8dd891` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:01.231537 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb662d3-06c3-4f5d-85f6-815c6e637255 None admin] RBAC: Authorizing `identity:get_user(user_id=5872a614b1274088850fa862ef8dd891)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:01.231537 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb662d3-06c3-4f5d-85f6-815c6e637255 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:01.231537 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 111/228] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:56:00 2022] GET /identity/v3/users/5872a614b1274088850fa862ef8dd891 => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:01.240051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb662d3-06c3-4f5d-85f6-815c6e637255 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:01.271174 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:01.307374 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd936d90-f7a4-47cf-83dc-340a661268dd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:01.309090 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:01.376671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecccbf4-15e3-41b0-9b8d-ad9ecde6318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:01.377290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecccbf4-15e3-41b0-9b8d-ad9ecde6318d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:01.377565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecccbf4-15e3-41b0-9b8d-ad9ecde6318d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:01.377837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecccbf4-15e3-41b0-9b8d-ad9ecde6318d None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:01.378505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecccbf4-15e3-41b0-9b8d-ad9ecde6318d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:01.378806 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecccbf4-15e3-41b0-9b8d-ad9ecde6318d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:01.380223 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecccbf4-15e3-41b0-9b8d-ad9ecde6318d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:01.402390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 118/229] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:01.406678 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb662d3-06c3-4f5d-85f6-815c6e637255 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:01.408699 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecccbf4-15e3-41b0-9b8d-ad9ecde6318d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:01.477857 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a6aa1-92e1-4735-a12c-349032efa523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:01.478494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a6aa1-92e1-4735-a12c-349032efa523 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:01.478773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a6aa1-92e1-4735-a12c-349032efa523 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:01.479043 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a6aa1-92e1-4735-a12c-349032efa523 None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:01.480310 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a6aa1-92e1-4735-a12c-349032efa523 None admin] RBAC: Authorizing `identity:get_project(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:01.481741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a6aa1-92e1-4735-a12c-349032efa523 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:01.485993 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 112/230] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:01 2022] GET /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:01.490537 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a6aa1-92e1-4735-a12c-349032efa523 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:01.593374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a6aa1-92e1-4735-a12c-349032efa523 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:01.597222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecccbf4-15e3-41b0-9b8d-ad9ecde6318d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:01.603920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:01.644818 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9246b-3f78-4915-9b1c-78e4002b0aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:01.645491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9246b-3f78-4915-9b1c-78e4002b0aa7 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:01.645769 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9246b-3f78-4915-9b1c-78e4002b0aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:01.646042 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9246b-3f78-4915-9b1c-78e4002b0aa7 None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506/users/5872a614b1274088850fa862ef8dd891/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:01.648473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9246b-3f78-4915-9b1c-78e4002b0aa7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506, user_id=5872a614b1274088850fa862ef8dd891, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:01.649932 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9246b-3f78-4915-9b1c-78e4002b0aa7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:01.669524 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6591965-aef9-4e66-a1f3-975e144fdbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:01.677341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 113/231] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:56:01 2022] PUT /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506/users/5872a614b1274088850fa862ef8dd891/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:56:01.677662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6591965-aef9-4e66-a1f3-975e144fdbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:01.677865 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6591965-aef9-4e66-a1f3-975e144fdbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:01.678147 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6591965-aef9-4e66-a1f3-975e144fdbd0 None admin] PATH_INFO: `/v3/users/5872a614b1274088850fa862ef8dd891` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:01.679531 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6591965-aef9-4e66-a1f3-975e144fdbd0 None admin] RBAC: Authorizing `identity:get_user(user_id=5872a614b1274088850fa862ef8dd891)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:01.681052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6591965-aef9-4e66-a1f3-975e144fdbd0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:01.682694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 119/232] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:56:01 2022] GET /identity/v3/users/5872a614b1274088850fa862ef8dd891 => generated 283 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:01.689673 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9246b-3f78-4915-9b1c-78e4002b0aa7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:01.840506 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9246b-3f78-4915-9b1c-78e4002b0aa7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:01.883316 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5563e84-f611-4aad-92de-dbc5c7979c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:01.883963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5563e84-f611-4aad-92de-dbc5c7979c51 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:01.884244 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5563e84-f611-4aad-92de-dbc5c7979c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:01.884511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5563e84-f611-4aad-92de-dbc5c7979c51 None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:01.886988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5563e84-f611-4aad-92de-dbc5c7979c51 None admin] RBAC: Authorizing `identity:get_project(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:01.889115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5563e84-f611-4aad-92de-dbc5c7979c51 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:01.890890 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 114/233] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:01 2022] GET /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:01.896788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6591965-aef9-4e66-a1f3-975e144fdbd0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:01.932165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:02.006253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6591965-aef9-4e66-a1f3-975e144fdbd0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:02.040873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c4aed-a02e-4c23-a220-efb83dfeb2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:02.041725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c4aed-a02e-4c23-a220-efb83dfeb2ac None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:02.041947 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c4aed-a02e-4c23-a220-efb83dfeb2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:02.042225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c4aed-a02e-4c23-a220-efb83dfeb2ac None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506/users/5872a614b1274088850fa862ef8dd891/roles/617e0c2609e3413ea3273113659bccbc` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:02.044454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c4aed-a02e-4c23-a220-efb83dfeb2ac None admin] RBAC: Authorizing `identity:create_grant(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506, user_id=5872a614b1274088850fa862ef8dd891, role_id=617e0c2609e3413ea3273113659bccbc)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:02.046017 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c4aed-a02e-4c23-a220-efb83dfeb2ac None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:02.068482 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 120/234] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:56:01 2022] PUT /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506/users/5872a614b1274088850fa862ef8dd891/roles/617e0c2609e3413ea3273113659bccbc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:56:02.316894 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8535d-f67e-4ada-b5dd-ee84c8fb074f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:02.317460 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8535d-f67e-4ada-b5dd-ee84c8fb074f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:02.317460 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8535d-f67e-4ada-b5dd-ee84c8fb074f None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:02.319171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 115/235] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:02.324399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf0fc7-285d-401f-9625-15bbee74ead1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:02.324689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf0fc7-285d-401f-9625-15bbee74ead1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:02.324965 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf0fc7-285d-401f-9625-15bbee74ead1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:02.346579 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-01cf0fc7-285d-401f-9625-15bbee74ead1 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:02.347891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-01cf0fc7-285d-401f-9625-15bbee74ead1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:02.429551 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 121/236] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:02.453562 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8535d-f67e-4ada-b5dd-ee84c8fb074f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:02.484423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:02.504706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7730c3-817a-4297-94e2-463b384ab683 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:02.505027 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7730c3-817a-4297-94e2-463b384ab683 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:02.505261 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7730c3-817a-4297-94e2-463b384ab683 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:02.506835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 122/237] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:02.511913 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738514d0-050b-4bba-bf94-c853e66227cf None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:02.512191 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738514d0-050b-4bba-bf94-c853e66227cf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:02.512467 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738514d0-050b-4bba-bf94-c853e66227cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:02.545521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-738514d0-050b-4bba-bf94-c853e66227cf None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:02.546910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-738514d0-050b-4bba-bf94-c853e66227cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:02.571949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:02.617787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8535d-f67e-4ada-b5dd-ee84c8fb074f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:02.665135 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 123/238] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:56:02.681901 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5efe2-802c-4060-85fa-9196087b5bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:02.682585 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5efe2-802c-4060-85fa-9196087b5bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:02.682867 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5efe2-802c-4060-85fa-9196087b5bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:02.683155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5efe2-802c-4060-85fa-9196087b5bb8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:02.702853 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5efe2-802c-4060-85fa-9196087b5bb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:02.707956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-a3b5efe2-802c-4060-85fa-9196087b5bb8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 06:56:02.707956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:02.707956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:02.707956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:02.707956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:02.707956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:02.707956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:02.707956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:02.707956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:02.707956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:02.707956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:02.707956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:02.707956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:02.707956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:02.707956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:02.707956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:02.708825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:02.708825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:02.708825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:02.708825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:02.708825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:02.708825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:02.708825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:02.708825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:02.708825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:02.708825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:02.708825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:02.708825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:02.708825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:02.708825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:02.708825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:02.708825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:02.710028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:02.710028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:02.710028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:02.710028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:02.710028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:02.710028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:02.710028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:02.710028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:02.710028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:02.710028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:02.710028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 06:56:02.710028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:02.710028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 116/239] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:02.714894 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738514d0-050b-4bba-bf94-c853e66227cf None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:02.725740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5efe2-802c-4060-85fa-9196087b5bb8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:02.841288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:02.864315 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5efe2-802c-4060-85fa-9196087b5bb8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:02.901082 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738514d0-050b-4bba-bf94-c853e66227cf None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:02.924393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2a0ea-d9e3-4b98-8a0d-ff214b7c3822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:02.925403 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2a0ea-d9e3-4b98-8a0d-ff214b7c3822 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:02.925902 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2a0ea-d9e3-4b98-8a0d-ff214b7c3822 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:02.927183 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2a0ea-d9e3-4b98-8a0d-ff214b7c3822 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:02.929266 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2a0ea-d9e3-4b98-8a0d-ff214b7c3822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:02.931058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2a0ea-d9e3-4b98-8a0d-ff214b7c3822 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:02.934880 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 117/240] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:02.944320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2a0ea-d9e3-4b98-8a0d-ff214b7c3822 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:02.976023 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64916d3d-9a44-4317-9b43-36e4e59356c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:02.977012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64916d3d-9a44-4317-9b43-36e4e59356c3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:02.977529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64916d3d-9a44-4317-9b43-36e4e59356c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:02.977996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64916d3d-9a44-4317-9b43-36e4e59356c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:02.978876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64916d3d-9a44-4317-9b43-36e4e59356c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:02.979421 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64916d3d-9a44-4317-9b43-36e4e59356c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:02.984612 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64916d3d-9a44-4317-9b43-36e4e59356c3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:03.005438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 124/241] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:56:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:03.010805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64916d3d-9a44-4317-9b43-36e4e59356c3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:03.046195 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:03.071719 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2a0ea-d9e3-4b98-8a0d-ff214b7c3822 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:03.108101 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5eac1-d1ea-40f0-b9ef-94eae54454d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:03.108772 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5eac1-d1ea-40f0-b9ef-94eae54454d2 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:03.109149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5eac1-d1ea-40f0-b9ef-94eae54454d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:03.109535 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5eac1-d1ea-40f0-b9ef-94eae54454d2 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:03.110283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5eac1-d1ea-40f0-b9ef-94eae54454d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:03.111830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5eac1-d1ea-40f0-b9ef-94eae54454d2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:03.131259 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64916d3d-9a44-4317-9b43-36e4e59356c3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:03.134269 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 118/242] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Aug 9 06:56:02 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:56:03.140628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0373386-276b-44fc-a56d-cf2ff6d9fa73 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:03.141042 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0373386-276b-44fc-a56d-cf2ff6d9fa73 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:03.141421 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0373386-276b-44fc-a56d-cf2ff6d9fa73 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:03.143238 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 119/243] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:03.149123 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24eee86-73b6-4446-9086-2f49bb7dd27a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:03.149502 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24eee86-73b6-4446-9086-2f49bb7dd27a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:03.149996 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24eee86-73b6-4446-9086-2f49bb7dd27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:03.173107 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb736f-b596-4830-8774-9769c133c3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:03.173761 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb736f-b596-4830-8774-9769c133c3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:03.174036 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb736f-b596-4830-8774-9769c133c3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:03.174305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb736f-b596-4830-8774-9769c133c3a1 None admin] PATH_INFO: `/v3/users/df400a5517544d99a1076046c42abdf1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:03.184382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a24eee86-73b6-4446-9086-2f49bb7dd27a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:03.186508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a24eee86-73b6-4446-9086-2f49bb7dd27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:03.190058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb736f-b596-4830-8774-9769c133c3a1 None admin] RBAC: Authorizing `identity:get_user(user_id=df400a5517544d99a1076046c42abdf1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:03.190563 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:03.193412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb736f-b596-4830-8774-9769c133c3a1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:03.193697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 125/244] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:56:03 2022] GET /identity/v3/users/df400a5517544d99a1076046c42abdf1 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:03.199898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb736f-b596-4830-8774-9769c133c3a1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:03.343595 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 120/245] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:56:03.348286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:03.369573 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24eee86-73b6-4446-9086-2f49bb7dd27a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:03.386472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb736f-b596-4830-8774-9769c133c3a1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:03.442053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f1291-ef89-4f8d-9d1d-45e1a09ff5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:03.442942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f1291-ef89-4f8d-9d1d-45e1a09ff5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:03.443269 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f1291-ef89-4f8d-9d1d-45e1a09ff5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:03.443536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f1291-ef89-4f8d-9d1d-45e1a09ff5e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:03.508710 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24eee86-73b6-4446-9086-2f49bb7dd27a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:03.529596 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f1291-ef89-4f8d-9d1d-45e1a09ff5e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:03.531848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f1291-ef89-4f8d-9d1d-45e1a09ff5e9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:03.550607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00c00b-7bdc-4c1c-9e23-b24b61b9ce56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:03.551288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00c00b-7bdc-4c1c-9e23-b24b61b9ce56 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:03.551564 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00c00b-7bdc-4c1c-9e23-b24b61b9ce56 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:03.551833 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00c00b-7bdc-4c1c-9e23-b24b61b9ce56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:03.559828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:03.564320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00c00b-7bdc-4c1c-9e23-b24b61b9ce56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:03.569855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-ea00c00b-7bdc-4c1c-9e23-b24b61b9ce56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:03.569855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:03.569855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:03.569855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:03.569855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:03.569855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:03.569855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:03.569855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:03.569855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:03.569855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:03.569855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:03.569855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:03.569855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:03.569855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:03.569855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:03.569855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:03.570839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:03.570839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:03.570839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:03.570839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:03.570839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:03.570839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:03.570839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:03.570839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:03.570839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:03.570839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:03.570839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:03.570839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:03.570839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:03.570839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:03.570839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:03.570839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:03.571675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:03.571675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:03.571675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:03.571675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:03.571675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:03.571675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:03.571675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:03.571675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:03.571675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:03.571675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:03.571675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:03.571675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:03.571675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 121/246] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:56:03.578820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00c00b-7bdc-4c1c-9e23-b24b61b9ce56 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:03.609596 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:03.648816 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 126/247] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 06:56:03.656346 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f1291-ef89-4f8d-9d1d-45e1a09ff5e9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:03.702034 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00c00b-7bdc-4c1c-9e23-b24b61b9ce56 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:03.745529 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7375e-9547-4666-ace4-29c776a00573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:03.747061 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7375e-9547-4666-ace4-29c776a00573 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:03.747369 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7375e-9547-4666-ace4-29c776a00573 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:03.747757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7375e-9547-4666-ace4-29c776a00573 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:03.748633 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7375e-9547-4666-ace4-29c776a00573 None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:03.748843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7375e-9547-4666-ace4-29c776a00573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:03.750180 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7375e-9547-4666-ace4-29c776a00573 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:03.762539 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 122/248] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:56:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:03.768877 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7375e-9547-4666-ace4-29c776a00573 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:03.785435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f1291-ef89-4f8d-9d1d-45e1a09ff5e9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:03.822476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf96063-f621-4623-9127-44f36d65f638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:03.823121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf96063-f621-4623-9127-44f36d65f638 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:03.823507 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf96063-f621-4623-9127-44f36d65f638 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:03.823828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf96063-f621-4623-9127-44f36d65f638 None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:03.825077 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf96063-f621-4623-9127-44f36d65f638 None admin] RBAC: Authorizing `identity:get_project(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:03.827101 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf96063-f621-4623-9127-44f36d65f638 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:03.829033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 127/249] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:03 2022] GET /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:03.834768 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:03.836208 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf96063-f621-4623-9127-44f36d65f638 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:03.877885 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7375e-9547-4666-ace4-29c776a00573 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:03.881117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:03.913431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dcc41-b8a6-443c-8f74-86029b36eb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:03.913995 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dcc41-b8a6-443c-8f74-86029b36eb00 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:03.914273 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dcc41-b8a6-443c-8f74-86029b36eb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:03.914545 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dcc41-b8a6-443c-8f74-86029b36eb00 None admin] PATH_INFO: `/v3/users/3fc673afbd2c448387ef5fdbd8faac76` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:03.916577 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dcc41-b8a6-443c-8f74-86029b36eb00 None admin] RBAC: Authorizing `identity:get_user(user_id=3fc673afbd2c448387ef5fdbd8faac76)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:03.918035 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dcc41-b8a6-443c-8f74-86029b36eb00 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:03.919689 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 123/250] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:56:03 2022] GET /identity/v3/users/3fc673afbd2c448387ef5fdbd8faac76 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:03.925437 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dcc41-b8a6-443c-8f74-86029b36eb00 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:03.949470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf96063-f621-4623-9127-44f36d65f638 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:03.985517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d175f-a592-432d-89cd-135114cfe238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:03.986127 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d175f-a592-432d-89cd-135114cfe238 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:03.986399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d175f-a592-432d-89cd-135114cfe238 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:03.986664 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d175f-a592-432d-89cd-135114cfe238 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:03.988589 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d175f-a592-432d-89cd-135114cfe238 None admin] RBAC: Adding query filter params (role.id=3a56edec1d804398814836d8f3aeb8cb, scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506, user.id=df400a5517544d99a1076046c42abdf1) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:03.988913 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d175f-a592-432d-89cd-135114cfe238 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:03.990353 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d175f-a592-432d-89cd-135114cfe238 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:03.996529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 128/251] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:56:03 2022] GET /identity/v3/role_assignments?user.id=df400a5517544d99a1076046c42abdf1&scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506&role.id=3a56edec1d804398814836d8f3aeb8cb => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:04.030298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7748c-9157-440e-92b4-2bed75c410fa None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:04.030653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7748c-9157-440e-92b4-2bed75c410fa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:04.030839 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7748c-9157-440e-92b4-2bed75c410fa None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:04.032222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 129/252] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:04.037299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dcc41-b8a6-443c-8f74-86029b36eb00 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:04.040543 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430d94c-9553-476a-8c0c-4e8074d0a938 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:04.040823 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430d94c-9553-476a-8c0c-4e8074d0a938 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:04.041093 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430d94c-9553-476a-8c0c-4e8074d0a938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:04.069425 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:04.076834 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1538981-7437-45ac-bc0e-2d898b5719b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:04.077633 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1538981-7437-45ac-bc0e-2d898b5719b4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:04.077916 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1538981-7437-45ac-bc0e-2d898b5719b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:04.078214 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1538981-7437-45ac-bc0e-2d898b5719b4 None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:04.079199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d430d94c-9553-476a-8c0c-4e8074d0a938 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:04.079637 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1538981-7437-45ac-bc0e-2d898b5719b4 None admin] RBAC: Authorizing `identity:get_project(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:04.081325 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1538981-7437-45ac-bc0e-2d898b5719b4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:04.082435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d430d94c-9553-476a-8c0c-4e8074d0a938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:04.083097 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 124/253] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:03 2022] GET /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:04.088813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1538981-7437-45ac-bc0e-2d898b5719b4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:04.198039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1538981-7437-45ac-bc0e-2d898b5719b4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:04.205362 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 130/254] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:04.245851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430d94c-9553-476a-8c0c-4e8074d0a938 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:04.258821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b3f70-885a-4b95-a995-e7933e543b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:04.259544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b3f70-885a-4b95-a995-e7933e543b9c None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:04.259821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b3f70-885a-4b95-a995-e7933e543b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:04.260160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b3f70-885a-4b95-a995-e7933e543b9c None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506/users/3fc673afbd2c448387ef5fdbd8faac76/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:04.262215 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b3f70-885a-4b95-a995-e7933e543b9c None admin] RBAC: Authorizing `identity:create_grant(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506, user_id=3fc673afbd2c448387ef5fdbd8faac76, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:04.264076 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b3f70-885a-4b95-a995-e7933e543b9c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:04.290392 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 125/255] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:56:04 2022] PUT /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506/users/3fc673afbd2c448387ef5fdbd8faac76/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 06:56:04.309212 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:04.400081 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430d94c-9553-476a-8c0c-4e8074d0a938 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:04.442432 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd1e54-a11f-4c77-87c2-0a10388e942a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:04.443066 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd1e54-a11f-4c77-87c2-0a10388e942a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:04.443368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd1e54-a11f-4c77-87c2-0a10388e942a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:04.443633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd1e54-a11f-4c77-87c2-0a10388e942a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:04.455825 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd1e54-a11f-4c77-87c2-0a10388e942a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:04.460536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f2cd1e54-a11f-4c77-87c2-0a10388e942a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:56:04.460536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:04.460536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:04.460536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:04.460536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:04.460536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:04.460536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:04.460536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:04.460536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:04.460536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:04.460536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:04.460536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:04.460536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:04.460536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:04.460536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:04.460536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:04.461418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:04.461418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:04.461418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:04.461418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:04.461418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:04.461418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:04.461418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:04.461418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:04.461418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:04.461418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:04.461418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:04.461418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:04.461418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:04.461418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:04.461418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:04.461418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:04.462224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:04.462224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:04.462224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:04.462224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:04.462224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:04.462224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:04.462224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:04.462224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:04.462224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:04.462224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:04.462224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:56:04.462224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:04.462224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 131/256] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:56:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:04.467883 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b3f70-885a-4b95-a995-e7933e543b9c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:04.564146 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:04.618642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b3f70-885a-4b95-a995-e7933e543b9c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:04.653534 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea10b02-2916-44b3-a6dd-803b550e1d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:04.654234 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea10b02-2916-44b3-a6dd-803b550e1d7e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:04.654511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea10b02-2916-44b3-a6dd-803b550e1d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:04.654781 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea10b02-2916-44b3-a6dd-803b550e1d7e None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:04.655476 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea10b02-2916-44b3-a6dd-803b550e1d7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:04.655775 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea10b02-2916-44b3-a6dd-803b550e1d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:04.657149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea10b02-2916-44b3-a6dd-803b550e1d7e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:04.666059 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 126/257] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:04.672187 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd1e54-a11f-4c77-87c2-0a10388e942a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:04.804659 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:04.812673 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd1e54-a11f-4c77-87c2-0a10388e942a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:04.848859 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd0b21-e399-4300-b192-0a123801d120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:04.849496 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd0b21-e399-4300-b192-0a123801d120 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:04.849770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd0b21-e399-4300-b192-0a123801d120 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:04.850035 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd0b21-e399-4300-b192-0a123801d120 None admin] PATH_INFO: `/v3/users/5872a614b1274088850fa862ef8dd891` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:04.851208 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd0b21-e399-4300-b192-0a123801d120 None admin] RBAC: Authorizing `identity:get_user(user_id=5872a614b1274088850fa862ef8dd891)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:04.852644 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd0b21-e399-4300-b192-0a123801d120 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:04.854208 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 132/258] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:56:04 2022] GET /identity/v3/users/5872a614b1274088850fa862ef8dd891 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:04.860036 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea10b02-2916-44b3-a6dd-803b550e1d7e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:04.969699 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea10b02-2916-44b3-a6dd-803b550e1d7e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:04.975112 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e0f08-8e54-48af-ae2b-c3cbc5006c12 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:04.975417 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e0f08-8e54-48af-ae2b-c3cbc5006c12 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:04.975694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e0f08-8e54-48af-ae2b-c3cbc5006c12 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:04.977344 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 133/259] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:56:04.984512 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3b5a8-d150-426f-8cf6-6483b551c9f7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:04.984796 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3b5a8-d150-426f-8cf6-6483b551c9f7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:04.985069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3b5a8-d150-426f-8cf6-6483b551c9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:04.987408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:05.011729 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a6d0e-333e-4f75-86e8-1c1920d05912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:05.012337 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a6d0e-333e-4f75-86e8-1c1920d05912 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:05.012618 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a6d0e-333e-4f75-86e8-1c1920d05912 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:05.012890 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a6d0e-333e-4f75-86e8-1c1920d05912 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:05.018251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a4f3b5a8-d150-426f-8cf6-6483b551c9f7 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:05.019442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a4f3b5a8-d150-426f-8cf6-6483b551c9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:05.178507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a6d0e-333e-4f75-86e8-1c1920d05912 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:05.179944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a6d0e-333e-4f75-86e8-1c1920d05912 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:05.180372 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 134/260] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:05.216514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3b5a8-d150-426f-8cf6-6483b551c9f7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:05.422240 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 127/261] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:05.430815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:05.431276 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a6d0e-333e-4f75-86e8-1c1920d05912 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:05.455380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3b5a8-d150-426f-8cf6-6483b551c9f7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:05.486024 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:05.543791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cce64-4b86-4eab-97a2-b7efd13f276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:05.544540 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cce64-4b86-4eab-97a2-b7efd13f276e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:05.544976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cce64-4b86-4eab-97a2-b7efd13f276e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:05.545250 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cce64-4b86-4eab-97a2-b7efd13f276e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:05.565269 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49cce64-4b86-4eab-97a2-b7efd13f276e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:05.570570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e49cce64-4b86-4eab-97a2-b7efd13f276e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:56:05.570570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:05.570570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:05.570570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:05.570570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:05.570570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:05.570570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:05.570570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:05.570570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:05.570570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:05.570570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:05.570570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:05.570570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:05.570570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:05.570570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:05.570570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:05.571495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:05.571495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:05.571495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:05.571495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:05.571495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:05.571495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:05.571495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:05.571495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:05.571495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:05.571495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:05.571495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:05.571495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:05.571495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:05.571495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:05.571495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:05.571495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:05.572284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:05.572284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:05.572284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:05.572284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:05.572284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:05.572284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:05.572284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:05.572284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:05.572284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:05.572284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:05.572284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:56:05.572284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:05.574566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 135/262] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:56:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:05.581153 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cce64-4b86-4eab-97a2-b7efd13f276e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:05.675506 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a6d0e-333e-4f75-86e8-1c1920d05912 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:05.759772 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694fddf-18bf-4a5f-a90c-ef67b6c911c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:05.760412 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694fddf-18bf-4a5f-a90c-ef67b6c911c8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:05.760688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694fddf-18bf-4a5f-a90c-ef67b6c911c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:05.760961 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694fddf-18bf-4a5f-a90c-ef67b6c911c8 None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:05.762290 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694fddf-18bf-4a5f-a90c-ef67b6c911c8 None admin] RBAC: Authorizing `identity:get_project(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:05.763834 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694fddf-18bf-4a5f-a90c-ef67b6c911c8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:05.765464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 128/263] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:05 2022] GET /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506 => generated 302 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:05.773306 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694fddf-18bf-4a5f-a90c-ef67b6c911c8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:05.794134 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cce64-4b86-4eab-97a2-b7efd13f276e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:05.864871 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe8403-92a7-43bb-bd22-1ef647fe3bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:05.865589 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe8403-92a7-43bb-bd22-1ef647fe3bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:05.865871 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe8403-92a7-43bb-bd22-1ef647fe3bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:05.866137 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe8403-92a7-43bb-bd22-1ef647fe3bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:05.866798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe8403-92a7-43bb-bd22-1ef647fe3bf5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:05.867116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe8403-92a7-43bb-bd22-1ef647fe3bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:05.868684 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe8403-92a7-43bb-bd22-1ef647fe3bf5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:05.886582 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 136/264] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:05.892962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe8403-92a7-43bb-bd22-1ef647fe3bf5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:05.913565 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:05.927129 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:05.929400 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694fddf-18bf-4a5f-a90c-ef67b6c911c8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:06.008337 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cd6bc-794d-446f-aba9-ebfe7f42948e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:06.008955 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cd6bc-794d-446f-aba9-ebfe7f42948e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:06.009235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cd6bc-794d-446f-aba9-ebfe7f42948e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:06.009504 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cd6bc-794d-446f-aba9-ebfe7f42948e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:06.010289 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cd6bc-794d-446f-aba9-ebfe7f42948e None admin] RBAC: Adding query filter params (role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506, user.id=5872a614b1274088850fa862ef8dd891) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:06.010544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cd6bc-794d-446f-aba9-ebfe7f42948e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:06.018641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cd6bc-794d-446f-aba9-ebfe7f42948e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:06.018964 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 129/265] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:56:05 2022] GET /identity/v3/role_assignments?user.id=5872a614b1274088850fa862ef8dd891&scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:06.070950 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe8403-92a7-43bb-bd22-1ef647fe3bf5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:06.122728 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5211c41-6a81-4fbb-839a-846b36cc9649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:06.123934 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5211c41-6a81-4fbb-839a-846b36cc9649 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:06.124443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5211c41-6a81-4fbb-839a-846b36cc9649 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:06.124923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5211c41-6a81-4fbb-839a-846b36cc9649 None admin] PATH_INFO: `/v3/users/5872a614b1274088850fa862ef8dd891` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:06.126274 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5211c41-6a81-4fbb-839a-846b36cc9649 None admin] RBAC: Authorizing `identity:get_user(user_id=5872a614b1274088850fa862ef8dd891)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:06.128078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5211c41-6a81-4fbb-839a-846b36cc9649 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:06.130988 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 137/266] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:56:05 2022] GET /identity/v3/users/5872a614b1274088850fa862ef8dd891 => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:06.135618 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cd6bc-794d-446f-aba9-ebfe7f42948e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:06.259376 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cd6bc-794d-446f-aba9-ebfe7f42948e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:06.303975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891f670-3f6b-449a-82ca-d0b2cf4d6bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:06.304534 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891f670-3f6b-449a-82ca-d0b2cf4d6bfe None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:06.304818 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891f670-3f6b-449a-82ca-d0b2cf4d6bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:06.305096 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891f670-3f6b-449a-82ca-d0b2cf4d6bfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:06.331031 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:06.399193 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891f670-3f6b-449a-82ca-d0b2cf4d6bfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:06.400664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891f670-3f6b-449a-82ca-d0b2cf4d6bfe None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:06.517482 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 130/267] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:06.522784 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5211c41-6a81-4fbb-839a-846b36cc9649 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:06.652720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:06.671810 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5211c41-6a81-4fbb-839a-846b36cc9649 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:06.711942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e54b3-68c6-40af-ac05-048d6136c954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:06.712581 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e54b3-68c6-40af-ac05-048d6136c954 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:06.712864 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e54b3-68c6-40af-ac05-048d6136c954 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:06.713140 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e54b3-68c6-40af-ac05-048d6136c954 None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:06.714264 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e54b3-68c6-40af-ac05-048d6136c954 None admin] RBAC: Authorizing `identity:get_project(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:06.715756 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e54b3-68c6-40af-ac05-048d6136c954 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:06.717790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 138/268] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:06 2022] GET /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:06.723688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891f670-3f6b-449a-82ca-d0b2cf4d6bfe None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:06.805560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:06.818873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe3753-8ff5-4e83-99cd-f4a15bcfc4aa None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:06.819206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe3753-8ff5-4e83-99cd-f4a15bcfc4aa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:06.819449 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe3753-8ff5-4e83-99cd-f4a15bcfc4aa None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:06.820942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 139/269] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:06.827635 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cf6b5-d91a-4fd8-8bb4-ffe5ce17c719 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:06.827918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cf6b5-d91a-4fd8-8bb4-ffe5ce17c719 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:06.828195 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cf6b5-d91a-4fd8-8bb4-ffe5ce17c719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:06.847614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f22cf6b5-d91a-4fd8-8bb4-ffe5ce17c719 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:06.848892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f22cf6b5-d91a-4fd8-8bb4-ffe5ce17c719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:06.897386 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891f670-3f6b-449a-82ca-d0b2cf4d6bfe None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:06.927185 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 140/270] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:56:06.928512 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e8f92-e2df-42a7-81b7-8f3ffe912ec0 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:06.928791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e8f92-e2df-42a7-81b7-8f3ffe912ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:06.929063 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e8f92-e2df-42a7-81b7-8f3ffe912ec0 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:06.930348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 141/271] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:06.933750 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd9e17-eeb1-44a9-858b-94dd0cce8f8b None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:06.934025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd9e17-eeb1-44a9-858b-94dd0cce8f8b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:06.934291 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd9e17-eeb1-44a9-858b-94dd0cce8f8b None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:06.940065 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 142/272] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:56:06.941227 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718dad5-d999-48fe-ae9d-edc3b37d6f18 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:06.941504 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718dad5-d999-48fe-ae9d-edc3b37d6f18 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:06.941775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718dad5-d999-48fe-ae9d-edc3b37d6f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:06.948098 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04337d-d58a-4017-848e-bf9ce736314d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:06.948848 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04337d-d58a-4017-848e-bf9ce736314d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:06.949207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04337d-d58a-4017-848e-bf9ce736314d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:06.949529 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04337d-d58a-4017-848e-bf9ce736314d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:06.950264 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04337d-d58a-4017-848e-bf9ce736314d None admin] RBAC: Adding query filter params (role.id=617e0c2609e3413ea3273113659bccbc, scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506, user.id=5872a614b1274088850fa862ef8dd891) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:06.950572 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04337d-d58a-4017-848e-bf9ce736314d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:06.952249 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04337d-d58a-4017-848e-bf9ce736314d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:06.958933 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 131/273] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:56:06 2022] GET /identity/v3/role_assignments?user.id=5872a614b1274088850fa862ef8dd891&scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506&role.id=617e0c2609e3413ea3273113659bccbc => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:06.960193 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f19e1-8f6e-4570-92d2-f2ac9c24d036 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:06.960481 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f19e1-8f6e-4570-92d2-f2ac9c24d036 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:06.960750 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f19e1-8f6e-4570-92d2-f2ac9c24d036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:06.965349 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8718dad5-d999-48fe-ae9d-edc3b37d6f18 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:06.967118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8718dad5-d999-48fe-ae9d-edc3b37d6f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:06.982068 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a70f19e1-8f6e-4570-92d2-f2ac9c24d036 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:06.984171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a70f19e1-8f6e-4570-92d2-f2ac9c24d036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:07.071113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 143/274] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:07.071113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718dad5-d999-48fe-ae9d-edc3b37d6f18 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:07.094959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:07.102109 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 132/275] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:07.103753 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f19e1-8f6e-4570-92d2-f2ac9c24d036 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:07.163767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:07.203284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718dad5-d999-48fe-ae9d-edc3b37d6f18 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:07.228276 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f19e1-8f6e-4570-92d2-f2ac9c24d036 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:07.252534 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008df9c-da0e-4e2a-a271-870b3d6bd007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:07.253783 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008df9c-da0e-4e2a-a271-870b3d6bd007 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:07.254264 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008df9c-da0e-4e2a-a271-870b3d6bd007 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:07.255066 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008df9c-da0e-4e2a-a271-870b3d6bd007 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:07.266452 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772063b9-920e-4afd-aeef-a50d5807b97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:07.267077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772063b9-920e-4afd-aeef-a50d5807b97a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:07.267386 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772063b9-920e-4afd-aeef-a50d5807b97a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:07.267657 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772063b9-920e-4afd-aeef-a50d5807b97a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:07.267839 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008df9c-da0e-4e2a-a271-870b3d6bd007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:07.268758 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772063b9-920e-4afd-aeef-a50d5807b97a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:07.270188 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772063b9-920e-4afd-aeef-a50d5807b97a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:07.272544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3008df9c-da0e-4e2a-a271-870b3d6bd007 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:07.272544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:07.272544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:07.272544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:07.272544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:07.272544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:07.272544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:07.272544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:07.272544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:07.272544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:07.272544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:07.272544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:07.272544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:07.272544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:07.272544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:07.272544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:07.273410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:07.273410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:07.273410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:07.273410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:07.273410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:07.273410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:07.273410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:07.273410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:07.273410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:07.273410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:07.273410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:07.273410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:07.273410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:07.273410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:07.273410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:07.273410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:07.274280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:07.274280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:07.274280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:07.274280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:07.274280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:07.274280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:07.274280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:07.274280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:07.274280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:07.274280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:07.274280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:07.274280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:07.274280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 144/276] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:07.274964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008df9c-da0e-4e2a-a271-870b3d6bd007 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:07.275593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 133/277] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:07.283028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772063b9-920e-4afd-aeef-a50d5807b97a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:07.349947 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:07.381268 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008df9c-da0e-4e2a-a271-870b3d6bd007 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:07.387871 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772063b9-920e-4afd-aeef-a50d5807b97a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:07.401894 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:07.416946 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c91aef-1009-4a9a-bce5-7bab4182d6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:07.417524 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c91aef-1009-4a9a-bce5-7bab4182d6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:07.417798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c91aef-1009-4a9a-bce5-7bab4182d6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:07.418065 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c91aef-1009-4a9a-bce5-7bab4182d6e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:07.427597 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bab697-13df-4649-ae25-99da16619e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:07.428212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab697-13df-4649-ae25-99da16619e9c None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:07.428645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab697-13df-4649-ae25-99da16619e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:07.428915 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab697-13df-4649-ae25-99da16619e9c None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:07.429311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c91aef-1009-4a9a-bce5-7bab4182d6e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:07.429556 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bab697-13df-4649-ae25-99da16619e9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:07.431037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bab697-13df-4649-ae25-99da16619e9c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:07.434050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-31c91aef-1009-4a9a-bce5-7bab4182d6e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 06:56:07.434050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:07.434050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:07.434050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:07.434050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:07.434050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:07.434050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:07.434050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:07.434050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:07.434050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:07.434050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:07.434050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:07.434050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:07.434050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:07.434050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:07.434050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:07.435278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:07.435278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:07.435278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:07.435278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:07.435278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:07.435278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:07.435278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:07.435278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:07.435278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:07.435278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:07.435278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:07.435278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:07.435278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:07.435278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:07.435278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:07.435278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:07.436630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:07.436630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:07.436630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:07.436630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:07.436630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:07.436630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:07.436630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:07.436630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:07.436630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:07.436630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:07.436630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 06:56:07.436630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:07.436630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 145/278] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:07.436630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c91aef-1009-4a9a-bce5-7bab4182d6e7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:07.467116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 134/279] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Aug 9 06:56:07 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 06:56:07.467116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642a6cd-03a5-4674-92bf-f2db80baae7d None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:07.467116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642a6cd-03a5-4674-92bf-f2db80baae7d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:07.467116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642a6cd-03a5-4674-92bf-f2db80baae7d None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:07.467116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 135/280] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:07.467116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642a6cd-03a5-4674-92bf-f2db80baae7d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:07.547889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c91aef-1009-4a9a-bce5-7bab4182d6e7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:07.583023 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:07.584857 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642a6cd-03a5-4674-92bf-f2db80baae7d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:07.590535 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2012fc6-6833-464f-bbe0-7a620604623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:07.591176 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012fc6-6833-464f-bbe0-7a620604623b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:07.591599 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012fc6-6833-464f-bbe0-7a620604623b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:07.591873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012fc6-6833-464f-bbe0-7a620604623b None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:07.592540 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2012fc6-6833-464f-bbe0-7a620604623b None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:07.592845 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2012fc6-6833-464f-bbe0-7a620604623b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:07.594393 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2012fc6-6833-464f-bbe0-7a620604623b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:07.604314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 146/281] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:56:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:07.605640 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8efc4-46bc-4b59-b3b3-29f3a8c48244 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:07.605921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8efc4-46bc-4b59-b3b3-29f3a8c48244 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:07.606247 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8efc4-46bc-4b59-b3b3-29f3a8c48244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:07.626054 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-eae8efc4-46bc-4b59-b3b3-29f3a8c48244 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:07.627278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-eae8efc4-46bc-4b59-b3b3-29f3a8c48244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:07.631480 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565501bd-5ef3-4be9-afbf-d3ff4b5cbfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:07.632127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565501bd-5ef3-4be9-afbf-d3ff4b5cbfd7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:07.632413 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565501bd-5ef3-4be9-afbf-d3ff4b5cbfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:07.632683 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565501bd-5ef3-4be9-afbf-d3ff4b5cbfd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:07.633351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565501bd-5ef3-4be9-afbf-d3ff4b5cbfd7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:07.633653 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565501bd-5ef3-4be9-afbf-d3ff4b5cbfd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:07.635023 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565501bd-5ef3-4be9-afbf-d3ff4b5cbfd7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:07.646982 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 136/282] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:56:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:07.651637 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565501bd-5ef3-4be9-afbf-d3ff4b5cbfd7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:07.681833 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:07.707711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 147/283] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:07.712584 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8efc4-46bc-4b59-b3b3-29f3a8c48244 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:07.775474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565501bd-5ef3-4be9-afbf-d3ff4b5cbfd7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:07.815433 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447801be-0c13-4bab-8e26-ef043057523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:07.816450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447801be-0c13-4bab-8e26-ef043057523a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:07.816906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447801be-0c13-4bab-8e26-ef043057523a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:07.817387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447801be-0c13-4bab-8e26-ef043057523a None admin] PATH_INFO: `/v3/users/8f49ffeece7144a7a2c2858223a7e989` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:07.832316 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447801be-0c13-4bab-8e26-ef043057523a None admin] RBAC: Authorizing `identity:get_user(user_id=8f49ffeece7144a7a2c2858223a7e989)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:07.834086 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447801be-0c13-4bab-8e26-ef043057523a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:07.836036 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 137/284] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:56:07 2022] GET /identity/v3/users/8f49ffeece7144a7a2c2858223a7e989 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:07.836552 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8efc4-46bc-4b59-b3b3-29f3a8c48244 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:07.836745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447801be-0c13-4bab-8e26-ef043057523a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:07.862742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:07.882979 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae02e22-8743-4b00-8191-51717ff0f61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:07.883989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae02e22-8743-4b00-8191-51717ff0f61e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:07.885005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae02e22-8743-4b00-8191-51717ff0f61e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:07.885472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae02e22-8743-4b00-8191-51717ff0f61e None admin] PATH_INFO: `/v3/users/df400a5517544d99a1076046c42abdf1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:07.887360 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae02e22-8743-4b00-8191-51717ff0f61e None admin] RBAC: Authorizing `identity:get_user(user_id=df400a5517544d99a1076046c42abdf1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:07.890021 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae02e22-8743-4b00-8191-51717ff0f61e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:07.893166 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 148/285] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:56:07 2022] GET /identity/v3/users/df400a5517544d99a1076046c42abdf1 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:07.897797 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae02e22-8743-4b00-8191-51717ff0f61e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:07.946608 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:07.963681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447801be-0c13-4bab-8e26-ef043057523a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:08.015757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d5351-0ee6-47a6-9139-1a7af79c898c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:08.016752 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d5351-0ee6-47a6-9139-1a7af79c898c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:08.017221 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d5351-0ee6-47a6-9139-1a7af79c898c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:08.017698 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d5351-0ee6-47a6-9139-1a7af79c898c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:08.028075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae02e22-8743-4b00-8191-51717ff0f61e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:08.029353 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d5351-0ee6-47a6-9139-1a7af79c898c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:08.034599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-522d5351-0ee6-47a6-9139-1a7af79c898c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:08.034599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:08.034599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:08.034599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:08.034599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:08.034599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:08.034599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:08.034599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:08.034599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:08.034599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:08.034599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:08.034599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:08.034599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:08.034599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:08.034599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:08.034599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:08.035507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:08.035507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:08.035507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:08.035507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:08.035507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:08.035507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:08.035507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:08.035507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:08.035507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:08.035507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:08.035507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:08.035507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:08.035507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:08.035507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:08.035507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:08.035507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:08.036309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:08.036309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:08.036309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:08.036309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:08.036309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:08.036309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:08.036309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:08.036309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:08.036309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:08.036309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:08.036309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:08.036309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:08.038895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 138/286] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:08.039906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d5351-0ee6-47a6-9139-1a7af79c898c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:08.066392 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63b28d-c491-4869-a380-de7e6535d25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:08.067009 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63b28d-c491-4869-a380-de7e6535d25c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:08.067325 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63b28d-c491-4869-a380-de7e6535d25c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:08.067652 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63b28d-c491-4869-a380-de7e6535d25c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:08.068403 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63b28d-c491-4869-a380-de7e6535d25c None admin] RBAC: Adding query filter params (role.id=decfb257a46442b8b4637f8c95c9967b, user.id=8f49ffeece7144a7a2c2858223a7e989, scope.system=all) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:08.068712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63b28d-c491-4869-a380-de7e6535d25c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:08.070442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63b28d-c491-4869-a380-de7e6535d25c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:08.076793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 149/287] 10.222.0.40 () {56 vars in 1308 bytes} [Tue Aug 9 06:56:07 2022] GET /identity/v3/role_assignments?user.id=8f49ffeece7144a7a2c2858223a7e989&scope.system=all&role.id=decfb257a46442b8b4637f8c95c9967b => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:08.084264 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63b28d-c491-4869-a380-de7e6535d25c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:08.161472 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d5351-0ee6-47a6-9139-1a7af79c898c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:08.203549 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:08.236175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eba00c-d8ab-4371-b262-1980a4be712a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:08.237155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eba00c-d8ab-4371-b262-1980a4be712a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:08.241402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eba00c-d8ab-4371-b262-1980a4be712a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:08.241915 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eba00c-d8ab-4371-b262-1980a4be712a None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:08.243893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eba00c-d8ab-4371-b262-1980a4be712a None admin] RBAC: Authorizing `identity:get_project(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:08.245675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eba00c-d8ab-4371-b262-1980a4be712a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:08.247664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 139/288] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:08 2022] GET /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:08.256086 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eba00c-d8ab-4371-b262-1980a4be712a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:08.282840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63b28d-c491-4869-a380-de7e6535d25c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:08.292023 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:08.321760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fbeba-54a8-4396-a9c8-c01cd3620460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:08.322686 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fbeba-54a8-4396-a9c8-c01cd3620460 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:08.323180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fbeba-54a8-4396-a9c8-c01cd3620460 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:08.323619 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fbeba-54a8-4396-a9c8-c01cd3620460 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:08.324444 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fbeba-54a8-4396-a9c8-c01cd3620460 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:08.324928 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fbeba-54a8-4396-a9c8-c01cd3620460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:08.327295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fbeba-54a8-4396-a9c8-c01cd3620460 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:08.336470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 150/289] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:56:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:08.342534 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fbeba-54a8-4396-a9c8-c01cd3620460 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:08.455624 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eba00c-d8ab-4371-b262-1980a4be712a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:08.521617 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21557c81-aa83-44e1-a747-75abff2c9e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:08.523114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21557c81-aa83-44e1-a747-75abff2c9e12 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:08.523565 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21557c81-aa83-44e1-a747-75abff2c9e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:08.524022 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21557c81-aa83-44e1-a747-75abff2c9e12 None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506/users/df400a5517544d99a1076046c42abdf1/roles/3a56edec1d804398814836d8f3aeb8cb` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:08.526460 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21557c81-aa83-44e1-a747-75abff2c9e12 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506, user_id=df400a5517544d99a1076046c42abdf1, role_id=3a56edec1d804398814836d8f3aeb8cb)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:08.528082 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21557c81-aa83-44e1-a747-75abff2c9e12 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:08.536892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fbeba-54a8-4396-a9c8-c01cd3620460 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:08.546085 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 140/290] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:56:08 2022] PUT /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506/users/df400a5517544d99a1076046c42abdf1/roles/3a56edec1d804398814836d8f3aeb8cb => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:56:08.562602 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:08.589597 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04c19a-3b9c-4316-9212-8481c0f08de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:08.590559 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04c19a-3b9c-4316-9212-8481c0f08de1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:08.591006 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04c19a-3b9c-4316-9212-8481c0f08de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:08.591985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04c19a-3b9c-4316-9212-8481c0f08de1 None admin] PATH_INFO: `/v3/users/3fc673afbd2c448387ef5fdbd8faac76` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:08.593518 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04c19a-3b9c-4316-9212-8481c0f08de1 None admin] RBAC: Authorizing `identity:get_user(user_id=3fc673afbd2c448387ef5fdbd8faac76)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:08.595205 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04c19a-3b9c-4316-9212-8481c0f08de1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:08.597238 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 151/291] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:56:08 2022] GET /identity/v3/users/3fc673afbd2c448387ef5fdbd8faac76 => generated 297 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:08.604337 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21557c81-aa83-44e1-a747-75abff2c9e12 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:08.714440 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:08.751947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21557c81-aa83-44e1-a747-75abff2c9e12 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:08.791071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef02067-d12c-40bf-97bb-5d387e11576d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:08.792041 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef02067-d12c-40bf-97bb-5d387e11576d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:08.792510 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef02067-d12c-40bf-97bb-5d387e11576d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:08.792959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef02067-d12c-40bf-97bb-5d387e11576d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:08.866684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef02067-d12c-40bf-97bb-5d387e11576d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:08.868524 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef02067-d12c-40bf-97bb-5d387e11576d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:08.969414 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:08.993901 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 141/292] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:08.999864 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04c19a-3b9c-4316-9212-8481c0f08de1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:09.116520 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04c19a-3b9c-4316-9212-8481c0f08de1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:09.151237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b53036-4e4a-4c3e-85c7-b44e5595ea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:09.151862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b53036-4e4a-4c3e-85c7-b44e5595ea19 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:09.152135 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b53036-4e4a-4c3e-85c7-b44e5595ea19 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:09.152399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b53036-4e4a-4c3e-85c7-b44e5595ea19 None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:09.153495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b53036-4e4a-4c3e-85c7-b44e5595ea19 None admin] RBAC: Authorizing `identity:get_project(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:09.155339 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b53036-4e4a-4c3e-85c7-b44e5595ea19 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:09.157323 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 152/293] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:08 2022] GET /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:09.162993 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef02067-d12c-40bf-97bb-5d387e11576d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:09.314860 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef02067-d12c-40bf-97bb-5d387e11576d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:09.360742 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cacce-43a6-4eff-ab90-b684afd74ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:09.361359 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cacce-43a6-4eff-ab90-b684afd74ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:09.361690 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cacce-43a6-4eff-ab90-b684afd74ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:09.361969 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cacce-43a6-4eff-ab90-b684afd74ec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:09.362706 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cacce-43a6-4eff-ab90-b684afd74ec6 None admin] RBAC: Adding query filter params (role.id=decfb257a46442b8b4637f8c95c9967b, scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506, user.id=3fc673afbd2c448387ef5fdbd8faac76) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:09.363018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cacce-43a6-4eff-ab90-b684afd74ec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:09.364527 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cacce-43a6-4eff-ab90-b684afd74ec6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:09.370533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 142/294] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:56:09 2022] GET /identity/v3/role_assignments?user.id=3fc673afbd2c448387ef5fdbd8faac76&scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506&role.id=decfb257a46442b8b4637f8c95c9967b => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:09.906825 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d2ee4-eac9-4bff-b3f3-d9b65b7c3a2c None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:09.907330 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d2ee4-eac9-4bff-b3f3-d9b65b7c3a2c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:09.907330 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d2ee4-eac9-4bff-b3f3-d9b65b7c3a2c None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:09.908913 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 153/295] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:09.914200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9cbe4-1b32-4333-a800-809f74fc5f3c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:09.914628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9cbe4-1b32-4333-a800-809f74fc5f3c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:09.914817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9cbe4-1b32-4333-a800-809f74fc5f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:09.918744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a99298-924c-4615-8041-2589104f6fc5 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:09.919025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a99298-924c-4615-8041-2589104f6fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:09.919344 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a99298-924c-4615-8041-2589104f6fc5 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:09.920947 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 154/296] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:09.926052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d22f8-114f-4022-92f3-6e0dda7c9968 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:09.926334 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d22f8-114f-4022-92f3-6e0dda7c9968 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:09.926612 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d22f8-114f-4022-92f3-6e0dda7c9968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:09.938161 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d4c9cbe4-1b32-4333-a800-809f74fc5f3c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:09.939768 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d4c9cbe4-1b32-4333-a800-809f74fc5f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:09.946833 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9c5d22f8-114f-4022-92f3-6e0dda7c9968 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:09.948091 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9c5d22f8-114f-4022-92f3-6e0dda7c9968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:09.985384 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:10.017083 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:10.035454 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 143/297] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:10.051181 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 155/298] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:10.062214 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9cbe4-1b32-4333-a800-809f74fc5f3c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:10.069427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d22f8-114f-4022-92f3-6e0dda7c9968 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:10.181284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9cbe4-1b32-4333-a800-809f74fc5f3c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:10.202659 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d22f8-114f-4022-92f3-6e0dda7c9968 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:10.219772 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e2e7a-4bbf-4b35-813d-eb56c12e2696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:10.220619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e2e7a-4bbf-4b35-813d-eb56c12e2696 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:10.221043 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e2e7a-4bbf-4b35-813d-eb56c12e2696 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:10.221448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e2e7a-4bbf-4b35-813d-eb56c12e2696 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:10.222779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e2e7a-4bbf-4b35-813d-eb56c12e2696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:10.224439 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e2e7a-4bbf-4b35-813d-eb56c12e2696 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:10.226688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 144/299] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:10.233301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e2e7a-4bbf-4b35-813d-eb56c12e2696 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:10.243524 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ada9b7-714d-4bdb-8f74-29c1d5c80ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:10.244154 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ada9b7-714d-4bdb-8f74-29c1d5c80ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:10.244429 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ada9b7-714d-4bdb-8f74-29c1d5c80ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:10.244698 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ada9b7-714d-4bdb-8f74-29c1d5c80ad8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:10.259709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ada9b7-714d-4bdb-8f74-29c1d5c80ad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:10.266989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-59ada9b7-714d-4bdb-8f74-29c1d5c80ad8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 06:56:10.266989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:10.266989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:10.266989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:10.266989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:10.266989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:10.266989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:10.266989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:10.266989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:10.266989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:10.266989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:10.266989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:10.266989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:10.266989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:10.266989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:10.266989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:10.267959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:10.267959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:10.267959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:10.267959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:10.267959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:10.267959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:10.267959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:10.267959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:10.267959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:10.267959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:10.267959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:10.267959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:10.267959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:10.267959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:10.267959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:10.267959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:10.273983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:10.273983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:10.273983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:10.273983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:10.273983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:10.273983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:10.273983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:10.273983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:10.273983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:10.273983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:10.273983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 06:56:10.273983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:10.273983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 156/300] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:56:10.276163 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ada9b7-714d-4bdb-8f74-29c1d5c80ad8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:10.287785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:10.332582 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:10.367425 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e2e7a-4bbf-4b35-813d-eb56c12e2696 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:10.405036 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ec1bc-403e-44c4-9f16-c442ea07628f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:10.405997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ec1bc-403e-44c4-9f16-c442ea07628f None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:10.406479 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ec1bc-403e-44c4-9f16-c442ea07628f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:10.406951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ec1bc-403e-44c4-9f16-c442ea07628f None admin] PATH_INFO: `/v3/groups` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:10.407805 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ec1bc-403e-44c4-9f16-c442ea07628f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:10.409445 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ec1bc-403e-44c4-9f16-c442ea07628f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:10.412068 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ada9b7-714d-4bdb-8f74-29c1d5c80ad8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:10.435371 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 145/301] 10.222.0.40 () {60 vars in 1134 bytes} [Tue Aug 9 06:56:10 2022] POST /identity/v3/groups => generated 229 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 06:56:10.452008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3931bd7-cb3a-4c86-8c2c-177c689721b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:10.452633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3931bd7-cb3a-4c86-8c2c-177c689721b1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:10.452907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3931bd7-cb3a-4c86-8c2c-177c689721b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:10.453176 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3931bd7-cb3a-4c86-8c2c-177c689721b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:10.453850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3931bd7-cb3a-4c86-8c2c-177c689721b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:10.454203 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3931bd7-cb3a-4c86-8c2c-177c689721b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:10.455885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3931bd7-cb3a-4c86-8c2c-177c689721b1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:10.473739 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 157/302] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:56:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:10.481365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ec1bc-403e-44c4-9f16-c442ea07628f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:10.603831 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:10.607859 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ec1bc-403e-44c4-9f16-c442ea07628f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:10.651332 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0cda9-9703-4f67-b7de-cb9befb1d6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:10.652355 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0cda9-9703-4f67-b7de-cb9befb1d6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:10.652834 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0cda9-9703-4f67-b7de-cb9befb1d6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:10.653312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0cda9-9703-4f67-b7de-cb9befb1d6e2 None admin] PATH_INFO: `/v3/users/b8ff0f4af87c4f8da3bab5aa6d41f39e` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:10.668885 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0cda9-9703-4f67-b7de-cb9befb1d6e2 None admin] RBAC: Authorizing `identity:get_user(user_id=b8ff0f4af87c4f8da3bab5aa6d41f39e)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:10.670916 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0cda9-9703-4f67-b7de-cb9befb1d6e2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:10.673220 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 146/303] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:56:10 2022] GET /identity/v3/users/b8ff0f4af87c4f8da3bab5aa6d41f39e => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:10.679204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3931bd7-cb3a-4c86-8c2c-177c689721b1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:10.736127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe84b6-09c5-4738-a94e-0b1ec132e735 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:10.736821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe84b6-09c5-4738-a94e-0b1ec132e735 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:10.737321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe84b6-09c5-4738-a94e-0b1ec132e735 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:10.738876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 147/304] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:10.744033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bc3a7-feac-4a4f-b781-59d476fd542a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:10.744308 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bc3a7-feac-4a4f-b781-59d476fd542a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:10.744580 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bc3a7-feac-4a4f-b781-59d476fd542a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:10.766528 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f88bc3a7-feac-4a4f-b781-59d476fd542a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:10.768235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f88bc3a7-feac-4a4f-b781-59d476fd542a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:10.787367 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3931bd7-cb3a-4c86-8c2c-177c689721b1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:10.789958 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:10.825683 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f268e-58da-4c66-8d1f-69a0b16614bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:10.827209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f268e-58da-4c66-8d1f-69a0b16614bf None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:10.827688 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f268e-58da-4c66-8d1f-69a0b16614bf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:10.828183 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f268e-58da-4c66-8d1f-69a0b16614bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:10.829076 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f268e-58da-4c66-8d1f-69a0b16614bf None admin] RBAC: Adding query filter params (role.id=3a56edec1d804398814836d8f3aeb8cb, user.id=b8ff0f4af87c4f8da3bab5aa6d41f39e, scope.system=all) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:10.829529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f268e-58da-4c66-8d1f-69a0b16614bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:10.832046 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f268e-58da-4c66-8d1f-69a0b16614bf None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:10.848769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 158/305] 10.222.0.40 () {56 vars in 1308 bytes} [Tue Aug 9 06:56:10 2022] GET /identity/v3/role_assignments?user.id=b8ff0f4af87c4f8da3bab5aa6d41f39e&scope.system=all&role.id=3a56edec1d804398814836d8f3aeb8cb => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:10.856950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 148/306] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:56:10.880866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f268e-58da-4c66-8d1f-69a0b16614bf None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:10.892703 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214805ae-188b-4f0d-b603-9d7bfe922ba3 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:10.892992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214805ae-188b-4f0d-b603-9d7bfe922ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:10.893266 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214805ae-188b-4f0d-b603-9d7bfe922ba3 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:10.895157 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 149/307] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:56:10.900783 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e3eff-f3ce-4c87-be5e-6e67ad0fb99d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:10.900783 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e3eff-f3ce-4c87-be5e-6e67ad0fb99d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:10.901029 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e3eff-f3ce-4c87-be5e-6e67ad0fb99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:10.920664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5d6e3eff-f3ce-4c87-be5e-6e67ad0fb99d None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:10.921915 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5d6e3eff-f3ce-4c87-be5e-6e67ad0fb99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:10.997396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f268e-58da-4c66-8d1f-69a0b16614bf None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:10.999500 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 150/308] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:56:11.023811 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e3eff-f3ce-4c87-be5e-6e67ad0fb99d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:11.041826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:11.043388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debda5f-e568-42b2-8f24-31c0b6935e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:11.045149 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debda5f-e568-42b2-8f24-31c0b6935e68 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:11.046208 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debda5f-e568-42b2-8f24-31c0b6935e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:11.046695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debda5f-e568-42b2-8f24-31c0b6935e68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:11.057831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debda5f-e568-42b2-8f24-31c0b6935e68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:11.064121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-2debda5f-e568-42b2-8f24-31c0b6935e68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:11.064121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:11.064121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:11.064121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:11.064121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:11.064121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:11.064121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:11.064121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:11.064121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:11.064121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:11.064121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:11.064121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:11.064121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:11.064121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:11.064121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:11.064121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:11.065024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:11.065024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:11.065024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:11.065024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:11.065024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:11.065024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:11.065024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:11.065024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:11.065024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:11.065024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:11.065024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:11.065024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:11.065024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:11.065024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:11.065024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:11.065024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:11.065850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:11.065850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:11.065850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:11.065850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:11.065850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:11.065850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:11.065850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:11.065850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:11.065850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:11.065850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:11.065850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:11.065850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:11.068203 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 159/309] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:11.074055 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debda5f-e568-42b2-8f24-31c0b6935e68 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:11.105903 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:11.135159 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e3eff-f3ce-4c87-be5e-6e67ad0fb99d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:11.174261 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210758a0-cffa-40d5-a6c2-2ddc4abba653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:11.175435 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210758a0-cffa-40d5-a6c2-2ddc4abba653 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:11.176274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210758a0-cffa-40d5-a6c2-2ddc4abba653 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:11.176693 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210758a0-cffa-40d5-a6c2-2ddc4abba653 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:11.184942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debda5f-e568-42b2-8f24-31c0b6935e68 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:11.191813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210758a0-cffa-40d5-a6c2-2ddc4abba653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:11.198643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-210758a0-cffa-40d5-a6c2-2ddc4abba653 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 06:56:11.198643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:11.198643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:11.198643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:11.198643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:11.198643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:11.198643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:11.198643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:11.198643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:11.198643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:11.198643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:11.198643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:11.198643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:11.198643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:11.198643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:11.198643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:11.199757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:11.199757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:11.199757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:11.199757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:11.199757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:11.199757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:11.199757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:11.199757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:11.199757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:11.199757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:11.199757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:11.199757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:11.199757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:11.199757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:11.199757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:11.199757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:11.201318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:11.201318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:11.201318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:11.201318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:11.201318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:11.201318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:11.201318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:11.201318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:11.201318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:11.201318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:11.201318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 06:56:11.201318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:11.203913 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 151/310] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:11.209789 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210758a0-cffa-40d5-a6c2-2ddc4abba653 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:11.231601 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023c3e0-7f0b-46ba-b0fb-9af5ec605540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:11.232615 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023c3e0-7f0b-46ba-b0fb-9af5ec605540 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:11.233082 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023c3e0-7f0b-46ba-b0fb-9af5ec605540 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:11.233560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023c3e0-7f0b-46ba-b0fb-9af5ec605540 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:11.234417 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023c3e0-7f0b-46ba-b0fb-9af5ec605540 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:11.234906 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023c3e0-7f0b-46ba-b0fb-9af5ec605540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:11.236576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023c3e0-7f0b-46ba-b0fb-9af5ec605540 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:11.246133 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 160/311] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:56:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:11.252076 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023c3e0-7f0b-46ba-b0fb-9af5ec605540 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:11.302021 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:11.328151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210758a0-cffa-40d5-a6c2-2ddc4abba653 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:11.366692 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22a561-2408-4d94-94e5-1cfed418af78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:11.367677 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22a561-2408-4d94-94e5-1cfed418af78 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:11.368147 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22a561-2408-4d94-94e5-1cfed418af78 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:11.368628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22a561-2408-4d94-94e5-1cfed418af78 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:11.369482 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22a561-2408-4d94-94e5-1cfed418af78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:11.370024 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22a561-2408-4d94-94e5-1cfed418af78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:11.371379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:11.371930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22a561-2408-4d94-94e5-1cfed418af78 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:11.383949 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 152/312] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:56:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:11.386787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023c3e0-7f0b-46ba-b0fb-9af5ec605540 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:11.392503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22a561-2408-4d94-94e5-1cfed418af78 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:11.431300 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ae1c9-d0c5-486a-aadf-f8ad408d2171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:11.431932 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ae1c9-d0c5-486a-aadf-f8ad408d2171 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:11.432204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ae1c9-d0c5-486a-aadf-f8ad408d2171 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:11.432473 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ae1c9-d0c5-486a-aadf-f8ad408d2171 None admin] PATH_INFO: `/v3/users/8f49ffeece7144a7a2c2858223a7e989` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:11.433597 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ae1c9-d0c5-486a-aadf-f8ad408d2171 None admin] RBAC: Authorizing `identity:get_user(user_id=8f49ffeece7144a7a2c2858223a7e989)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:11.435586 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ae1c9-d0c5-486a-aadf-f8ad408d2171 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:11.442185 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 161/313] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:56:11 2022] GET /identity/v3/users/8f49ffeece7144a7a2c2858223a7e989 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:11.443299 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ae1c9-d0c5-486a-aadf-f8ad408d2171 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:11.509026 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22a561-2408-4d94-94e5-1cfed418af78 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:11.546325 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323074c6-4469-4fb5-b3d9-94ef74ab064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:11.547295 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323074c6-4469-4fb5-b3d9-94ef74ab064c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:11.547602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323074c6-4469-4fb5-b3d9-94ef74ab064c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:11.547971 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323074c6-4469-4fb5-b3d9-94ef74ab064c None admin] PATH_INFO: `/v3/users/df400a5517544d99a1076046c42abdf1` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:11.549206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323074c6-4469-4fb5-b3d9-94ef74ab064c None admin] RBAC: Authorizing `identity:get_user(user_id=df400a5517544d99a1076046c42abdf1)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:11.550708 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323074c6-4469-4fb5-b3d9-94ef74ab064c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:11.557107 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 153/314] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:56:11 2022] GET /identity/v3/users/df400a5517544d99a1076046c42abdf1 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:11.558123 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323074c6-4469-4fb5-b3d9-94ef74ab064c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:11.567922 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:11.580001 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ae1c9-d0c5-486a-aadf-f8ad408d2171 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:11.626908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992c27b-ecb7-4c8e-a344-d2825295f027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:11.627822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992c27b-ecb7-4c8e-a344-d2825295f027 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:11.628237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992c27b-ecb7-4c8e-a344-d2825295f027 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:11.628640 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992c27b-ecb7-4c8e-a344-d2825295f027 None admin] PATH_INFO: `/v3/system/users/8f49ffeece7144a7a2c2858223a7e989/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:11.631111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992c27b-ecb7-4c8e-a344-d2825295f027 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8f49ffeece7144a7a2c2858223a7e989, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:11.632916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992c27b-ecb7-4c8e-a344-d2825295f027 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:11.652332 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 162/315] 10.222.0.40 () {58 vars in 1334 bytes} [Tue Aug 9 06:56:11 2022] PUT /identity/v3/system/users/8f49ffeece7144a7a2c2858223a7e989/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:56:11.684576 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323074c6-4469-4fb5-b3d9-94ef74ab064c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:11.724204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ad8e5-2177-4eec-96c2-bfe3726326c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:11.724934 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ad8e5-2177-4eec-96c2-bfe3726326c7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:11.725284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ad8e5-2177-4eec-96c2-bfe3726326c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:11.725629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ad8e5-2177-4eec-96c2-bfe3726326c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:11.804368 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ad8e5-2177-4eec-96c2-bfe3726326c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:11.805840 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ad8e5-2177-4eec-96c2-bfe3726326c7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:11.814589 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:11.911434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 154/316] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:11.916909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992c27b-ecb7-4c8e-a344-d2825295f027 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:11.943726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:12.025095 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992c27b-ecb7-4c8e-a344-d2825295f027 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:12.062270 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33153fbf-29c4-4115-b650-3a115a25b364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:12.062821 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33153fbf-29c4-4115-b650-3a115a25b364 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:12.063111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33153fbf-29c4-4115-b650-3a115a25b364 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:12.063387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33153fbf-29c4-4115-b650-3a115a25b364 None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:12.064510 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33153fbf-29c4-4115-b650-3a115a25b364 None admin] RBAC: Authorizing `identity:get_project(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:12.065952 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33153fbf-29c4-4115-b650-3a115a25b364 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:12.067886 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 163/317] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:11 2022] GET /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:12.073855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ad8e5-2177-4eec-96c2-bfe3726326c7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:12.186327 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ad8e5-2177-4eec-96c2-bfe3726326c7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:12.207464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:12.221860 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f20b89-c0bf-45aa-9b72-02f780c4c13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:12.222458 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f20b89-c0bf-45aa-9b72-02f780c4c13b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:12.222729 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f20b89-c0bf-45aa-9b72-02f780c4c13b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:12.222998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f20b89-c0bf-45aa-9b72-02f780c4c13b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:12.223748 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f20b89-c0bf-45aa-9b72-02f780c4c13b None admin] RBAC: Adding query filter params (role.id=3a56edec1d804398814836d8f3aeb8cb, scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506, user.id=df400a5517544d99a1076046c42abdf1) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:12.224052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f20b89-c0bf-45aa-9b72-02f780c4c13b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:12.225509 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f20b89-c0bf-45aa-9b72-02f780c4c13b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:12.231608 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 155/318] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:56:12 2022] GET /identity/v3/role_assignments?user.id=df400a5517544d99a1076046c42abdf1&scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506&role.id=3a56edec1d804398814836d8f3aeb8cb => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:12.626425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4082847-b875-45d7-814a-1b762e8b1b84 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:12.627121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4082847-b875-45d7-814a-1b762e8b1b84 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:12.627627 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4082847-b875-45d7-814a-1b762e8b1b84 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:12.629439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 164/319] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:12.634746 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7d52a-8de7-44b8-bd41-e71dff0c1fe5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:12.635035 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7d52a-8de7-44b8-bd41-e71dff0c1fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:12.635343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7d52a-8de7-44b8-bd41-e71dff0c1fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:12.653269 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2fe7d52a-8de7-44b8-bd41-e71dff0c1fe5 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:12.654490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2fe7d52a-8de7-44b8-bd41-e71dff0c1fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:12.724214 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 156/320] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:12.746475 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4082847-b875-45d7-814a-1b762e8b1b84 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:12.855520 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:12.868144 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4082847-b875-45d7-814a-1b762e8b1b84 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:12.903380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2e91d-f7cc-4cc5-b974-4a0cb3a1dba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:12.905139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2e91d-f7cc-4cc5-b974-4a0cb3a1dba6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:12.905419 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2e91d-f7cc-4cc5-b974-4a0cb3a1dba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:12.905688 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2e91d-f7cc-4cc5-b974-4a0cb3a1dba6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:12.906808 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2e91d-f7cc-4cc5-b974-4a0cb3a1dba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:12.908394 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2e91d-f7cc-4cc5-b974-4a0cb3a1dba6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:12.909598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f707a9-914e-4d85-afd5-0f7d3e8b7f45 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:12.909886 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f707a9-914e-4d85-afd5-0f7d3e8b7f45 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:12.910258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 165/321] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:12.910367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f707a9-914e-4d85-afd5-0f7d3e8b7f45 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:12.911609 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 157/322] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:12.916395 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050c510-0d18-4d14-9190-919ca3146e70 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:12.916506 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f707a9-914e-4d85-afd5-0f7d3e8b7f45 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:12.916671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050c510-0d18-4d14-9190-919ca3146e70 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:12.916948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050c510-0d18-4d14-9190-919ca3146e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:12.935426 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c050c510-0d18-4d14-9190-919ca3146e70 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:12.936596 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c050c510-0d18-4d14-9190-919ca3146e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:13.004825 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 166/323] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:13.020368 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:13.025698 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f707a9-914e-4d85-afd5-0f7d3e8b7f45 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:13.026312 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050c510-0d18-4d14-9190-919ca3146e70 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:13.063054 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ddec2-db38-4d3f-a6f0-d9c614a41595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:13.063694 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ddec2-db38-4d3f-a6f0-d9c614a41595 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:13.063967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ddec2-db38-4d3f-a6f0-d9c614a41595 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:13.064236 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ddec2-db38-4d3f-a6f0-d9c614a41595 None admin] PATH_INFO: `/v3/groups` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:13.064854 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ddec2-db38-4d3f-a6f0-d9c614a41595 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:13.066249 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ddec2-db38-4d3f-a6f0-d9c614a41595 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:13.082745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 158/324] 10.222.0.40 () {60 vars in 1134 bytes} [Tue Aug 9 06:56:12 2022] POST /identity/v3/groups => generated 226 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 06:56:13.127916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:13.137101 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050c510-0d18-4d14-9190-919ca3146e70 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:13.175790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef3794-a214-4ce0-8b45-301b04ac1798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:13.176359 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef3794-a214-4ce0-8b45-301b04ac1798 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:13.176631 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef3794-a214-4ce0-8b45-301b04ac1798 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:13.176898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef3794-a214-4ce0-8b45-301b04ac1798 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:13.188896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef3794-a214-4ce0-8b45-301b04ac1798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:13.193666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a7ef3794-a214-4ce0-8b45-301b04ac1798 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 06:56:13.193666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:13.193666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:13.193666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:13.193666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:13.193666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:13.193666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:13.193666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:13.193666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:13.193666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:13.193666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:13.193666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:13.193666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:13.193666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:13.193666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:13.193666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:13.194576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:13.194576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:13.194576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:13.194576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:13.194576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:13.194576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:13.194576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:13.194576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:13.194576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:13.194576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:13.194576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:13.194576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:13.194576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:13.194576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:13.194576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:13.194576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:13.195422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:13.195422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:13.195422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:13.195422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:13.195422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:13.195422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:13.195422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:13.195422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:13.195422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:13.195422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:13.195422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 06:56:13.195422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:13.199422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 167/325] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:56:13.201485 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ddec2-db38-4d3f-a6f0-d9c614a41595 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:13.313414 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ddec2-db38-4d3f-a6f0-d9c614a41595 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:13.348941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff5495-06ff-4010-a76a-06235c6e2dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:13.349551 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff5495-06ff-4010-a76a-06235c6e2dae None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:13.349828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff5495-06ff-4010-a76a-06235c6e2dae None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:13.350113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff5495-06ff-4010-a76a-06235c6e2dae None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:13.350766 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff5495-06ff-4010-a76a-06235c6e2dae None admin] RBAC: Adding query filter params (name=reader) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:13.351064 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff5495-06ff-4010-a76a-06235c6e2dae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:13.352503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff5495-06ff-4010-a76a-06235c6e2dae None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:13.362049 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 159/326] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:56:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:13.368286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef3794-a214-4ce0-8b45-301b04ac1798 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:13.495043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef3794-a214-4ce0-8b45-301b04ac1798 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:13.533739 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac3b55-45cf-45cb-80fa-59839f96cecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:13.534438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac3b55-45cf-45cb-80fa-59839f96cecd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:13.534720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac3b55-45cf-45cb-80fa-59839f96cecd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:13.534996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac3b55-45cf-45cb-80fa-59839f96cecd None admin] PATH_INFO: `/v3/users/b8ff0f4af87c4f8da3bab5aa6d41f39e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:13.536203 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac3b55-45cf-45cb-80fa-59839f96cecd None admin] RBAC: Authorizing `identity:get_user(user_id=b8ff0f4af87c4f8da3bab5aa6d41f39e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:13.537666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac3b55-45cf-45cb-80fa-59839f96cecd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:13.539299 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 168/327] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:56:13 2022] GET /identity/v3/users/b8ff0f4af87c4f8da3bab5aa6d41f39e => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:13.546184 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff5495-06ff-4010-a76a-06235c6e2dae None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:13.573537 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:13.671414 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff5495-06ff-4010-a76a-06235c6e2dae None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:13.710066 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365f034-4331-4ac5-ba61-5b024dc489f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:13.710724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365f034-4331-4ac5-ba61-5b024dc489f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:13.711002 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365f034-4331-4ac5-ba61-5b024dc489f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:13.711303 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365f034-4331-4ac5-ba61-5b024dc489f5 None admin] PATH_INFO: `/v3/system/users/b8ff0f4af87c4f8da3bab5aa6d41f39e/roles/3a56edec1d804398814836d8f3aeb8cb` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:13.713482 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365f034-4331-4ac5-ba61-5b024dc489f5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b8ff0f4af87c4f8da3bab5aa6d41f39e, role_id=3a56edec1d804398814836d8f3aeb8cb)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:13.714850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365f034-4331-4ac5-ba61-5b024dc489f5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:13.734442 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 160/328] 10.222.0.40 () {58 vars in 1334 bytes} [Tue Aug 9 06:56:13 2022] PUT /identity/v3/system/users/b8ff0f4af87c4f8da3bab5aa6d41f39e/roles/3a56edec1d804398814836d8f3aeb8cb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:56:13.772155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba87f4a-f682-4bc1-886b-88a6d2d29945 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:13.772438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba87f4a-f682-4bc1-886b-88a6d2d29945 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:13.772689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba87f4a-f682-4bc1-886b-88a6d2d29945 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:13.774171 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 169/329] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:13.780566 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27403848-b0da-4aca-8003-1627a7292e6b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:13.781182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27403848-b0da-4aca-8003-1627a7292e6b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:13.781691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27403848-b0da-4aca-8003-1627a7292e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:13.801999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-27403848-b0da-4aca-8003-1627a7292e6b None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:13.803627 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-27403848-b0da-4aca-8003-1627a7292e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:13.882770 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 161/330] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:13.909020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba87f4a-f682-4bc1-886b-88a6d2d29945 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:13.929377 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:14.031545 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba87f4a-f682-4bc1-886b-88a6d2d29945 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:14.076486 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d5348-89f0-4d9b-a1fe-0a35e6f9ac53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:14.077209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d5348-89f0-4d9b-a1fe-0a35e6f9ac53 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:14.077532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d5348-89f0-4d9b-a1fe-0a35e6f9ac53 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:14.077802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d5348-89f0-4d9b-a1fe-0a35e6f9ac53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:14.093177 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d5348-89f0-4d9b-a1fe-0a35e6f9ac53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:14.098064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-937d5348-89f0-4d9b-a1fe-0a35e6f9ac53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:14.098064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:14.098064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:14.098064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:14.098064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:14.098064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:14.098064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:14.098064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:14.098064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:14.098064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:14.098064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:14.098064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:14.098064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:14.098064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:14.098064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:14.098064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:14.098924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:14.098924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:14.098924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:14.098924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:14.098924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:14.098924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:14.098924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:14.098924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:14.098924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:14.098924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:14.098924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:14.098924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:14.098924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:14.098924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:14.098924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:14.098924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:14.099767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:14.099767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:14.099767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:14.099767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:14.099767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:14.099767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:14.099767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:14.099767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:14.099767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:14.099767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:14.099767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:14.099767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:14.099767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 170/331] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:14.105728 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27403848-b0da-4aca-8003-1627a7292e6b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:14.132129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:14.241636 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27403848-b0da-4aca-8003-1627a7292e6b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:14.279116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d094d-a53d-4f9b-b07a-9d6ba98d212a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:14.279740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d094d-a53d-4f9b-b07a-9d6ba98d212a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:14.280014 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d094d-a53d-4f9b-b07a-9d6ba98d212a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:14.280285 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d094d-a53d-4f9b-b07a-9d6ba98d212a None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:14.280948 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d094d-a53d-4f9b-b07a-9d6ba98d212a None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:14.281248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d094d-a53d-4f9b-b07a-9d6ba98d212a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:14.282719 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d094d-a53d-4f9b-b07a-9d6ba98d212a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:14.291500 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 162/332] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:56:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:14.300194 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d5348-89f0-4d9b-a1fe-0a35e6f9ac53 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:14.387654 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:14.413012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d5348-89f0-4d9b-a1fe-0a35e6f9ac53 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:14.452883 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b7a10-b84d-4624-9441-a6a832e0fd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:14.453874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b7a10-b84d-4624-9441-a6a832e0fd43 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:14.454328 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b7a10-b84d-4624-9441-a6a832e0fd43 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:14.455051 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b7a10-b84d-4624-9441-a6a832e0fd43 None admin] PATH_INFO: `/v3/users/8f49ffeece7144a7a2c2858223a7e989` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:14.456400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b7a10-b84d-4624-9441-a6a832e0fd43 None admin] RBAC: Authorizing `identity:get_user(user_id=8f49ffeece7144a7a2c2858223a7e989)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:14.458083 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b7a10-b84d-4624-9441-a6a832e0fd43 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:14.460177 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 171/333] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:56:14 2022] GET /identity/v3/users/8f49ffeece7144a7a2c2858223a7e989 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:14.466846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d094d-a53d-4f9b-b07a-9d6ba98d212a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:14.555237 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:14.580636 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d094d-a53d-4f9b-b07a-9d6ba98d212a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:14.624644 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076e4cb-5d8b-4453-ae35-9e4021a27a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:14.625321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076e4cb-5d8b-4453-ae35-9e4021a27a19 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:14.625604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076e4cb-5d8b-4453-ae35-9e4021a27a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:14.625878 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076e4cb-5d8b-4453-ae35-9e4021a27a19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:14.626666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076e4cb-5d8b-4453-ae35-9e4021a27a19 None admin] RBAC: Adding query filter params (role.id=decfb257a46442b8b4637f8c95c9967b, user.id=8f49ffeece7144a7a2c2858223a7e989, scope.system=all) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:14.626980 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076e4cb-5d8b-4453-ae35-9e4021a27a19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:14.629892 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076e4cb-5d8b-4453-ae35-9e4021a27a19 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:14.644125 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 163/334] 10.222.0.40 () {56 vars in 1308 bytes} [Tue Aug 9 06:56:14 2022] GET /identity/v3/role_assignments?user.id=8f49ffeece7144a7a2c2858223a7e989&scope.system=all&role.id=decfb257a46442b8b4637f8c95c9967b => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:16.066922 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05393b-dfd9-4122-8bf9-91add463d9ad None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:16.067453 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05393b-dfd9-4122-8bf9-91add463d9ad None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:16.067529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05393b-dfd9-4122-8bf9-91add463d9ad None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:16.069075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 172/335] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:16.088667 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cb6c8-30c5-4636-affb-2e99c24e37a3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:16.089162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cb6c8-30c5-4636-affb-2e99c24e37a3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:16.089236 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cb6c8-30c5-4636-affb-2e99c24e37a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:16.109929 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0a2cb6c8-30c5-4636-affb-2e99c24e37a3 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:16.111134 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0a2cb6c8-30c5-4636-affb-2e99c24e37a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:16.192346 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 164/336] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:16.232599 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05393b-dfd9-4122-8bf9-91add463d9ad None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:16.357147 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05393b-dfd9-4122-8bf9-91add463d9ad None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:16.399406 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52f569-b9b6-4b3e-a3cd-64ceeb2404eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:16.400037 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52f569-b9b6-4b3e-a3cd-64ceeb2404eb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:16.400376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52f569-b9b6-4b3e-a3cd-64ceeb2404eb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:16.400649 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52f569-b9b6-4b3e-a3cd-64ceeb2404eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:16.417963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52f569-b9b6-4b3e-a3cd-64ceeb2404eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:16.423536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7d52f569-b9b6-4b3e-a3cd-64ceeb2404eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:16.423536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:16.423536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:16.423536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:16.423536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:16.423536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:16.423536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:16.423536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:16.423536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:16.423536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:16.423536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:16.423536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:16.423536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:16.423536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:16.423536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:16.423536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:16.425592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:16.425592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:16.425592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:16.425592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:16.425592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:16.425592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:16.425592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:16.425592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:16.425592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:16.425592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:16.425592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:16.425592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:16.425592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:16.425592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:16.425592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:16.425592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:16.427532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:16.427532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:16.427532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:16.427532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:16.427532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:16.427532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:16.427532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:16.427532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:16.427532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:16.427532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:16.427532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:16.427532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:16.427532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 173/337] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:16.435076 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25601d19-19a8-4c41-b798-409f9fb65621 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:16.435459 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25601d19-19a8-4c41-b798-409f9fb65621 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:16.435626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25601d19-19a8-4c41-b798-409f9fb65621 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:16.436142 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52f569-b9b6-4b3e-a3cd-64ceeb2404eb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:16.437830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 165/338] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:16.441034 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:16.444368 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f6026-60b6-4d1f-b768-28ace8f6f54f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:16.444654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f6026-60b6-4d1f-b768-28ace8f6f54f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:16.444930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f6026-60b6-4d1f-b768-28ace8f6f54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:16.487104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8d9f6026-60b6-4d1f-b768-28ace8f6f54f None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:16.488304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8d9f6026-60b6-4d1f-b768-28ace8f6f54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:16.570155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52f569-b9b6-4b3e-a3cd-64ceeb2404eb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:16.623901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c927823-4b89-4c8d-9635-45b527ad68f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:16.624443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c927823-4b89-4c8d-9635-45b527ad68f2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:16.624715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c927823-4b89-4c8d-9635-45b527ad68f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:16.624983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c927823-4b89-4c8d-9635-45b527ad68f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:16.625647 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c927823-4b89-4c8d-9635-45b527ad68f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:16.625945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c927823-4b89-4c8d-9635-45b527ad68f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:16.627404 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c927823-4b89-4c8d-9635-45b527ad68f2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:16.639230 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 174/339] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:56:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:16.640192 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:16.642650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c927823-4b89-4c8d-9635-45b527ad68f2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:16.654162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 166/340] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:16.693723 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f6026-60b6-4d1f-b768-28ace8f6f54f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:16.731506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:16.773734 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c927823-4b89-4c8d-9635-45b527ad68f2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:16.832701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6343b1a-2899-4cf1-94c9-114a8c817dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:16.833689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6343b1a-2899-4cf1-94c9-114a8c817dfc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:16.834176 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6343b1a-2899-4cf1-94c9-114a8c817dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:16.834637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6343b1a-2899-4cf1-94c9-114a8c817dfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:16.838518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f6026-60b6-4d1f-b768-28ace8f6f54f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:16.878047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7c29f-31ff-4024-ac06-f9c24010de8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:16.878599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7c29f-31ff-4024-ac06-f9c24010de8c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:16.878877 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7c29f-31ff-4024-ac06-f9c24010de8c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:16.879175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7c29f-31ff-4024-ac06-f9c24010de8c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:16.901739 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7c29f-31ff-4024-ac06-f9c24010de8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:16.908033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-deb7c29f-31ff-4024-ac06-f9c24010de8c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 06:56:16.908033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:16.908033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:16.908033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:16.908033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:16.908033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:16.908033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:16.908033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:16.908033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:16.908033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:16.908033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:16.908033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:16.908033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:16.908033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:16.908033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:16.908033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:16.908911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:16.908911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:16.908911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:16.908911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:16.908911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:16.908911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:16.908911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:16.908911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:16.908911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:16.908911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:16.908911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:16.908911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:16.908911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:16.908911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:16.908911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:16.908911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:16.909709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:16.909709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:16.909709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:16.909709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:16.909709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:16.909709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:16.909709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:16.909709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:16.909709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:16.909709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:16.909709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 06:56:16.909709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:16.909709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 167/341] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:16.910359 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89424766-6aaf-42eb-ba34-7ef0a7eff822 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:16.912309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89424766-6aaf-42eb-ba34-7ef0a7eff822 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:16.912309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89424766-6aaf-42eb-ba34-7ef0a7eff822 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:16.919723 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 168/342] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:16.924859 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89424766-6aaf-42eb-ba34-7ef0a7eff822 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:16.977729 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6343b1a-2899-4cf1-94c9-114a8c817dfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:16.979215 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6343b1a-2899-4cf1-94c9-114a8c817dfc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:17.042914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:17.109831 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89424766-6aaf-42eb-ba34-7ef0a7eff822 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:17.115407 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:17.152778 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf7a90-2fbc-4671-b118-6a1b2c55fd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:17.153309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf7a90-2fbc-4671-b118-6a1b2c55fd47 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:17.153655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf7a90-2fbc-4671-b118-6a1b2c55fd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:17.153933 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf7a90-2fbc-4671-b118-6a1b2c55fd47 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:17.154696 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf7a90-2fbc-4671-b118-6a1b2c55fd47 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:17.155005 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf7a90-2fbc-4671-b118-6a1b2c55fd47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:17.156437 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf7a90-2fbc-4671-b118-6a1b2c55fd47 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:17.165701 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 169/343] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:56:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:17.169003 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf887c1a-51db-429a-bb47-5bc3c79b92ab None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:17.169003 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf887c1a-51db-429a-bb47-5bc3c79b92ab None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:17.169003 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf887c1a-51db-429a-bb47-5bc3c79b92ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:17.173317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 175/344] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:17.174779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41dbf2-2200-40d9-a050-bb3948e7aefc None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:17.175372 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41dbf2-2200-40d9-a050-bb3948e7aefc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:17.175837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41dbf2-2200-40d9-a050-bb3948e7aefc None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:17.177278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 176/345] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:17.183101 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cff6f-35d5-441b-a5f3-2d821fd1bdd6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:17.183623 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cff6f-35d5-441b-a5f3-2d821fd1bdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:17.184105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cff6f-35d5-441b-a5f3-2d821fd1bdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:17.187682 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-bf887c1a-51db-429a-bb47-5bc3c79b92ab None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:17.188933 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bf887c1a-51db-429a-bb47-5bc3c79b92ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:17.208755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b18cff6f-35d5-441b-a5f3-2d821fd1bdd6 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:17.210391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b18cff6f-35d5-441b-a5f3-2d821fd1bdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:17.277092 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 170/346] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:17.278326 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf887c1a-51db-429a-bb47-5bc3c79b92ab None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:17.319705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 177/347] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:17.320850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cff6f-35d5-441b-a5f3-2d821fd1bdd6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:17.354980 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:17.420207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf887c1a-51db-429a-bb47-5bc3c79b92ab None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:17.437077 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:17.444292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cff6f-35d5-441b-a5f3-2d821fd1bdd6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:17.462627 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bdb4a-786c-4c89-a29c-d5dcf337a934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:17.463382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bdb4a-786c-4c89-a29c-d5dcf337a934 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:17.463664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bdb4a-786c-4c89-a29c-d5dcf337a934 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:17.463929 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bdb4a-786c-4c89-a29c-d5dcf337a934 None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:17.465940 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bdb4a-786c-4c89-a29c-d5dcf337a934 None admin] RBAC: Authorizing `identity:get_project(project_id=b4ee993851d3477d921a816e3f05a39d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:17.468115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bdb4a-786c-4c89-a29c-d5dcf337a934 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:17.469773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 171/348] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:17 2022] GET /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:17.470702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bdb4a-786c-4c89-a29c-d5dcf337a934 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:17.486144 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197c13d-671d-4867-885a-217d80636198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:17.486770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197c13d-671d-4867-885a-217d80636198 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:17.487039 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197c13d-671d-4867-885a-217d80636198 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:17.487341 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197c13d-671d-4867-885a-217d80636198 None admin] PATH_INFO: `/v3/users/b8ff0f4af87c4f8da3bab5aa6d41f39e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:17.489838 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197c13d-671d-4867-885a-217d80636198 None admin] RBAC: Authorizing `identity:get_user(user_id=b8ff0f4af87c4f8da3bab5aa6d41f39e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:17.491330 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197c13d-671d-4867-885a-217d80636198 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:17.493070 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 178/349] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:56:17 2022] GET /identity/v3/users/b8ff0f4af87c4f8da3bab5aa6d41f39e => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:17.493662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197c13d-671d-4867-885a-217d80636198 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:17.596779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bdb4a-786c-4c89-a29c-d5dcf337a934 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:17.618666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197c13d-671d-4867-885a-217d80636198 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:17.621765 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:17.650503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09855b-0ad9-4dad-a53c-19d4d9c40df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:17.651740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09855b-0ad9-4dad-a53c-19d4d9c40df6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:17.651847 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09855b-0ad9-4dad-a53c-19d4d9c40df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:17.652051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09855b-0ad9-4dad-a53c-19d4d9c40df6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:17.665632 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09855b-0ad9-4dad-a53c-19d4d9c40df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:17.666561 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40b0cd-fcc8-4c28-8f23-73d996f372af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:17.670445 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40b0cd-fcc8-4c28-8f23-73d996f372af None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:17.670445 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40b0cd-fcc8-4c28-8f23-73d996f372af None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:17.670445 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40b0cd-fcc8-4c28-8f23-73d996f372af None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:17.670914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-dc09855b-0ad9-4dad-a53c-19d4d9c40df6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:56:17.670914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:17.670914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:17.670914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:17.670914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:17.670914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:17.670914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:17.670914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:17.670914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:17.670914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:17.670914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:17.670914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:17.670914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:17.670914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:17.670914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:17.670914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:17.671809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:17.671809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:17.671809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:17.671809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:17.671809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:17.671809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:17.671809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:17.671809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:17.671809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:17.671809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:17.671809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:17.671809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:17.671809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:17.671809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:17.671809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:17.671809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:17.672641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:17.672641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:17.672641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:17.672641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:17.672641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:17.672641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:17.672641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:17.672641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:17.672641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:17.672641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:17.672641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:56:17.672641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:17.672641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 172/350] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:56:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:17.673821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8838e-d286-4690-9a98-20f919f26eeb None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:17.673821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8838e-d286-4690-9a98-20f919f26eeb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:17.674047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8838e-d286-4690-9a98-20f919f26eeb None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:17.675560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 173/351] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:17.676347 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8838e-d286-4690-9a98-20f919f26eeb None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:17.692311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40b0cd-fcc8-4c28-8f23-73d996f372af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:17.697670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7c40b0cd-fcc8-4c28-8f23-73d996f372af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:17.697670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:17.697670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:17.697670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:17.697670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:17.697670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:17.697670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:17.697670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:17.697670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:17.697670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:17.697670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:17.697670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:17.697670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:17.697670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:17.697670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:17.697670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:17.698572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:17.698572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:17.698572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:17.698572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:17.698572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:17.698572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:17.698572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:17.698572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:17.698572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:17.698572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:17.698572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:17.698572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:17.698572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:17.698572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:17.698572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:17.698572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:17.699415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:17.699415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:17.699415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:17.699415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:17.699415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:17.699415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:17.699415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:17.699415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:17.699415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:17.699415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:17.699415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:17.699415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:17.699415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 179/352] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:17.700081 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40b0cd-fcc8-4c28-8f23-73d996f372af None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:17.731846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:17.804246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8838e-d286-4690-9a98-20f919f26eeb None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:17.826746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40b0cd-fcc8-4c28-8f23-73d996f372af None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:17.847687 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03bbec-ff41-4974-bbaf-c0b3bdd7c779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:17.848741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03bbec-ff41-4974-bbaf-c0b3bdd7c779 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:17.849434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03bbec-ff41-4974-bbaf-c0b3bdd7c779 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:17.849861 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03bbec-ff41-4974-bbaf-c0b3bdd7c779 None admin] PATH_INFO: `/v3/groups/b40eec006bd247068fbf1b33da715d5b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:17.857428 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b03bbec-ff41-4974-bbaf-c0b3bdd7c779 None admin] RBAC: Authorizing `identity:get_group(group_id=b40eec006bd247068fbf1b33da715d5b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:17.860000 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b03bbec-ff41-4974-bbaf-c0b3bdd7c779 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:17.861401 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 174/353] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Aug 9 06:56:17 2022] GET /identity/v3/groups/b40eec006bd247068fbf1b33da715d5b => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:17.862404 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463394b-f679-4fa9-bde8-bc8c58466559 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:17.862680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463394b-f679-4fa9-bde8-bc8c58466559 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:17.862947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463394b-f679-4fa9-bde8-bc8c58466559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:17.870712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19873b1-a9f7-4a37-8099-75299bbd417b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:17.871372 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19873b1-a9f7-4a37-8099-75299bbd417b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:17.871654 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19873b1-a9f7-4a37-8099-75299bbd417b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:17.871927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19873b1-a9f7-4a37-8099-75299bbd417b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:17.873451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19873b1-a9f7-4a37-8099-75299bbd417b None admin] RBAC: Adding query filter params (role.id=3a56edec1d804398814836d8f3aeb8cb, user.id=b8ff0f4af87c4f8da3bab5aa6d41f39e, scope.system=all) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:17.873769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19873b1-a9f7-4a37-8099-75299bbd417b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:17.875315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19873b1-a9f7-4a37-8099-75299bbd417b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:17.886567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0463394b-f679-4fa9-bde8-bc8c58466559 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:17.887840 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0463394b-f679-4fa9-bde8-bc8c58466559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:17.889429 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 180/354] 10.222.0.40 () {56 vars in 1308 bytes} [Tue Aug 9 06:56:17 2022] GET /identity/v3/role_assignments?user.id=b8ff0f4af87c4f8da3bab5aa6d41f39e&scope.system=all&role.id=3a56edec1d804398814836d8f3aeb8cb => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:17.890264 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19873b1-a9f7-4a37-8099-75299bbd417b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:17.936530 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:17.986423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 175/355] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:17.987324 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463394b-f679-4fa9-bde8-bc8c58466559 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:18.008132 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:18.035370 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19873b1-a9f7-4a37-8099-75299bbd417b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:18.082350 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe100b-d81b-4eae-b649-65234f991fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:18.082988 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe100b-d81b-4eae-b649-65234f991fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:18.083330 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe100b-d81b-4eae-b649-65234f991fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:18.083595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe100b-d81b-4eae-b649-65234f991fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:18.084258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe100b-d81b-4eae-b649-65234f991fa8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:18.084557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe100b-d81b-4eae-b649-65234f991fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:18.085915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe100b-d81b-4eae-b649-65234f991fa8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:18.099325 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 181/356] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:18.100733 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9b9d2-803d-4783-bcbf-7a894b6a08eb None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:18.101017 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9b9d2-803d-4783-bcbf-7a894b6a08eb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:18.101306 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9b9d2-803d-4783-bcbf-7a894b6a08eb None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:18.102846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 182/357] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:18.104853 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9b9d2-803d-4783-bcbf-7a894b6a08eb None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:18.117215 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463394b-f679-4fa9-bde8-bc8c58466559 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:18.160968 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede285d-94db-4b2a-9f12-4eaf7869809c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:18.161579 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede285d-94db-4b2a-9f12-4eaf7869809c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:18.161861 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede285d-94db-4b2a-9f12-4eaf7869809c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:18.162128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede285d-94db-4b2a-9f12-4eaf7869809c None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:18.162794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede285d-94db-4b2a-9f12-4eaf7869809c None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:18.163108 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede285d-94db-4b2a-9f12-4eaf7869809c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:18.164458 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede285d-94db-4b2a-9f12-4eaf7869809c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:18.173796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 176/358] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:56:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:18.174739 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede285d-94db-4b2a-9f12-4eaf7869809c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:18.211533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:18.236889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9b9d2-803d-4783-bcbf-7a894b6a08eb None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:18.274701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03c12d-fd04-48b7-96cb-8c72626ef6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:18.275336 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03c12d-fd04-48b7-96cb-8c72626ef6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:18.275609 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03c12d-fd04-48b7-96cb-8c72626ef6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:18.275876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03c12d-fd04-48b7-96cb-8c72626ef6a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:18.276586 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03c12d-fd04-48b7-96cb-8c72626ef6a9 None admin] RBAC: Adding query filter params (group.id=b40eec006bd247068fbf1b33da715d5b, role.id=decfb257a46442b8b4637f8c95c9967b, scope.project.id=b4ee993851d3477d921a816e3f05a39d) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:18.276889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03c12d-fd04-48b7-96cb-8c72626ef6a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:18.278315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03c12d-fd04-48b7-96cb-8c72626ef6a9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:18.285560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 183/359] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Aug 9 06:56:18 2022] GET /identity/v3/role_assignments?group.id=b40eec006bd247068fbf1b33da715d5b&scope.project.id=b4ee993851d3477d921a816e3f05a39d&role.id=decfb257a46442b8b4637f8c95c9967b => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:18.286436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03c12d-fd04-48b7-96cb-8c72626ef6a9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:18.298758 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:18.302728 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede285d-94db-4b2a-9f12-4eaf7869809c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:18.346776 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5327c4-db31-40db-afd9-ae503ade52e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:18.347452 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5327c4-db31-40db-afd9-ae503ade52e9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:18.347726 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5327c4-db31-40db-afd9-ae503ade52e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:18.347993 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5327c4-db31-40db-afd9-ae503ade52e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:18.364426 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5327c4-db31-40db-afd9-ae503ade52e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:18.369782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-4d5327c4-db31-40db-afd9-ae503ade52e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:56:18.369782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:18.369782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:18.369782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:18.369782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:18.369782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:18.369782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:18.369782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:18.369782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:18.369782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:18.369782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:18.369782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:18.369782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:18.369782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:18.369782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:18.369782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:18.370813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:18.370813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:18.370813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:18.370813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:18.370813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:18.370813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:18.370813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:18.370813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:18.370813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:18.370813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:18.370813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:18.370813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:18.370813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:18.370813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:18.370813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:18.370813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:18.371663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:18.371663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:18.371663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:18.371663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:18.371663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:18.371663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:18.371663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:18.371663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:18.371663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:18.371663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:18.371663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:56:18.371663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:18.371663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 177/360] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:56:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:18.373421 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813b83c-a5c1-4520-8a8e-8ac27e436e3b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:18.373421 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813b83c-a5c1-4520-8a8e-8ac27e436e3b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:18.373421 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813b83c-a5c1-4520-8a8e-8ac27e436e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:18.394379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0813b83c-a5c1-4520-8a8e-8ac27e436e3b None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:18.396141 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0813b83c-a5c1-4520-8a8e-8ac27e436e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:18.439550 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03c12d-fd04-48b7-96cb-8c72626ef6a9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:18.485830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 178/361] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:18.486684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813b83c-a5c1-4520-8a8e-8ac27e436e3b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:18.488667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7333219-55b3-4027-945d-e87efe0e33a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:18.489276 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333219-55b3-4027-945d-e87efe0e33a9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:18.489553 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333219-55b3-4027-945d-e87efe0e33a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:18.489832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333219-55b3-4027-945d-e87efe0e33a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:18.518984 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:18.581905 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7333219-55b3-4027-945d-e87efe0e33a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:18.583700 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7333219-55b3-4027-945d-e87efe0e33a9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:18.598616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:18.617282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813b83c-a5c1-4520-8a8e-8ac27e436e3b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:18.662849 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fccc2-0729-4880-95e2-26438c701072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:18.663639 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fccc2-0729-4880-95e2-26438c701072 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:18.663914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fccc2-0729-4880-95e2-26438c701072 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:18.664176 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fccc2-0729-4880-95e2-26438c701072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:18.740524 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 184/362] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:18.743270 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7333219-55b3-4027-945d-e87efe0e33a9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:18.764371 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fccc2-0729-4880-95e2-26438c701072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:18.767330 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fccc2-0729-4880-95e2-26438c701072 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:18.798110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:18.872062 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7333219-55b3-4027-945d-e87efe0e33a9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:18.883655 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:18.897197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 179/363] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:18.897197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fccc2-0729-4880-95e2-26438c701072 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:18.920181 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d3d5c-4399-4ca2-8cf6-3ab1dda1c489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:18.920820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d3d5c-4399-4ca2-8cf6-3ab1dda1c489 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:18.921207 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d3d5c-4399-4ca2-8cf6-3ab1dda1c489 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:18.921481 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d3d5c-4399-4ca2-8cf6-3ab1dda1c489 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:18.922301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d3d5c-4399-4ca2-8cf6-3ab1dda1c489 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:18.922608 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d3d5c-4399-4ca2-8cf6-3ab1dda1c489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:18.924401 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d3d5c-4399-4ca2-8cf6-3ab1dda1c489 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:18.934574 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 185/364] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:18.934574 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d3d5c-4399-4ca2-8cf6-3ab1dda1c489 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:19.040651 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fccc2-0729-4880-95e2-26438c701072 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:19.069670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d3d5c-4399-4ca2-8cf6-3ab1dda1c489 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:19.074642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:19.087375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6298c8-1b69-4e84-95cf-a4a031fa6863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:19.088011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6298c8-1b69-4e84-95cf-a4a031fa6863 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:19.089630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6298c8-1b69-4e84-95cf-a4a031fa6863 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:19.089914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6298c8-1b69-4e84-95cf-a4a031fa6863 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:19.101348 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6298c8-1b69-4e84-95cf-a4a031fa6863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:19.107740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3b6298c8-1b69-4e84-95cf-a4a031fa6863 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:56:19.107740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:19.107740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:19.107740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:19.107740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:19.107740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:19.107740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:19.107740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:19.107740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:19.107740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:19.107740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:19.107740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:19.107740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:19.107740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:19.107740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:19.107740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:19.108628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:19.108628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:19.108628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:19.108628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:19.108628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:19.108628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:19.108628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:19.108628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:19.108628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:19.108628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:19.108628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:19.108628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:19.108628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:19.108628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:19.108628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:19.108628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:19.111923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:19.111923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:19.111923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:19.111923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:19.111923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:19.111923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:19.111923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:19.111923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:19.111923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:19.111923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:19.111923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:56:19.111923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:19.111923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 180/365] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:56:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:19.111923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6298c8-1b69-4e84-95cf-a4a031fa6863 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:19.116172 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c1642-092f-4047-aaf2-d69f5cc45f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:19.116869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c1642-092f-4047-aaf2-d69f5cc45f92 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:19.117141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c1642-092f-4047-aaf2-d69f5cc45f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:19.117404 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c1642-092f-4047-aaf2-d69f5cc45f92 None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:19.118526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c1642-092f-4047-aaf2-d69f5cc45f92 None admin] RBAC: Authorizing `identity:get_project(project_id=b4ee993851d3477d921a816e3f05a39d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:19.120003 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c1642-092f-4047-aaf2-d69f5cc45f92 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:19.121970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 186/366] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:18 2022] GET /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:19.127436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c1642-092f-4047-aaf2-d69f5cc45f92 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:19.173974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:19.251304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6298c8-1b69-4e84-95cf-a4a031fa6863 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:19.265060 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c1642-092f-4047-aaf2-d69f5cc45f92 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:19.289085 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4a9ce-d416-401a-8baf-b0683c9aa039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:19.289723 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4a9ce-d416-401a-8baf-b0683c9aa039 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:19.290001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4a9ce-d416-401a-8baf-b0683c9aa039 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:19.290271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4a9ce-d416-401a-8baf-b0683c9aa039 None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:19.291881 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4a9ce-d416-401a-8baf-b0683c9aa039 None admin] RBAC: Authorizing `identity:get_project(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:19.293258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4a9ce-d416-401a-8baf-b0683c9aa039 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:19.295524 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 181/367] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:19 2022] GET /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:19.296382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4a9ce-d416-401a-8baf-b0683c9aa039 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:19.315390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdcfbf-593d-4c08-81ce-fcf0162e6109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:19.316335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdcfbf-593d-4c08-81ce-fcf0162e6109 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:19.316810 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdcfbf-593d-4c08-81ce-fcf0162e6109 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:19.317300 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdcfbf-593d-4c08-81ce-fcf0162e6109 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:19.361418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:19.409976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdcfbf-593d-4c08-81ce-fcf0162e6109 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:19.411839 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdcfbf-593d-4c08-81ce-fcf0162e6109 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:19.429558 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4a9ce-d416-401a-8baf-b0683c9aa039 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:19.463971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:19.487331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74641cb4-0a8a-4789-a81d-6dddeacd262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:19.487981 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74641cb4-0a8a-4789-a81d-6dddeacd262b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:19.488262 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74641cb4-0a8a-4789-a81d-6dddeacd262b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:19.488541 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74641cb4-0a8a-4789-a81d-6dddeacd262b None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:19.489219 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74641cb4-0a8a-4789-a81d-6dddeacd262b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:19.489540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74641cb4-0a8a-4789-a81d-6dddeacd262b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:19.490897 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74641cb4-0a8a-4789-a81d-6dddeacd262b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:19.503167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 182/368] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:19.504016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74641cb4-0a8a-4789-a81d-6dddeacd262b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:19.540106 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 187/369] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:19.542695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdcfbf-593d-4c08-81ce-fcf0162e6109 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:19.634400 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74641cb4-0a8a-4789-a81d-6dddeacd262b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:19.650309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:19.670896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdcfbf-593d-4c08-81ce-fcf0162e6109 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:19.671491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758af5f-e070-40c0-9018-24fdca0ca1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:19.672119 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758af5f-e070-40c0-9018-24fdca0ca1fa None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:19.672394 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758af5f-e070-40c0-9018-24fdca0ca1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:19.672660 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758af5f-e070-40c0-9018-24fdca0ca1fa None admin] PATH_INFO: `/v3/groups/b40eec006bd247068fbf1b33da715d5b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:19.673748 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758af5f-e070-40c0-9018-24fdca0ca1fa None admin] RBAC: Authorizing `identity:get_group(group_id=b40eec006bd247068fbf1b33da715d5b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:19.675192 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758af5f-e070-40c0-9018-24fdca0ca1fa None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:19.676914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 183/370] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Aug 9 06:56:19 2022] GET /identity/v3/groups/b40eec006bd247068fbf1b33da715d5b => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:19.677572 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758af5f-e070-40c0-9018-24fdca0ca1fa None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:19.712148 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759ba5c-40e9-4133-ba31-d48a0db255f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:19.712777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759ba5c-40e9-4133-ba31-d48a0db255f6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:19.713053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759ba5c-40e9-4133-ba31-d48a0db255f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:19.713325 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759ba5c-40e9-4133-ba31-d48a0db255f6 None admin] PATH_INFO: `/v3/groups/b40eec006bd247068fbf1b33da715d5b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:19.714439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759ba5c-40e9-4133-ba31-d48a0db255f6 None admin] RBAC: Authorizing `identity:get_group(group_id=b40eec006bd247068fbf1b33da715d5b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:19.716556 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759ba5c-40e9-4133-ba31-d48a0db255f6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:19.722834 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 188/371] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Aug 9 06:56:19 2022] GET /identity/v3/groups/b40eec006bd247068fbf1b33da715d5b => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:19.722834 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759ba5c-40e9-4133-ba31-d48a0db255f6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:19.730137 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:19.785769 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758af5f-e070-40c0-9018-24fdca0ca1fa None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:19.819869 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ae0b4-340f-4346-8abf-470c30bc9d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:19.820393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ae0b4-340f-4346-8abf-470c30bc9d74 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:19.820669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ae0b4-340f-4346-8abf-470c30bc9d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:19.820928 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ae0b4-340f-4346-8abf-470c30bc9d74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:19.825322 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759ba5c-40e9-4133-ba31-d48a0db255f6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:19.862271 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4359e5-2574-435e-b958-5aabef474cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:19.863424 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4359e5-2574-435e-b958-5aabef474cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:19.863704 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4359e5-2574-435e-b958-5aabef474cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:19.863972 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4359e5-2574-435e-b958-5aabef474cb0 None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:19.865523 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4359e5-2574-435e-b958-5aabef474cb0 None admin] RBAC: Authorizing `identity:get_project(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:19.867692 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4359e5-2574-435e-b958-5aabef474cb0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:19.871387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 189/372] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:19 2022] GET /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:19.873488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4359e5-2574-435e-b958-5aabef474cb0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:19.876214 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:19.892771 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ae0b4-340f-4346-8abf-470c30bc9d74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:19.894323 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ae0b4-340f-4346-8abf-470c30bc9d74 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:19.957546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:19.983956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4359e5-2574-435e-b958-5aabef474cb0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:19.998242 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 184/373] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:19.998915 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ae0b4-340f-4346-8abf-470c30bc9d74 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:20.022480 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7402bdd-b5d6-44b6-a393-bc47a9c1db7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:20.023106 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7402bdd-b5d6-44b6-a393-bc47a9c1db7d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:20.023379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7402bdd-b5d6-44b6-a393-bc47a9c1db7d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:20.023644 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7402bdd-b5d6-44b6-a393-bc47a9c1db7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:20.024404 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7402bdd-b5d6-44b6-a393-bc47a9c1db7d None admin] RBAC: Adding query filter params (group.id=b40eec006bd247068fbf1b33da715d5b, role.id=617e0c2609e3413ea3273113659bccbc, scope.project.id=b4ee993851d3477d921a816e3f05a39d) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:20.024710 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7402bdd-b5d6-44b6-a393-bc47a9c1db7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:20.026114 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7402bdd-b5d6-44b6-a393-bc47a9c1db7d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:20.039118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 190/374] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Aug 9 06:56:19 2022] GET /identity/v3/role_assignments?group.id=b40eec006bd247068fbf1b33da715d5b&scope.project.id=b4ee993851d3477d921a816e3f05a39d&role.id=617e0c2609e3413ea3273113659bccbc => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:20.039118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7402bdd-b5d6-44b6-a393-bc47a9c1db7d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:20.100232 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:20.128177 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ae0b4-340f-4346-8abf-470c30bc9d74 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:20.168044 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7402bdd-b5d6-44b6-a393-bc47a9c1db7d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:20.185096 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215dd7a-d91a-4bad-9aea-334659a23651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:20.186467 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215dd7a-d91a-4bad-9aea-334659a23651 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:20.186961 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215dd7a-d91a-4bad-9aea-334659a23651 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:20.187633 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215dd7a-d91a-4bad-9aea-334659a23651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:20.188929 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215dd7a-d91a-4bad-9aea-334659a23651 None admin] RBAC: Adding query filter params (group.id=b40eec006bd247068fbf1b33da715d5b, role.id=decfb257a46442b8b4637f8c95c9967b, scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:20.189438 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215dd7a-d91a-4bad-9aea-334659a23651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:20.191098 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215dd7a-d91a-4bad-9aea-334659a23651 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:20.199406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 185/375] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Aug 9 06:56:19 2022] GET /identity/v3/role_assignments?group.id=b40eec006bd247068fbf1b33da715d5b&scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506&role.id=decfb257a46442b8b4637f8c95c9967b => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:20.201531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215dd7a-d91a-4bad-9aea-334659a23651 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:20.208509 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25680141-c50f-4cfb-90f4-d107fb159721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:20.209244 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25680141-c50f-4cfb-90f4-d107fb159721 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:20.209581 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25680141-c50f-4cfb-90f4-d107fb159721 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:20.209918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25680141-c50f-4cfb-90f4-d107fb159721 None admin] PATH_INFO: `/v3/groups/b40eec006bd247068fbf1b33da715d5b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:20.211242 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25680141-c50f-4cfb-90f4-d107fb159721 None admin] RBAC: Authorizing `identity:get_group(group_id=b40eec006bd247068fbf1b33da715d5b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:20.213471 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25680141-c50f-4cfb-90f4-d107fb159721 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:20.220583 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 191/376] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Aug 9 06:56:20 2022] GET /identity/v3/groups/b40eec006bd247068fbf1b33da715d5b => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:20.222092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25680141-c50f-4cfb-90f4-d107fb159721 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:20.237914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:20.344920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215dd7a-d91a-4bad-9aea-334659a23651 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:20.390031 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f2a42-beb2-4652-96f2-d09ac7223e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:20.390233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25680141-c50f-4cfb-90f4-d107fb159721 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:20.391948 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f2a42-beb2-4652-96f2-d09ac7223e98 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:20.393564 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f2a42-beb2-4652-96f2-d09ac7223e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:20.394095 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f2a42-beb2-4652-96f2-d09ac7223e98 None admin] PATH_INFO: `/v3/projects/7517e8deb7c2455e89af98b08782ec1d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:20.395634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f2a42-beb2-4652-96f2-d09ac7223e98 None admin] RBAC: Authorizing `identity:get_project(project_id=7517e8deb7c2455e89af98b08782ec1d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:20.397452 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f2a42-beb2-4652-96f2-d09ac7223e98 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:20.401002 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 186/377] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:20 2022] GET /identity/v3/projects/7517e8deb7c2455e89af98b08782ec1d => generated 344 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:20.403314 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf27694-d450-4bf8-8674-75f3f948851a None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:20.404014 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf27694-d450-4bf8-8674-75f3f948851a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:20.404505 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf27694-d450-4bf8-8674-75f3f948851a None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:20.406904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 187/378] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:20.407956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf27694-d450-4bf8-8674-75f3f948851a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:20.428097 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:20.445520 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb2b13-69f8-49ca-8c39-b9ad57924984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:20.446136 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb2b13-69f8-49ca-8c39-b9ad57924984 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:20.446414 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb2b13-69f8-49ca-8c39-b9ad57924984 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:20.446683 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb2b13-69f8-49ca-8c39-b9ad57924984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:20.447445 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb2b13-69f8-49ca-8c39-b9ad57924984 None admin] RBAC: Adding query filter params (group.id=b40eec006bd247068fbf1b33da715d5b, role.id=617e0c2609e3413ea3273113659bccbc, scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:20.448020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb2b13-69f8-49ca-8c39-b9ad57924984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:20.449470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb2b13-69f8-49ca-8c39-b9ad57924984 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:20.460498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 192/379] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Aug 9 06:56:20 2022] GET /identity/v3/role_assignments?group.id=b40eec006bd247068fbf1b33da715d5b&scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506&role.id=617e0c2609e3413ea3273113659bccbc => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:20.460498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd309081-7051-4ffb-94c2-d2af3a71b7f3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:20.460498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd309081-7051-4ffb-94c2-d2af3a71b7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:20.460498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd309081-7051-4ffb-94c2-d2af3a71b7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:20.486181 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fd309081-7051-4ffb-94c2-d2af3a71b7f3 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:20.488416 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fd309081-7051-4ffb-94c2-d2af3a71b7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:20.627790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf27694-d450-4bf8-8674-75f3f948851a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:20.629917 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:20.639403 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 193/380] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:20.664150 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd309081-7051-4ffb-94c2-d2af3a71b7f3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:20.677949 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f780fe-94dc-4f87-a7e2-68bd402347f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:20.678701 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f780fe-94dc-4f87-a7e2-68bd402347f7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:20.678973 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f780fe-94dc-4f87-a7e2-68bd402347f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:20.679284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f780fe-94dc-4f87-a7e2-68bd402347f7 None admin] PATH_INFO: `/v3/groups/f7c4e63760f04663aab17ca6e2ba2ebb` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:20.686300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f780fe-94dc-4f87-a7e2-68bd402347f7 None admin] RBAC: Authorizing `identity:get_group(group_id=f7c4e63760f04663aab17ca6e2ba2ebb)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:20.687915 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f780fe-94dc-4f87-a7e2-68bd402347f7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:20.694385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 188/381] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Aug 9 06:56:20 2022] GET /identity/v3/groups/f7c4e63760f04663aab17ca6e2ba2ebb => generated 229 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:20.695802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f780fe-94dc-4f87-a7e2-68bd402347f7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:20.778247 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd309081-7051-4ffb-94c2-d2af3a71b7f3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:20.794951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:20.833935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d14a8-4558-476b-b771-3ec55cddf0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:20.834641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d14a8-4558-476b-b771-3ec55cddf0da None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:20.834946 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d14a8-4558-476b-b771-3ec55cddf0da None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:20.835243 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d14a8-4558-476b-b771-3ec55cddf0da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:20.848279 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f780fe-94dc-4f87-a7e2-68bd402347f7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:20.860709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d14a8-4558-476b-b771-3ec55cddf0da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:20.865476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1f1d14a8-4558-476b-b771-3ec55cddf0da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:20.865476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:20.865476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:20.865476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:20.865476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:20.865476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:20.865476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:20.865476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:20.865476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:20.865476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:20.865476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:20.865476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:20.865476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:20.865476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:20.865476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:20.865476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:20.866425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:20.866425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:20.866425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:20.866425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:20.866425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:20.866425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:20.866425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:20.866425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:20.866425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:20.866425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:20.866425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:20.866425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:20.866425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:20.866425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:20.866425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:20.866425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:20.867335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:20.867335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:20.867335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:20.867335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:20.867335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:20.867335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:20.867335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:20.867335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:20.867335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:20.867335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:20.867335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:20.867335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:20.867335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 194/382] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:56:20.874954 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d14a8-4558-476b-b771-3ec55cddf0da None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:20.926186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb4747-a36f-4899-9524-345e1e074fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:20.926711 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb4747-a36f-4899-9524-345e1e074fba None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:20.926985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb4747-a36f-4899-9524-345e1e074fba None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:20.927275 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb4747-a36f-4899-9524-345e1e074fba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:20.931463 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb4747-a36f-4899-9524-345e1e074fba None admin] RBAC: Adding query filter params (group.id=f7c4e63760f04663aab17ca6e2ba2ebb, role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.project.id=7517e8deb7c2455e89af98b08782ec1d) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:20.931774 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb4747-a36f-4899-9524-345e1e074fba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:20.933205 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb4747-a36f-4899-9524-345e1e074fba None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:20.955228 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 189/383] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Aug 9 06:56:20 2022] GET /identity/v3/role_assignments?group.id=f7c4e63760f04663aab17ca6e2ba2ebb&scope.project.id=7517e8deb7c2455e89af98b08782ec1d&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 260 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:20.983126 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:21.045580 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d14a8-4558-476b-b771-3ec55cddf0da None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:21.096698 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e911b-2769-4779-9d33-a2fc7b80adf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:21.097717 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e911b-2769-4779-9d33-a2fc7b80adf0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:21.098195 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e911b-2769-4779-9d33-a2fc7b80adf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:21.098680 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e911b-2769-4779-9d33-a2fc7b80adf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:21.099594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e911b-2769-4779-9d33-a2fc7b80adf0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:21.100102 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e911b-2769-4779-9d33-a2fc7b80adf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:21.101693 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e911b-2769-4779-9d33-a2fc7b80adf0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:21.115305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 195/384] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:56:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:21.121350 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb4747-a36f-4899-9524-345e1e074fba None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:21.237888 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb4747-a36f-4899-9524-345e1e074fba None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:21.285553 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe54052-9bca-44d0-b027-b3e216525268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:21.286190 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe54052-9bca-44d0-b027-b3e216525268 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:21.286467 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe54052-9bca-44d0-b027-b3e216525268 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:21.286737 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe54052-9bca-44d0-b027-b3e216525268 None admin] PATH_INFO: `/v3/groups/b40eec006bd247068fbf1b33da715d5b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:21.287880 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe54052-9bca-44d0-b027-b3e216525268 None admin] RBAC: Authorizing `identity:get_group(group_id=b40eec006bd247068fbf1b33da715d5b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:21.289304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe54052-9bca-44d0-b027-b3e216525268 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:21.291191 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 190/385] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Aug 9 06:56:21 2022] GET /identity/v3/groups/b40eec006bd247068fbf1b33da715d5b => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:21.296751 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e911b-2769-4779-9d33-a2fc7b80adf0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:21.459116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e911b-2769-4779-9d33-a2fc7b80adf0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:21.492830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:21.510678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59771f8-f213-4bbf-b5f1-a7a7eacb6a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:21.511340 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59771f8-f213-4bbf-b5f1-a7a7eacb6a94 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:21.511620 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59771f8-f213-4bbf-b5f1-a7a7eacb6a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:21.511891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59771f8-f213-4bbf-b5f1-a7a7eacb6a94 None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:21.514012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59771f8-f213-4bbf-b5f1-a7a7eacb6a94 None admin] RBAC: Authorizing `identity:get_project(project_id=b4ee993851d3477d921a816e3f05a39d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:21.515466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59771f8-f213-4bbf-b5f1-a7a7eacb6a94 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:21.517309 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 196/386] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:21 2022] GET /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:21.522881 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe54052-9bca-44d0-b027-b3e216525268 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:21.545404 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:21.689172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe54052-9bca-44d0-b027-b3e216525268 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:21.732100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb2144-2080-42c5-b73d-539c10aa2e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:21.732830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb2144-2080-42c5-b73d-539c10aa2e78 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:21.733110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb2144-2080-42c5-b73d-539c10aa2e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:21.733379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb2144-2080-42c5-b73d-539c10aa2e78 None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d/groups/b40eec006bd247068fbf1b33da715d5b/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:21.740492 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb2144-2080-42c5-b73d-539c10aa2e78 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4ee993851d3477d921a816e3f05a39d, group_id=b40eec006bd247068fbf1b33da715d5b, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:21.741904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb2144-2080-42c5-b73d-539c10aa2e78 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:21.765799 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 191/387] 10.222.0.40 () {58 vars in 1442 bytes} [Tue Aug 9 06:56:21 2022] PUT /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d/groups/b40eec006bd247068fbf1b33da715d5b/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:56:22.487748 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bcfe7-5b73-4710-9936-e93adf6befdb None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:22.488788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bcfe7-5b73-4710-9936-e93adf6befdb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:22.489269 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bcfe7-5b73-4710-9936-e93adf6befdb None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:22.490813 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 197/388] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:22.498689 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfbcd3-b53d-45db-982d-839a6b73e0b7 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:22.498992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfbcd3-b53d-45db-982d-839a6b73e0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:22.499383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfbcd3-b53d-45db-982d-839a6b73e0b7 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:22.502060 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281afb9-5a31-4e1c-8cf1-9127036f084a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:22.502342 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281afb9-5a31-4e1c-8cf1-9127036f084a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:22.502613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281afb9-5a31-4e1c-8cf1-9127036f084a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:22.502946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 192/389] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:22.516086 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52963d7c-ccc4-4c86-8769-9ba7850e2e72 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:22.516368 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52963d7c-ccc4-4c86-8769-9ba7850e2e72 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:22.516641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52963d7c-ccc4-4c86-8769-9ba7850e2e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:22.540710 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1281afb9-5a31-4e1c-8cf1-9127036f084a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:22.541873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1281afb9-5a31-4e1c-8cf1-9127036f084a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:22.548324 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-52963d7c-ccc4-4c86-8769-9ba7850e2e72 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:22.549468 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-52963d7c-ccc4-4c86-8769-9ba7850e2e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:22.664899 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 198/390] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:56:22.674785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:22.686487 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 193/391] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:22.698547 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281afb9-5a31-4e1c-8cf1-9127036f084a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:22.715491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52963d7c-ccc4-4c86-8769-9ba7850e2e72 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:22.880428 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281afb9-5a31-4e1c-8cf1-9127036f084a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:22.890372 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52963d7c-ccc4-4c86-8769-9ba7850e2e72 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:22.920634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:22.928385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265378e4-1563-4c7c-bb73-267069e07470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:22.929021 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265378e4-1563-4c7c-bb73-267069e07470 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:22.929298 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265378e4-1563-4c7c-bb73-267069e07470 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:22.929565 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265378e4-1563-4c7c-bb73-267069e07470 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:22.941852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265378e4-1563-4c7c-bb73-267069e07470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:22.946864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-265378e4-1563-4c7c-bb73-267069e07470 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:22.946864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:22.946864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:22.946864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:22.946864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:22.946864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:22.946864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:22.946864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:22.946864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:22.946864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:22.946864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:22.946864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:22.946864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:22.946864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:22.946864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:22.946864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:22.947829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:22.947829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:22.947829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:22.947829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:22.947829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:22.947829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:22.947829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:22.947829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:22.947829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:22.947829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:22.947829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:22.947829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:22.947829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:22.947829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:22.947829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:22.947829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:22.948640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:22.948640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:22.948640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:22.948640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:22.948640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:22.948640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:22.948640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:22.948640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:22.948640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:22.948640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:22.948640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:22.948640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:22.953191 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 194/392] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:22.954415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72779d21-9a37-4a8d-a6e0-39421d3bc472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:22.954984 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265378e4-1563-4c7c-bb73-267069e07470 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:22.955357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72779d21-9a37-4a8d-a6e0-39421d3bc472 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:22.955656 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72779d21-9a37-4a8d-a6e0-39421d3bc472 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:22.955913 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72779d21-9a37-4a8d-a6e0-39421d3bc472 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:22.977666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72779d21-9a37-4a8d-a6e0-39421d3bc472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:22.982491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-72779d21-9a37-4a8d-a6e0-39421d3bc472 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:56:22.982491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:22.982491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:22.982491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:22.982491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:22.982491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:22.982491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:22.982491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:22.982491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:22.982491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:22.982491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:22.982491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:22.982491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:22.982491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:22.982491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:22.982491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:22.983595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:22.983595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:22.983595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:22.983595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:22.983595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:22.983595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:22.983595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:22.983595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:22.983595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:22.983595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:22.983595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:22.983595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:22.983595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:22.983595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:22.983595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:22.983595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:22.984641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:22.984641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:22.984641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:22.984641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:22.984641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:22.984641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:22.984641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:22.984641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:22.984641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:22.984641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:22.984641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:56:22.984641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:22.996483 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 199/393] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:56:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:23.002444 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72779d21-9a37-4a8d-a6e0-39421d3bc472 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:23.022369 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:23.067589 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265378e4-1563-4c7c-bb73-267069e07470 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:23.107279 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3464a6-293b-49e5-810b-e49062ac3122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:23.108163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3464a6-293b-49e5-810b-e49062ac3122 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:23.108578 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3464a6-293b-49e5-810b-e49062ac3122 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:23.109086 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3464a6-293b-49e5-810b-e49062ac3122 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:23.109980 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3464a6-293b-49e5-810b-e49062ac3122 None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:23.110425 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3464a6-293b-49e5-810b-e49062ac3122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:23.112031 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3464a6-293b-49e5-810b-e49062ac3122 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:23.125846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 195/394] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:56:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:23.127446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3464a6-293b-49e5-810b-e49062ac3122 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:23.173599 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72779d21-9a37-4a8d-a6e0-39421d3bc472 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:23.237674 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3464a6-293b-49e5-810b-e49062ac3122 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:23.239819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9905fe-9fb9-49ea-a449-5a019bbb67d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:23.241108 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9905fe-9fb9-49ea-a449-5a019bbb67d5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:23.241108 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9905fe-9fb9-49ea-a449-5a019bbb67d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:23.241108 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9905fe-9fb9-49ea-a449-5a019bbb67d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:23.241639 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9905fe-9fb9-49ea-a449-5a019bbb67d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:23.241942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9905fe-9fb9-49ea-a449-5a019bbb67d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:23.243359 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9905fe-9fb9-49ea-a449-5a019bbb67d5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:23.253135 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 200/395] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:23.258942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9905fe-9fb9-49ea-a449-5a019bbb67d5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:23.261538 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:23.279218 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f654f6-7da3-4f51-8f37-39f61749d2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:23.280031 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f654f6-7da3-4f51-8f37-39f61749d2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:23.280307 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f654f6-7da3-4f51-8f37-39f61749d2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:23.280577 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f654f6-7da3-4f51-8f37-39f61749d2b9 None admin] PATH_INFO: `/v3/groups/b40eec006bd247068fbf1b33da715d5b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:23.281763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f654f6-7da3-4f51-8f37-39f61749d2b9 None admin] RBAC: Authorizing `identity:get_group(group_id=b40eec006bd247068fbf1b33da715d5b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:23.283521 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f654f6-7da3-4f51-8f37-39f61749d2b9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:23.289874 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 196/396] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Aug 9 06:56:23 2022] GET /identity/v3/groups/b40eec006bd247068fbf1b33da715d5b => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:23.291158 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfaa79-f43f-47a7-8336-92f6f18daf7f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:23.291483 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfaa79-f43f-47a7-8336-92f6f18daf7f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:23.291757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfaa79-f43f-47a7-8336-92f6f18daf7f None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:23.293474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 197/397] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:23.298631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfaa79-f43f-47a7-8336-92f6f18daf7f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:23.313362 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:23.394715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9905fe-9fb9-49ea-a449-5a019bbb67d5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:23.412677 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfaa79-f43f-47a7-8336-92f6f18daf7f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:23.441131 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2c9b1-74c0-4921-9235-005d58967729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:23.441679 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2c9b1-74c0-4921-9235-005d58967729 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:23.441950 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2c9b1-74c0-4921-9235-005d58967729 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:23.442215 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2c9b1-74c0-4921-9235-005d58967729 None admin] PATH_INFO: `/v3/groups/b40eec006bd247068fbf1b33da715d5b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:23.443321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2c9b1-74c0-4921-9235-005d58967729 None admin] RBAC: Authorizing `identity:get_group(group_id=b40eec006bd247068fbf1b33da715d5b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:23.444747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2c9b1-74c0-4921-9235-005d58967729 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:23.446280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 201/398] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Aug 9 06:56:23 2022] GET /identity/v3/groups/b40eec006bd247068fbf1b33da715d5b => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:23.447526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f148ae-186b-416c-87be-64d27f10ba80 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:23.447802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f148ae-186b-416c-87be-64d27f10ba80 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:23.448067 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f148ae-186b-416c-87be-64d27f10ba80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:23.453378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5f4fc-156c-408a-ab48-b4634797d2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:23.454250 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5f4fc-156c-408a-ab48-b4634797d2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:23.455035 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5f4fc-156c-408a-ab48-b4634797d2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:23.455599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5f4fc-156c-408a-ab48-b4634797d2c3 None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:23.456725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5f4fc-156c-408a-ab48-b4634797d2c3 None admin] RBAC: Authorizing `identity:get_project(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:23.458133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5f4fc-156c-408a-ab48-b4634797d2c3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:23.463516 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 198/399] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:23 2022] GET /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:23.463516 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c856b-2182-4ba5-bd9f-6122df56d12e None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:23.463516 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c856b-2182-4ba5-bd9f-6122df56d12e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:23.463516 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c856b-2182-4ba5-bd9f-6122df56d12e None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:23.463516 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 199/400] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:23.464174 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c856b-2182-4ba5-bd9f-6122df56d12e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:23.469832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-42f148ae-186b-416c-87be-64d27f10ba80 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:23.471315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-42f148ae-186b-416c-87be-64d27f10ba80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:23.525822 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:23.563105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 202/401] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:23.563105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a726b2-6e33-4d9b-84b7-4a69444e4400 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:23.563105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a726b2-6e33-4d9b-84b7-4a69444e4400 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:23.563105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a726b2-6e33-4d9b-84b7-4a69444e4400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:23.571745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c856b-2182-4ba5-bd9f-6122df56d12e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:23.581602 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f9a726b2-6e33-4d9b-84b7-4a69444e4400 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:23.583494 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f9a726b2-6e33-4d9b-84b7-4a69444e4400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:23.609181 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151918f-e34a-48e7-b75b-062cc08dc41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:23.609810 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151918f-e34a-48e7-b75b-062cc08dc41f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:23.610092 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151918f-e34a-48e7-b75b-062cc08dc41f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:23.610363 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151918f-e34a-48e7-b75b-062cc08dc41f None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:23.611567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151918f-e34a-48e7-b75b-062cc08dc41f None admin] RBAC: Authorizing `identity:get_project(project_id=b4ee993851d3477d921a816e3f05a39d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:23.612976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151918f-e34a-48e7-b75b-062cc08dc41f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:23.622552 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 200/402] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:23 2022] GET /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:23.622552 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151918f-e34a-48e7-b75b-062cc08dc41f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:23.622909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:23.663643 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 203/403] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:23.672407 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a726b2-6e33-4d9b-84b7-4a69444e4400 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:23.732341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151918f-e34a-48e7-b75b-062cc08dc41f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:23.757937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:23.771039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c535903-9454-4b89-9961-a70aaffba029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:23.771717 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c535903-9454-4b89-9961-a70aaffba029 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:23.771992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c535903-9454-4b89-9961-a70aaffba029 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:23.772259 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c535903-9454-4b89-9961-a70aaffba029 None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506/groups/b40eec006bd247068fbf1b33da715d5b/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:23.774185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c535903-9454-4b89-9961-a70aaffba029 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506, group_id=b40eec006bd247068fbf1b33da715d5b, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:23.775641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c535903-9454-4b89-9961-a70aaffba029 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:23.779073 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a726b2-6e33-4d9b-84b7-4a69444e4400 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:23.789583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 201/404] 10.222.0.40 () {58 vars in 1442 bytes} [Tue Aug 9 06:56:23 2022] PUT /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506/groups/b40eec006bd247068fbf1b33da715d5b/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:56:23.790749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c535903-9454-4b89-9961-a70aaffba029 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:23.829531 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fc8a5-dd75-4c10-9940-6cceeda21157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:23.830961 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fc8a5-dd75-4c10-9940-6cceeda21157 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:23.831545 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fc8a5-dd75-4c10-9940-6cceeda21157 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:23.832026 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fc8a5-dd75-4c10-9940-6cceeda21157 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:23.844433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fc8a5-dd75-4c10-9940-6cceeda21157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:23.849721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-0d4fc8a5-dd75-4c10-9940-6cceeda21157 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:56:23.849721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:23.849721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:23.849721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:23.849721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:23.849721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:23.849721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:23.849721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:23.849721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:23.849721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:23.849721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:23.849721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:23.849721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:23.849721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:23.849721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:23.849721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:23.850890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:23.850890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:23.850890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:23.850890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:23.850890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:23.850890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:23.850890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:23.850890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:23.850890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:23.850890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:23.850890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:23.850890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:23.850890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:23.850890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:23.850890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:23.850890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:23.851798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:23.851798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:23.851798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:23.851798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:23.851798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:23.851798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:23.851798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:23.851798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:23.851798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:23.851798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:23.851798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:56:23.851798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:23.854080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 204/405] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:56:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:23.860756 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fc8a5-dd75-4c10-9940-6cceeda21157 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:23.896743 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:23.934258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c535903-9454-4b89-9961-a70aaffba029 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:23.975781 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ccf21-1e41-4e84-921f-c2d18f8bddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:23.977629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ccf21-1e41-4e84-921f-c2d18f8bddcc None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:23.977629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ccf21-1e41-4e84-921f-c2d18f8bddcc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:23.977802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ccf21-1e41-4e84-921f-c2d18f8bddcc None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d/groups/b40eec006bd247068fbf1b33da715d5b/roles/617e0c2609e3413ea3273113659bccbc` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:23.980584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ccf21-1e41-4e84-921f-c2d18f8bddcc None admin] RBAC: Authorizing `identity:create_grant(project_id=b4ee993851d3477d921a816e3f05a39d, group_id=b40eec006bd247068fbf1b33da715d5b, role_id=617e0c2609e3413ea3273113659bccbc)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:23.983012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ccf21-1e41-4e84-921f-c2d18f8bddcc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:23.992773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fc8a5-dd75-4c10-9940-6cceeda21157 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:24.000702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 202/406] 10.222.0.40 () {58 vars in 1442 bytes} [Tue Aug 9 06:56:23 2022] PUT /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d/groups/b40eec006bd247068fbf1b33da715d5b/roles/617e0c2609e3413ea3273113659bccbc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:56:24.001557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ccf21-1e41-4e84-921f-c2d18f8bddcc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:24.076538 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052f3bb-26c1-42e9-a095-994cf7ac1583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:24.078499 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052f3bb-26c1-42e9-a095-994cf7ac1583 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:24.078845 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052f3bb-26c1-42e9-a095-994cf7ac1583 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:24.079142 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052f3bb-26c1-42e9-a095-994cf7ac1583 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:24.110031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052f3bb-26c1-42e9-a095-994cf7ac1583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:24.119503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:24.120390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7052f3bb-26c1-42e9-a095-994cf7ac1583 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:56:24.120390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:24.120390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:24.120390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:24.120390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:24.120390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:24.120390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:24.120390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:24.120390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:24.120390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:24.120390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:24.120390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:24.120390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:24.120390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:24.120390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:24.120390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:24.121286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:24.121286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:24.121286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:24.121286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:24.121286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:24.121286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:24.121286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:24.121286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:24.121286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:24.121286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:24.121286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:24.121286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:24.121286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:24.121286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:24.121286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:24.121286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:24.122284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:24.122284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:24.122284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:24.122284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:24.122284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:24.122284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:24.122284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:24.122284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:24.122284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:24.122284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:24.122284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:56:24.122284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:24.122284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 205/407] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:56:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:24.128933 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052f3bb-26c1-42e9-a095-994cf7ac1583 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:24.211025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ccf21-1e41-4e84-921f-c2d18f8bddcc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:24.237151 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:24.248380 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa5ab0-2c7f-4236-9377-2b3363f28801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:24.248594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052f3bb-26c1-42e9-a095-994cf7ac1583 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:24.249505 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa5ab0-2c7f-4236-9377-2b3363f28801 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:24.249983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa5ab0-2c7f-4236-9377-2b3363f28801 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:24.250476 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa5ab0-2c7f-4236-9377-2b3363f28801 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:24.251424 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa5ab0-2c7f-4236-9377-2b3363f28801 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:24.251962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa5ab0-2c7f-4236-9377-2b3363f28801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:24.253534 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa5ab0-2c7f-4236-9377-2b3363f28801 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:24.263777 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 203/408] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:24.265392 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a0ce2-e5e9-4b76-b90b-99be18b44cb1 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:24.265879 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a0ce2-e5e9-4b76-b90b-99be18b44cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:24.266364 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a0ce2-e5e9-4b76-b90b-99be18b44cb1 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:24.267828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 204/409] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:24.275112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a0ce2-e5e9-4b76-b90b-99be18b44cb1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:24.294116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6796b62-6a1b-4dfc-8250-7b40541b3306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:24.294737 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6796b62-6a1b-4dfc-8250-7b40541b3306 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:24.295018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6796b62-6a1b-4dfc-8250-7b40541b3306 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:24.295323 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6796b62-6a1b-4dfc-8250-7b40541b3306 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:24.296007 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6796b62-6a1b-4dfc-8250-7b40541b3306 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:24.296767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6796b62-6a1b-4dfc-8250-7b40541b3306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:24.298449 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6796b62-6a1b-4dfc-8250-7b40541b3306 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:24.310157 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 206/410] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:24.316779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935bdb9-cc8a-4138-80cf-75f5ca44e8db None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:24.317065 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935bdb9-cc8a-4138-80cf-75f5ca44e8db None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:24.317343 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935bdb9-cc8a-4138-80cf-75f5ca44e8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:24.338077 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9935bdb9-cc8a-4138-80cf-75f5ca44e8db None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:24.339746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9935bdb9-cc8a-4138-80cf-75f5ca44e8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:24.385626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a0ce2-e5e9-4b76-b90b-99be18b44cb1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:24.393462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:24.425630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f43ee-7cbb-4c29-9c32-126e480f02dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:24.426263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f43ee-7cbb-4c29-9c32-126e480f02dc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:24.426540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f43ee-7cbb-4c29-9c32-126e480f02dc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:24.426810 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f43ee-7cbb-4c29-9c32-126e480f02dc None admin] PATH_INFO: `/v3/groups/b40eec006bd247068fbf1b33da715d5b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:24.427208 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 207/411] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:24.428112 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935bdb9-cc8a-4138-80cf-75f5ca44e8db None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:24.437884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f43ee-7cbb-4c29-9c32-126e480f02dc None admin] RBAC: Authorizing `identity:get_group(group_id=b40eec006bd247068fbf1b33da715d5b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:24.439463 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f43ee-7cbb-4c29-9c32-126e480f02dc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:24.441749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 205/412] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Aug 9 06:56:24 2022] GET /identity/v3/groups/b40eec006bd247068fbf1b33da715d5b => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:24.447206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f43ee-7cbb-4c29-9c32-126e480f02dc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:24.532604 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:24.555271 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935bdb9-cc8a-4138-80cf-75f5ca44e8db None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:24.567887 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f43ee-7cbb-4c29-9c32-126e480f02dc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:24.604216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51988d9-a40d-450f-8e46-95ed50b4dfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:24.604864 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51988d9-a40d-450f-8e46-95ed50b4dfd7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:24.605139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51988d9-a40d-450f-8e46-95ed50b4dfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:24.605467 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51988d9-a40d-450f-8e46-95ed50b4dfd7 None admin] PATH_INFO: `/v3/groups/f7c4e63760f04663aab17ca6e2ba2ebb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:24.607169 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51988d9-a40d-450f-8e46-95ed50b4dfd7 None admin] RBAC: Authorizing `identity:get_group(group_id=f7c4e63760f04663aab17ca6e2ba2ebb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:24.608609 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51988d9-a40d-450f-8e46-95ed50b4dfd7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:24.609050 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf9829-11b7-41f6-a0fa-29a6f0fd496a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:24.609760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf9829-11b7-41f6-a0fa-29a6f0fd496a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:24.610110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf9829-11b7-41f6-a0fa-29a6f0fd496a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:24.610287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 208/413] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Aug 9 06:56:24 2022] GET /identity/v3/groups/f7c4e63760f04663aab17ca6e2ba2ebb => generated 229 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:24.610520 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf9829-11b7-41f6-a0fa-29a6f0fd496a None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:24.610935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51988d9-a40d-450f-8e46-95ed50b4dfd7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:24.611901 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf9829-11b7-41f6-a0fa-29a6f0fd496a None admin] RBAC: Authorizing `identity:get_project(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:24.619539 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf9829-11b7-41f6-a0fa-29a6f0fd496a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:24.626520 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 206/414] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:24 2022] GET /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:24.626520 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf9829-11b7-41f6-a0fa-29a6f0fd496a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:24.679588 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:24.733537 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51988d9-a40d-450f-8e46-95ed50b4dfd7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:24.743569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf9829-11b7-41f6-a0fa-29a6f0fd496a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:24.774607 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2e665-e904-4f73-ac51-970a515d6046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:24.775599 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2e665-e904-4f73-ac51-970a515d6046 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:24.776081 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2e665-e904-4f73-ac51-970a515d6046 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:24.776531 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2e665-e904-4f73-ac51-970a515d6046 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:24.781164 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824ea0f-a10e-4584-9179-07b890939736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:24.781795 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824ea0f-a10e-4584-9179-07b890939736 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:24.782077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824ea0f-a10e-4584-9179-07b890939736 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:24.782357 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824ea0f-a10e-4584-9179-07b890939736 None admin] PATH_INFO: `/v3/projects/7517e8deb7c2455e89af98b08782ec1d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:24.783571 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824ea0f-a10e-4584-9179-07b890939736 None admin] RBAC: Authorizing `identity:get_project(project_id=7517e8deb7c2455e89af98b08782ec1d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:24.784925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824ea0f-a10e-4584-9179-07b890939736 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:24.787079 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 207/415] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:24 2022] GET /identity/v3/projects/7517e8deb7c2455e89af98b08782ec1d => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:24.787932 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824ea0f-a10e-4584-9179-07b890939736 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:24.789702 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2e665-e904-4f73-ac51-970a515d6046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:24.795139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-50a2e665-e904-4f73-ac51-970a515d6046 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:24.795139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:24.795139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:24.795139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:24.795139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:24.795139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:24.795139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:24.795139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:24.795139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:24.795139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:24.795139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:24.795139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:24.795139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:24.795139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:24.795139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:24.795139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:24.796031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:24.796031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:24.796031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:24.796031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:24.796031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:24.796031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:24.796031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:24.796031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:24.796031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:24.796031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:24.796031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:24.796031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:24.796031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:24.796031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:24.796031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:24.796031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:24.796837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:24.796837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:24.796837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:24.796837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:24.796837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:24.796837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:24.796837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:24.796837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:24.796837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:24.796837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:24.796837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:24.796837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:24.799413 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 209/416] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:24.800332 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2e665-e904-4f73-ac51-970a515d6046 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:24.813299 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:24.903042 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2e665-e904-4f73-ac51-970a515d6046 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:24.906975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824ea0f-a10e-4584-9179-07b890939736 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:24.918197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:24.938907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d19250-3683-4ef9-960e-547839af3fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:24.939884 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d19250-3683-4ef9-960e-547839af3fd5 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:24.940349 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d19250-3683-4ef9-960e-547839af3fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:24.940798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d19250-3683-4ef9-960e-547839af3fd5 None admin] PATH_INFO: `/v3/projects/7517e8deb7c2455e89af98b08782ec1d/groups/f7c4e63760f04663aab17ca6e2ba2ebb/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:24.943017 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d19250-3683-4ef9-960e-547839af3fd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7517e8deb7c2455e89af98b08782ec1d, group_id=f7c4e63760f04663aab17ca6e2ba2ebb, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:24.944980 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d19250-3683-4ef9-960e-547839af3fd5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:24.945810 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f982750-b41e-4f45-a525-f066c46c818b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:24.946539 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f982750-b41e-4f45-a525-f066c46c818b None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:24.946893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f982750-b41e-4f45-a525-f066c46c818b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:24.947269 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f982750-b41e-4f45-a525-f066c46c818b None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506/groups/b40eec006bd247068fbf1b33da715d5b/roles/617e0c2609e3413ea3273113659bccbc` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:24.950044 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f982750-b41e-4f45-a525-f066c46c818b None admin] RBAC: Authorizing `identity:create_grant(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506, group_id=b40eec006bd247068fbf1b33da715d5b, role_id=617e0c2609e3413ea3273113659bccbc)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:24.951885 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f982750-b41e-4f45-a525-f066c46c818b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:24.961645 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 210/417] 10.222.0.40 () {58 vars in 1442 bytes} [Tue Aug 9 06:56:24 2022] PUT /identity/v3/projects/7517e8deb7c2455e89af98b08782ec1d/groups/f7c4e63760f04663aab17ca6e2ba2ebb/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:56:24.962685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d19250-3683-4ef9-960e-547839af3fd5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:24.967395 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 208/418] 10.222.0.40 () {58 vars in 1442 bytes} [Tue Aug 9 06:56:24 2022] PUT /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506/groups/b40eec006bd247068fbf1b33da715d5b/roles/617e0c2609e3413ea3273113659bccbc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:56:25.056269 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:25.105538 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d19250-3683-4ef9-960e-547839af3fd5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:25.157282 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912dc1d-ae2f-40e9-a1dc-3e9c1a60eeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:25.157966 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912dc1d-ae2f-40e9-a1dc-3e9c1a60eeb1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:25.158248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912dc1d-ae2f-40e9-a1dc-3e9c1a60eeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:25.158574 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912dc1d-ae2f-40e9-a1dc-3e9c1a60eeb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:25.159720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912dc1d-ae2f-40e9-a1dc-3e9c1a60eeb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:25.160036 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912dc1d-ae2f-40e9-a1dc-3e9c1a60eeb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:25.162040 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912dc1d-ae2f-40e9-a1dc-3e9c1a60eeb1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:25.171974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 211/419] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:56:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:25.178207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f982750-b41e-4f45-a525-f066c46c818b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:25.312173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f982750-b41e-4f45-a525-f066c46c818b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:25.361896 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c5139-11df-4d01-9df3-859efc1377ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:25.362514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c5139-11df-4d01-9df3-859efc1377ab None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:25.362796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c5139-11df-4d01-9df3-859efc1377ab None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:25.363072 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c5139-11df-4d01-9df3-859efc1377ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:25.420185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:25.461120 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c5139-11df-4d01-9df3-859efc1377ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:25.462586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c5139-11df-4d01-9df3-859efc1377ab None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:25.611072 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 209/420] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:25.618863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912dc1d-ae2f-40e9-a1dc-3e9c1a60eeb1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:25.791168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912dc1d-ae2f-40e9-a1dc-3e9c1a60eeb1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:25.834541 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:25.843794 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7bc9a-00e9-4cdf-ba12-8578f14179ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:25.844443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7bc9a-00e9-4cdf-ba12-8578f14179ce None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:25.844726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7bc9a-00e9-4cdf-ba12-8578f14179ce None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:25.845004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7bc9a-00e9-4cdf-ba12-8578f14179ce None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:25.846160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7bc9a-00e9-4cdf-ba12-8578f14179ce None admin] RBAC: Authorizing `identity:get_project(project_id=b4ee993851d3477d921a816e3f05a39d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:25.847653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7bc9a-00e9-4cdf-ba12-8578f14179ce None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:25.849606 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 212/421] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:25 2022] GET /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:25.855285 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c5139-11df-4d01-9df3-859efc1377ab None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:25.940731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:25.974614 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c5139-11df-4d01-9df3-859efc1377ab None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:26.023835 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1b726-0874-4770-b86d-d4c7cfc3c72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:26.024475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1b726-0874-4770-b86d-d4c7cfc3c72f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:26.024755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1b726-0874-4770-b86d-d4c7cfc3c72f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:26.025027 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1b726-0874-4770-b86d-d4c7cfc3c72f None admin] PATH_INFO: `/v3/groups/b40eec006bd247068fbf1b33da715d5b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:26.031837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1b726-0874-4770-b86d-d4c7cfc3c72f None admin] RBAC: Authorizing `identity:get_group(group_id=b40eec006bd247068fbf1b33da715d5b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:26.033282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1b726-0874-4770-b86d-d4c7cfc3c72f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:26.035129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 210/422] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Aug 9 06:56:25 2022] GET /identity/v3/groups/b40eec006bd247068fbf1b33da715d5b => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:26.041202 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7bc9a-00e9-4cdf-ba12-8578f14179ce None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:26.167133 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7bc9a-00e9-4cdf-ba12-8578f14179ce None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:26.218262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48582b19-3343-4574-9eaa-45ab9021bbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:26.218885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48582b19-3343-4574-9eaa-45ab9021bbc3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:26.219191 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48582b19-3343-4574-9eaa-45ab9021bbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:26.219465 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48582b19-3343-4574-9eaa-45ab9021bbc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:26.220195 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48582b19-3343-4574-9eaa-45ab9021bbc3 None admin] RBAC: Adding query filter params (group.id=b40eec006bd247068fbf1b33da715d5b, role.id=decfb257a46442b8b4637f8c95c9967b, scope.project.id=b4ee993851d3477d921a816e3f05a39d) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:26.220503 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48582b19-3343-4574-9eaa-45ab9021bbc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:26.221931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48582b19-3343-4574-9eaa-45ab9021bbc3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:26.233091 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 213/423] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Aug 9 06:56:26 2022] GET /identity/v3/role_assignments?group.id=b40eec006bd247068fbf1b33da715d5b&scope.project.id=b4ee993851d3477d921a816e3f05a39d&role.id=decfb257a46442b8b4637f8c95c9967b => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:26.351577 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f0414-18ff-4674-aa94-fa203c0c3a32 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:26.351942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f0414-18ff-4674-aa94-fa203c0c3a32 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:26.352130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f0414-18ff-4674-aa94-fa203c0c3a32 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:26.353728 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 211/424] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:26.359486 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde7453-85af-42b8-8124-b1a0a48da44d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:26.359768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde7453-85af-42b8-8124-b1a0a48da44d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:26.360046 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde7453-85af-42b8-8124-b1a0a48da44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:26.388925 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8fde7453-85af-42b8-8124-b1a0a48da44d None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:26.390248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8fde7453-85af-42b8-8124-b1a0a48da44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:26.391685 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcd37c-7185-457a-9f33-0fa0c376771d None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:26.391972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcd37c-7185-457a-9f33-0fa0c376771d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:26.392250 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcd37c-7185-457a-9f33-0fa0c376771d None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:26.393983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 212/425] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:26.399415 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794befa1-f5fd-40d2-a155-3559ade67f08 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:26.399703 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794befa1-f5fd-40d2-a155-3559ade67f08 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:26.399982 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794befa1-f5fd-40d2-a155-3559ade67f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:26.419720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-794befa1-f5fd-40d2-a155-3559ade67f08 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:26.421120 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-794befa1-f5fd-40d2-a155-3559ade67f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:26.496132 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:26.502664 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 214/426] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:26.530674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde7453-85af-42b8-8124-b1a0a48da44d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:26.546199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 213/427] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:56:26.581631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794befa1-f5fd-40d2-a155-3559ade67f08 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:26.652046 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde7453-85af-42b8-8124-b1a0a48da44d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:26.687014 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:26.699042 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26631a46-8448-4973-aad7-3dc7c13915d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:26.700237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26631a46-8448-4973-aad7-3dc7c13915d0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:26.700581 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26631a46-8448-4973-aad7-3dc7c13915d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:26.700912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26631a46-8448-4973-aad7-3dc7c13915d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:26.717028 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26631a46-8448-4973-aad7-3dc7c13915d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:26.722695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-26631a46-8448-4973-aad7-3dc7c13915d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:26.722695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:26.722695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:26.722695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:26.722695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:26.722695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:26.722695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:26.722695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:26.722695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:26.722695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:26.722695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:26.722695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:26.722695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:26.722695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:26.722695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:26.722695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:26.723856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:26.723856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:26.723856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:26.723856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:26.723856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:26.723856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:26.723856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:26.723856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:26.723856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:26.723856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:26.723856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:26.723856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:26.723856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:26.723856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:26.723856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:26.723856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:26.724876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:26.724876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:26.724876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:26.724876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:26.724876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:26.724876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:26.724876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:26.724876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:26.724876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:26.724876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:26.724876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 06:56:26.724876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:26.726751 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 215/428] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:26.733726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26631a46-8448-4973-aad7-3dc7c13915d0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:26.743355 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794befa1-f5fd-40d2-a155-3559ade67f08 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:26.788718 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085a3ba-dfa8-4d36-b981-e62951403b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:26.789874 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085a3ba-dfa8-4d36-b981-e62951403b62 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:26.790628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085a3ba-dfa8-4d36-b981-e62951403b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:26.791102 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085a3ba-dfa8-4d36-b981-e62951403b62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:26.798521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:26.805452 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085a3ba-dfa8-4d36-b981-e62951403b62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:26.812602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-1085a3ba-dfa8-4d36-b981-e62951403b62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:56:26.812602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:26.812602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:26.812602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:26.812602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:26.812602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:26.812602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:26.812602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:26.812602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:26.812602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:26.812602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:26.812602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:26.812602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:26.812602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:26.812602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:26.812602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:26.813512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:26.813512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:26.813512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:26.813512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:26.813512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:26.813512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:26.813512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:26.813512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:26.813512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:26.813512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:26.813512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:26.813512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:26.813512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:26.813512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:26.813512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:26.813512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:26.814370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:26.814370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:26.814370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:26.814370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:26.814370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:26.814370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:26.814370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:26.814370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:26.814370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:26.814370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:26.814370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:56:26.814370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:26.822220 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 214/429] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:56:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:56:26.824093 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085a3ba-dfa8-4d36-b981-e62951403b62 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:26.860978 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26631a46-8448-4973-aad7-3dc7c13915d0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:26.907288 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083b384-f21f-4309-b36d-6bafa395001b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:26.907897 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083b384-f21f-4309-b36d-6bafa395001b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:26.908175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083b384-f21f-4309-b36d-6bafa395001b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:26.908441 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083b384-f21f-4309-b36d-6bafa395001b None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:26.909102 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083b384-f21f-4309-b36d-6bafa395001b None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:26.909402 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083b384-f21f-4309-b36d-6bafa395001b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:26.910774 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083b384-f21f-4309-b36d-6bafa395001b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:26.920899 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 216/430] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:56:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:26.926948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083b384-f21f-4309-b36d-6bafa395001b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:26.942760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085a3ba-dfa8-4d36-b981-e62951403b62 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:26.984071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:26.994024 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cacd1-6e88-4cc7-8883-59cbeec7e76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:26.994780 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cacd1-6e88-4cc7-8883-59cbeec7e76a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:26.995718 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cacd1-6e88-4cc7-8883-59cbeec7e76a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:26.996108 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cacd1-6e88-4cc7-8883-59cbeec7e76a None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:26.996987 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cacd1-6e88-4cc7-8883-59cbeec7e76a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:26.997347 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cacd1-6e88-4cc7-8883-59cbeec7e76a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:26.998813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cacd1-6e88-4cc7-8883-59cbeec7e76a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:27.008428 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 215/431] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:27.014927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cacd1-6e88-4cc7-8883-59cbeec7e76a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:27.084636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083b384-f21f-4309-b36d-6bafa395001b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:27.108628 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:27.141150 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cacd1-6e88-4cc7-8883-59cbeec7e76a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:27.143874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec679d5-4d34-46f9-a035-1952d09a96b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:27.144899 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec679d5-4d34-46f9-a035-1952d09a96b1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:27.144899 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec679d5-4d34-46f9-a035-1952d09a96b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:27.145097 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec679d5-4d34-46f9-a035-1952d09a96b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:27.179588 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c74d01-cc43-41af-86fc-ed02c7c112ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:27.180679 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c74d01-cc43-41af-86fc-ed02c7c112ff None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:27.181277 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c74d01-cc43-41af-86fc-ed02c7c112ff None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:27.181750 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c74d01-cc43-41af-86fc-ed02c7c112ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:27.229843 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec679d5-4d34-46f9-a035-1952d09a96b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:27.230923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec679d5-4d34-46f9-a035-1952d09a96b1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:27.249720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:27.263723 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c74d01-cc43-41af-86fc-ed02c7c112ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:27.265606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c74d01-cc43-41af-86fc-ed02c7c112ff None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:27.342057 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 217/432] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:27.352167 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec679d5-4d34-46f9-a035-1952d09a96b1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:27.370278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:27.380232 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 216/433] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:27.386069 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c74d01-cc43-41af-86fc-ed02c7c112ff None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:27.464098 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec679d5-4d34-46f9-a035-1952d09a96b1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:27.481188 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:27.494571 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c74d01-cc43-41af-86fc-ed02c7c112ff None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:27.501355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f49545-8aa6-4752-82a0-bf34f5a4eeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:27.502328 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f49545-8aa6-4752-82a0-bf34f5a4eeeb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:27.502606 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f49545-8aa6-4752-82a0-bf34f5a4eeeb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:27.502870 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f49545-8aa6-4752-82a0-bf34f5a4eeeb None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:27.504140 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f49545-8aa6-4752-82a0-bf34f5a4eeeb None admin] RBAC: Authorizing `identity:get_project(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:27.505694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f49545-8aa6-4752-82a0-bf34f5a4eeeb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:27.511982 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 218/434] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:27 2022] GET /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:27.513422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d05da-b079-45e9-be2c-b37a82414c31 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:27.513774 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d05da-b079-45e9-be2c-b37a82414c31 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:27.514042 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d05da-b079-45e9-be2c-b37a82414c31 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:27.515481 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 219/435] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:27.519959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d05da-b079-45e9-be2c-b37a82414c31 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:27.531631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13dfef2-0605-41f9-a12b-5269be16b339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:27.532259 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13dfef2-0605-41f9-a12b-5269be16b339 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:27.532528 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13dfef2-0605-41f9-a12b-5269be16b339 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:27.532794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13dfef2-0605-41f9-a12b-5269be16b339 None admin] PATH_INFO: `/v3/projects/b4ee993851d3477d921a816e3f05a39d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:27.533900 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13dfef2-0605-41f9-a12b-5269be16b339 None admin] RBAC: Authorizing `identity:get_project(project_id=b4ee993851d3477d921a816e3f05a39d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:27.535328 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13dfef2-0605-41f9-a12b-5269be16b339 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:27.536927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 217/436] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:27 2022] GET /identity/v3/projects/b4ee993851d3477d921a816e3f05a39d => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:27.538003 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1a8cd-4874-4d7f-93b7-4a6a47b4603a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:27.538274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1a8cd-4874-4d7f-93b7-4a6a47b4603a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:27.538535 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1a8cd-4874-4d7f-93b7-4a6a47b4603a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:27.557368 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-cbe1a8cd-4874-4d7f-93b7-4a6a47b4603a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:27.558584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cbe1a8cd-4874-4d7f-93b7-4a6a47b4603a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:27.609672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:27.628212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 218/437] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:27.629568 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0893d3-f8c9-4da3-8fe2-3d47b15cad50 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:27.629850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0893d3-f8c9-4da3-8fe2-3d47b15cad50 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:27.630121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0893d3-f8c9-4da3-8fe2-3d47b15cad50 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:27.635213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 219/438] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:27.635213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0893d3-f8c9-4da3-8fe2-3d47b15cad50 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:27.640841 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d05da-b079-45e9-be2c-b37a82414c31 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:27.677115 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ed4ee-294b-4165-8a64-840659719ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:27.677733 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ed4ee-294b-4165-8a64-840659719ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:27.678004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ed4ee-294b-4165-8a64-840659719ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:27.678277 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ed4ee-294b-4165-8a64-840659719ec3 None admin] PATH_INFO: `/v3/groups/b40eec006bd247068fbf1b33da715d5b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:27.679420 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ed4ee-294b-4165-8a64-840659719ec3 None admin] RBAC: Authorizing `identity:get_group(group_id=b40eec006bd247068fbf1b33da715d5b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:27.680839 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ed4ee-294b-4165-8a64-840659719ec3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:27.682389 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 220/439] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Aug 9 06:56:27 2022] GET /identity/v3/groups/b40eec006bd247068fbf1b33da715d5b => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:27.683492 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1e4ef-ee9a-4dfb-be32-8833d55e66d9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:27.683774 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1e4ef-ee9a-4dfb-be32-8833d55e66d9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:27.684052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1e4ef-ee9a-4dfb-be32-8833d55e66d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:27.701910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8cc1e4ef-ee9a-4dfb-be32-8833d55e66d9 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:27.703124 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8cc1e4ef-ee9a-4dfb-be32-8833d55e66d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:27.726550 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:27.740515 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0893d3-f8c9-4da3-8fe2-3d47b15cad50 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:27.768475 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 221/440] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:27.769300 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1e4ef-ee9a-4dfb-be32-8833d55e66d9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:27.776177 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca069e-e734-47a0-98db-145170480d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:27.777216 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca069e-e734-47a0-98db-145170480d5f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:27.777522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca069e-e734-47a0-98db-145170480d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:27.777791 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca069e-e734-47a0-98db-145170480d5f None admin] PATH_INFO: `/v3/groups/b40eec006bd247068fbf1b33da715d5b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:27.779335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca069e-e734-47a0-98db-145170480d5f None admin] RBAC: Authorizing `identity:get_group(group_id=b40eec006bd247068fbf1b33da715d5b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:27.781069 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca069e-e734-47a0-98db-145170480d5f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:27.782630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 220/441] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Aug 9 06:56:27 2022] GET /identity/v3/groups/b40eec006bd247068fbf1b33da715d5b => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:27.783392 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca069e-e734-47a0-98db-145170480d5f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:27.856134 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:27.875425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1e4ef-ee9a-4dfb-be32-8833d55e66d9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:27.889156 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca069e-e734-47a0-98db-145170480d5f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:27.909007 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeee1c1-588c-49fc-99e0-60a04a76b0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:27.909634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeee1c1-588c-49fc-99e0-60a04a76b0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:27.909912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeee1c1-588c-49fc-99e0-60a04a76b0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:27.910184 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeee1c1-588c-49fc-99e0-60a04a76b0a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:27.920622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeee1c1-588c-49fc-99e0-60a04a76b0a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:27.924479 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31931ba-072e-4f36-afda-09353ad2c47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:27.925071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31931ba-072e-4f36-afda-09353ad2c47b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:27.925245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-efeee1c1-588c-49fc-99e0-60a04a76b0a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:56:27.925245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:27.925245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:27.925245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:27.925245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:27.925245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:27.925245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:27.925245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:27.925245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:27.925245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:27.925245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:27.925245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:27.925245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:27.925245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:27.925245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:27.925245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:27.926240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:27.926240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:27.926240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:27.926240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:27.926240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:27.926240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:27.926240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:27.926240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:27.926240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:27.926240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:27.926240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:27.926240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:27.926240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:27.926240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:27.926240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:27.926240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:27.927056 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:27.927056 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:27.927056 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:27.927056 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:27.927056 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:27.927056 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:27.927056 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:27.927056 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:27.927056 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:27.927056 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:27.927056 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:56:27.927056 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:27.927704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31931ba-072e-4f36-afda-09353ad2c47b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:27.927704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31931ba-072e-4f36-afda-09353ad2c47b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:27.927704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31931ba-072e-4f36-afda-09353ad2c47b None admin] RBAC: Adding query filter params (group.id=b40eec006bd247068fbf1b33da715d5b, role.id=decfb257a46442b8b4637f8c95c9967b, scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:27.927893 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 222/442] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:56:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:27.927958 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31931ba-072e-4f36-afda-09353ad2c47b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:27.928022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeee1c1-588c-49fc-99e0-60a04a76b0a5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:27.928087 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31931ba-072e-4f36-afda-09353ad2c47b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:27.951170 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 221/443] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Aug 9 06:56:27 2022] GET /identity/v3/role_assignments?group.id=b40eec006bd247068fbf1b33da715d5b&scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506&role.id=decfb257a46442b8b4637f8c95c9967b => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:27.951170 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31931ba-072e-4f36-afda-09353ad2c47b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:27.961051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:28.045255 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeee1c1-588c-49fc-99e0-60a04a76b0a5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:28.055111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31931ba-072e-4f36-afda-09353ad2c47b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:28.080921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa96e6f-2be4-4420-8739-53ae5b1c74ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:28.081526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa96e6f-2be4-4420-8739-53ae5b1c74ff None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:28.081803 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa96e6f-2be4-4420-8739-53ae5b1c74ff None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:28.082072 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa96e6f-2be4-4420-8739-53ae5b1c74ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:28.082793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa96e6f-2be4-4420-8739-53ae5b1c74ff None admin] RBAC: Adding query filter params (group.id=b40eec006bd247068fbf1b33da715d5b, role.id=617e0c2609e3413ea3273113659bccbc, scope.project.id=b4ee993851d3477d921a816e3f05a39d) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:28.083128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa96e6f-2be4-4420-8739-53ae5b1c74ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:28.084545 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa96e6f-2be4-4420-8739-53ae5b1c74ff None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:28.090494 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 223/444] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Aug 9 06:56:27 2022] GET /identity/v3/role_assignments?group.id=b40eec006bd247068fbf1b33da715d5b&scope.project.id=b4ee993851d3477d921a816e3f05a39d&role.id=617e0c2609e3413ea3273113659bccbc => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:28.091949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa96e6f-2be4-4420-8739-53ae5b1c74ff None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:28.100814 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:28.102468 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85719626-4908-461d-8339-53b1af4bc8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:28.103158 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85719626-4908-461d-8339-53b1af4bc8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:28.103438 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85719626-4908-461d-8339-53b1af4bc8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:28.103704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85719626-4908-461d-8339-53b1af4bc8c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:28.118138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85719626-4908-461d-8339-53b1af4bc8c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:28.124163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-85719626-4908-461d-8339-53b1af4bc8c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:56:28.124163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:28.124163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:28.124163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:28.124163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:28.124163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:28.124163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:28.124163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:28.124163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:28.124163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:28.124163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:28.124163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:28.124163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:28.124163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:28.124163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:28.124163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:28.125122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:28.125122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:28.125122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:28.125122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:28.125122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:28.125122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:28.125122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:28.125122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:28.125122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:28.125122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:28.125122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:28.125122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:28.125122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:28.125122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:28.125122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:28.125122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:28.125972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:28.125972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:28.125972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:28.125972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:28.125972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:28.125972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:28.125972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:28.125972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:28.125972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:28.125972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:28.125972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:56:28.125972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:28.130887 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 222/445] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:56:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:28.132267 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85719626-4908-461d-8339-53b1af4bc8c2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:28.226968 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa96e6f-2be4-4420-8739-53ae5b1c74ff None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:28.245381 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:28.266114 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a1d7d-bda3-45e2-a8c6-192f83bafb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:28.266815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a1d7d-bda3-45e2-a8c6-192f83bafb3b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:28.267110 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a1d7d-bda3-45e2-a8c6-192f83bafb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:28.267398 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a1d7d-bda3-45e2-a8c6-192f83bafb3b None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:28.268067 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a1d7d-bda3-45e2-a8c6-192f83bafb3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:28.268460 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a1d7d-bda3-45e2-a8c6-192f83bafb3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:28.269723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a1d7d-bda3-45e2-a8c6-192f83bafb3b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:28.270678 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85719626-4908-461d-8339-53b1af4bc8c2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:28.280096 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 224/446] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:28.285387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a1d7d-bda3-45e2-a8c6-192f83bafb3b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:28.315029 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216f97e-b63a-46c7-a66d-936fa605617d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:28.316051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216f97e-b63a-46c7-a66d-936fa605617d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:28.316335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216f97e-b63a-46c7-a66d-936fa605617d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:28.316881 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216f97e-b63a-46c7-a66d-936fa605617d None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:28.317592 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216f97e-b63a-46c7-a66d-936fa605617d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:28.318007 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216f97e-b63a-46c7-a66d-936fa605617d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:28.320023 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216f97e-b63a-46c7-a66d-936fa605617d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:28.333267 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 223/447] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:28.338614 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216f97e-b63a-46c7-a66d-936fa605617d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:28.358590 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:28.400519 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a1d7d-bda3-45e2-a8c6-192f83bafb3b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:28.441056 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ac05a-f936-4f8d-b5db-7ad14613dc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:28.441885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ac05a-f936-4f8d-b5db-7ad14613dc8f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:28.442301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ac05a-f936-4f8d-b5db-7ad14613dc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:28.442571 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ac05a-f936-4f8d-b5db-7ad14613dc8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:28.464204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216f97e-b63a-46c7-a66d-936fa605617d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:28.522968 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da04b4-76c9-4021-b135-642d29f0621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:28.523615 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da04b4-76c9-4021-b135-642d29f0621a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:28.523892 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da04b4-76c9-4021-b135-642d29f0621a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:28.524236 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da04b4-76c9-4021-b135-642d29f0621a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:28.525757 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ac05a-f936-4f8d-b5db-7ad14613dc8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:28.527561 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ac05a-f936-4f8d-b5db-7ad14613dc8f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:28.538351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:28.611132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da04b4-76c9-4021-b135-642d29f0621a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:28.611454 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da04b4-76c9-4021-b135-642d29f0621a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:28.614113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:28.657312 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 225/448] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 06:56:28.662933 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ac05a-f936-4f8d-b5db-7ad14613dc8f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:28.714664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 224/449] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 06:56:28.720933 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da04b4-76c9-4021-b135-642d29f0621a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:28.761468 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:28.763746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ac05a-f936-4f8d-b5db-7ad14613dc8f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:28.799512 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de803ab1-f129-4945-9585-db3ea777adac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:28.800149 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de803ab1-f129-4945-9585-db3ea777adac None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:28.800428 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de803ab1-f129-4945-9585-db3ea777adac None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:28.800705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de803ab1-f129-4945-9585-db3ea777adac None admin] PATH_INFO: `/v3/projects/7517e8deb7c2455e89af98b08782ec1d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:28.802131 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de803ab1-f129-4945-9585-db3ea777adac None admin] RBAC: Authorizing `identity:get_project(project_id=7517e8deb7c2455e89af98b08782ec1d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:28.803603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de803ab1-f129-4945-9585-db3ea777adac None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:28.805239 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 226/450] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:28 2022] GET /identity/v3/projects/7517e8deb7c2455e89af98b08782ec1d => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:28.810744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de803ab1-f129-4945-9585-db3ea777adac None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:28.824447 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da04b4-76c9-4021-b135-642d29f0621a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:28.849436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:28.862661 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d37472-8205-4e1e-8108-66697c1002e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:28.863309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37472-8205-4e1e-8108-66697c1002e3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:28.863589 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37472-8205-4e1e-8108-66697c1002e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:28.863855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37472-8205-4e1e-8108-66697c1002e3 None admin] PATH_INFO: `/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:28.864964 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d37472-8205-4e1e-8108-66697c1002e3 None admin] RBAC: Authorizing `identity:get_project(project_id=fdfa94d8f8f54c5f90410bbd5e4b5506)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:28.866384 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d37472-8205-4e1e-8108-66697c1002e3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:28.868025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 225/451] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:56:28 2022] GET /identity/v3/projects/fdfa94d8f8f54c5f90410bbd5e4b5506 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:28.873573 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d37472-8205-4e1e-8108-66697c1002e3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:28.912721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de803ab1-f129-4945-9585-db3ea777adac None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:28.946885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275379ac-6a6e-426c-95c2-122b1f13f6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:28.947589 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275379ac-6a6e-426c-95c2-122b1f13f6ad None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:28.947859 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275379ac-6a6e-426c-95c2-122b1f13f6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:28.948128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275379ac-6a6e-426c-95c2-122b1f13f6ad None admin] PATH_INFO: `/v3/groups/f7c4e63760f04663aab17ca6e2ba2ebb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:28.949224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275379ac-6a6e-426c-95c2-122b1f13f6ad None admin] RBAC: Authorizing `identity:get_group(group_id=f7c4e63760f04663aab17ca6e2ba2ebb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:28.951399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275379ac-6a6e-426c-95c2-122b1f13f6ad None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:28.952947 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 227/452] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Aug 9 06:56:28 2022] GET /identity/v3/groups/f7c4e63760f04663aab17ca6e2ba2ebb => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:28.958830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275379ac-6a6e-426c-95c2-122b1f13f6ad None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:28.968877 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d37472-8205-4e1e-8108-66697c1002e3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:28.979325 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:29.003044 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e5f55-c2e0-46f7-919f-ac994c4e8863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:29.003708 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e5f55-c2e0-46f7-919f-ac994c4e8863 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:29.003980 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e5f55-c2e0-46f7-919f-ac994c4e8863 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:29.004245 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e5f55-c2e0-46f7-919f-ac994c4e8863 None admin] PATH_INFO: `/v3/groups/b40eec006bd247068fbf1b33da715d5b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:29.005350 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e5f55-c2e0-46f7-919f-ac994c4e8863 None admin] RBAC: Authorizing `identity:get_group(group_id=b40eec006bd247068fbf1b33da715d5b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:29.006748 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e5f55-c2e0-46f7-919f-ac994c4e8863 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:29.008317 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 226/453] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Aug 9 06:56:28 2022] GET /identity/v3/groups/b40eec006bd247068fbf1b33da715d5b => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:29.014148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e5f55-c2e0-46f7-919f-ac994c4e8863 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:29.056388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275379ac-6a6e-426c-95c2-122b1f13f6ad None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:29.058587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:29.090233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0a71a-4797-4308-b224-13912f851239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:29.091443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0a71a-4797-4308-b224-13912f851239 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:29.091753 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0a71a-4797-4308-b224-13912f851239 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:29.092067 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0a71a-4797-4308-b224-13912f851239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:29.092778 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0a71a-4797-4308-b224-13912f851239 None admin] RBAC: Adding query filter params (group.id=f7c4e63760f04663aab17ca6e2ba2ebb, role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.project.id=7517e8deb7c2455e89af98b08782ec1d) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:29.093081 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0a71a-4797-4308-b224-13912f851239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:29.094498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0a71a-4797-4308-b224-13912f851239 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:29.100115 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 228/454] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Aug 9 06:56:28 2022] GET /identity/v3/role_assignments?group.id=f7c4e63760f04663aab17ca6e2ba2ebb&scope.project.id=7517e8deb7c2455e89af98b08782ec1d&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:29.111346 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e5f55-c2e0-46f7-919f-ac994c4e8863 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:29.154688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68713e-c92b-487b-be13-be6e27011c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:29.155345 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68713e-c92b-487b-be13-be6e27011c9d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:29.155620 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68713e-c92b-487b-be13-be6e27011c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:29.155884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68713e-c92b-487b-be13-be6e27011c9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:29.156619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68713e-c92b-487b-be13-be6e27011c9d None admin] RBAC: Adding query filter params (group.id=b40eec006bd247068fbf1b33da715d5b, role.id=617e0c2609e3413ea3273113659bccbc, scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:29.156921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68713e-c92b-487b-be13-be6e27011c9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:29.158360 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68713e-c92b-487b-be13-be6e27011c9d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:29.164888 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 227/455] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Aug 9 06:56:29 2022] GET /identity/v3/role_assignments?group.id=b40eec006bd247068fbf1b33da715d5b&scope.project.id=fdfa94d8f8f54c5f90410bbd5e4b5506&role.id=617e0c2609e3413ea3273113659bccbc => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:31.854245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa3f94-3f5a-45dc-a992-cf6733a0096d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:31.854786 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa3f94-3f5a-45dc-a992-cf6733a0096d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:31.854786 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa3f94-3f5a-45dc-a992-cf6733a0096d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:31.856982 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 229/456] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:31.862815 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc75aa-42ff-4419-8e13-6644dc89b54b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:31.863653 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc75aa-42ff-4419-8e13-6644dc89b54b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:31.864146 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc75aa-42ff-4419-8e13-6644dc89b54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:31.887583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-94fc75aa-42ff-4419-8e13-6644dc89b54b None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:31.889246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-94fc75aa-42ff-4419-8e13-6644dc89b54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:31.933939 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:31.969864 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23112043-1aa2-4104-8db5-542f76039bca None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:31.970560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23112043-1aa2-4104-8db5-542f76039bca None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:31.971037 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23112043-1aa2-4104-8db5-542f76039bca None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:31.972839 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 230/457] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:31.975514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 228/458] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:31.977830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10bc5a-0d5b-4d23-9cef-d96c86726fd4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:31.978114 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10bc5a-0d5b-4d23-9cef-d96c86726fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:31.978601 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10bc5a-0d5b-4d23-9cef-d96c86726fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:32.000183 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc75aa-42ff-4419-8e13-6644dc89b54b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:32.028598 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8c10bc5a-0d5b-4d23-9cef-d96c86726fd4 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:32.029804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8c10bc5a-0d5b-4d23-9cef-d96c86726fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:32.107582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc75aa-42ff-4419-8e13-6644dc89b54b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:32.151547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d464942-3f07-4cf3-ad96-872f020cb1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:32.152545 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d464942-3f07-4cf3-ad96-872f020cb1be None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:32.153166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d464942-3f07-4cf3-ad96-872f020cb1be None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:32.153719 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d464942-3f07-4cf3-ad96-872f020cb1be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:32.176376 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d464942-3f07-4cf3-ad96-872f020cb1be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:32.178182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d464942-3f07-4cf3-ad96-872f020cb1be None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:32.207511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-9d464942-3f07-4cf3-ad96-872f020cb1be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:32.207511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:32.207511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:32.207511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:32.207511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:32.207511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:32.207511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:32.207511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:32.207511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:32.207511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:32.207511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:32.207511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:32.207511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:32.207511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:32.207511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:32.207511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:32.208522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:32.208522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:32.208522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:32.208522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:32.208522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:32.208522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:32.208522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:32.208522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:32.208522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:32.208522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:32.208522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:32.208522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:32.208522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:32.208522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:32.208522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:32.208522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:32.208522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:32.209383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:32.209383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:32.209383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:32.223502 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 229/460] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:32.223838 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 231/460] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:32.225521 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d464942-3f07-4cf3-ad96-872f020cb1be None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:32.250972 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10bc5a-0d5b-4d23-9cef-d96c86726fd4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:32.265417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:32.344746 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d464942-3f07-4cf3-ad96-872f020cb1be None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:32.353330 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:32.358210 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10bc5a-0d5b-4d23-9cef-d96c86726fd4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:32.382772 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b69a39-3569-4791-92ee-3904f67a6158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:32.383739 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b69a39-3569-4791-92ee-3904f67a6158 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:32.384218 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b69a39-3569-4791-92ee-3904f67a6158 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:32.384673 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b69a39-3569-4791-92ee-3904f67a6158 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:32.385510 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b69a39-3569-4791-92ee-3904f67a6158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:32.386097 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b69a39-3569-4791-92ee-3904f67a6158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:32.388311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b69a39-3569-4791-92ee-3904f67a6158 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:32.395278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be7cbe-5141-4887-866f-6058daa2c7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:32.395914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be7cbe-5141-4887-866f-6058daa2c7ca None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:32.396217 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be7cbe-5141-4887-866f-6058daa2c7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:32.396492 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be7cbe-5141-4887-866f-6058daa2c7ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:32.403237 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 230/461] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:32.404830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612051-b78f-4f03-b941-d60daec88118 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:32.405323 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612051-b78f-4f03-b941-d60daec88118 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:32.405796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612051-b78f-4f03-b941-d60daec88118 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:32.407203 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 231/462] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:32.408664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa57a52-3b74-4932-8aa2-30d8343c9073 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:32.408977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa57a52-3b74-4932-8aa2-30d8343c9073 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:32.409250 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa57a52-3b74-4932-8aa2-30d8343c9073 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:32.410449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 232/463] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:32.411163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa57a52-3b74-4932-8aa2-30d8343c9073 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:32.416728 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be7cbe-5141-4887-866f-6058daa2c7ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:32.418212 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be7cbe-5141-4887-866f-6058daa2c7ca None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:32.436080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b9be7cbe-5141-4887-866f-6058daa2c7ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:32.436080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:32.436080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:32.436080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:32.436080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:32.436080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:32.436080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:32.436080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:32.436080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:32.436080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:32.436080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:32.436080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:32.436080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:32.436080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:32.436080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:32.436080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:32.437188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:32.437188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:32.437188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:32.437188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:32.437188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:32.437188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:32.437188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:32.437188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:32.437188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:32.437188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:32.437188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:32.437188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:32.437188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:32.437188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:32.437188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:32.437188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:32.437188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:32.438118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:32.438118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:32.438118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:32.438118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 232/464] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:56:32.438416 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fd82e-0429-4e6d-929d-2b00b58f2d3f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:32.438658 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fd82e-0429-4e6d-929d-2b00b58f2d3f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:32.438940 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fd82e-0429-4e6d-929d-2b00b58f2d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:32.459155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f06fd82e-0429-4e6d-929d-2b00b58f2d3f None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:32.460346 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f06fd82e-0429-4e6d-929d-2b00b58f2d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:32.505041 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:32.523330 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa57a52-3b74-4932-8aa2-30d8343c9073 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:32.531472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 233/465] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:32.533223 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c0d58-8394-443d-945f-2cf5d698c154 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:32.533511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c0d58-8394-443d-945f-2cf5d698c154 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:32.533786 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c0d58-8394-443d-945f-2cf5d698c154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:32.554909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4a7c0d58-8394-443d-945f-2cf5d698c154 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:32.556143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4a7c0d58-8394-443d-945f-2cf5d698c154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:32.561517 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec39c6-6f18-4a3a-9569-3d548b4bd839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:32.562121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec39c6-6f18-4a3a-9569-3d548b4bd839 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:32.562392 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec39c6-6f18-4a3a-9569-3d548b4bd839 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:32.562657 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec39c6-6f18-4a3a-9569-3d548b4bd839 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:32.563316 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec39c6-6f18-4a3a-9569-3d548b4bd839 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:32.564734 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec39c6-6f18-4a3a-9569-3d548b4bd839 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:32.586396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 233/466] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Aug 9 06:56:32 2022] POST /identity/v3/users => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:56:32.587249 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec39c6-6f18-4a3a-9569-3d548b4bd839 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:32.659651 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 234/467] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:32.661119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c0d58-8394-443d-945f-2cf5d698c154 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:32.675461 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:32.741615 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec39c6-6f18-4a3a-9569-3d548b4bd839 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:32.780231 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc44555-eba2-4097-87f2-3bc38cbd7f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:32.780839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc44555-eba2-4097-87f2-3bc38cbd7f30 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:32.781115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc44555-eba2-4097-87f2-3bc38cbd7f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:32.781468 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc44555-eba2-4097-87f2-3bc38cbd7f30 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:32.782018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc44555-eba2-4097-87f2-3bc38cbd7f30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:32.782317 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc44555-eba2-4097-87f2-3bc38cbd7f30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:32.783705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc44555-eba2-4097-87f2-3bc38cbd7f30 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:32.793404 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:32.797829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 234/468] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:32.798490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c0d58-8394-443d-945f-2cf5d698c154 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:32.798687 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc44555-eba2-4097-87f2-3bc38cbd7f30 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:32.852581 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b01b1-7842-436c-a560-a53a7738b820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:32.853227 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b01b1-7842-436c-a560-a53a7738b820 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:32.853506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b01b1-7842-436c-a560-a53a7738b820 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:32.853778 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b01b1-7842-436c-a560-a53a7738b820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:32.867259 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b01b1-7842-436c-a560-a53a7738b820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:32.869374 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b01b1-7842-436c-a560-a53a7738b820 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:32.889996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-070b01b1-7842-436c-a560-a53a7738b820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:32.889996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:32.889996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:32.889996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:32.889996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:32.889996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:32.889996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:32.889996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:32.889996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:32.889996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:32.889996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:32.889996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:32.889996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:32.889996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:32.889996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:32.889996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:32.890957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:32.890957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:32.890957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:32.890957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:32.890957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:32.890957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:32.890957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:32.890957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:32.890957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:32.890957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:32.890957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:32.890957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:32.890957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:32.890957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:32.890957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:32.890957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:32.890957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:32.891863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:32.891863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:32.891863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:32.891863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 235/469] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:32.892084 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b01b1-7842-436c-a560-a53a7738b820 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:32.937570 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc44555-eba2-4097-87f2-3bc38cbd7f30 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:32.974896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:32.982616 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f313b-bf94-4b00-9f42-6c177b7bf91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:32.983261 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f313b-bf94-4b00-9f42-6c177b7bf91a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:32.983536 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f313b-bf94-4b00-9f42-6c177b7bf91a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:32.983802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f313b-bf94-4b00-9f42-6c177b7bf91a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:32.994574 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f313b-bf94-4b00-9f42-6c177b7bf91a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:32.996311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f313b-bf94-4b00-9f42-6c177b7bf91a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:33.011764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-cf5f313b-bf94-4b00-9f42-6c177b7bf91a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:33.011764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:33.011764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:33.011764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:33.011764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:33.011764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:33.011764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:33.011764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:33.011764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:33.011764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:33.011764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:33.011764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:33.011764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:33.011764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:33.011764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:33.011764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:33.013446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:33.013446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:33.013446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:33.013446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:33.013446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:33.013446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:33.013446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:33.013446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:33.013446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:33.013446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:33.013446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:33.013446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:33.013446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:33.013446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:33.013446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:33.013446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:33.013446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:33.014651 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:33.014651 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:33.014651 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:33.016386 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 235/470] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:33.017321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f313b-bf94-4b00-9f42-6c177b7bf91a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:33.025856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b01b1-7842-436c-a560-a53a7738b820 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:33.062400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8b943-6a6e-4810-9ab7-446c80e74284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:33.063216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8b943-6a6e-4810-9ab7-446c80e74284 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:33.063599 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8b943-6a6e-4810-9ab7-446c80e74284 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:33.063974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8b943-6a6e-4810-9ab7-446c80e74284 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:33.064708 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8b943-6a6e-4810-9ab7-446c80e74284 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:33.066253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8b943-6a6e-4810-9ab7-446c80e74284 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:33.075636 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:33.099619 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 236/471] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Aug 9 06:56:32 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:56:33.100858 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8b943-6a6e-4810-9ab7-446c80e74284 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:33.135717 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f313b-bf94-4b00-9f42-6c177b7bf91a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:33.182873 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002a521-1ec0-4c36-aa97-1f7c4e8ce34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:33.183916 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002a521-1ec0-4c36-aa97-1f7c4e8ce34a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:33.184883 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002a521-1ec0-4c36-aa97-1f7c4e8ce34a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:33.185377 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002a521-1ec0-4c36-aa97-1f7c4e8ce34a None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:33.186114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002a521-1ec0-4c36-aa97-1f7c4e8ce34a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:33.186459 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002a521-1ec0-4c36-aa97-1f7c4e8ce34a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:33.187964 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002a521-1ec0-4c36-aa97-1f7c4e8ce34a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:33.204150 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 236/472] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:33.206474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f17a87-a689-4d68-8bdc-8c87994482c4 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:33.207017 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f17a87-a689-4d68-8bdc-8c87994482c4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:33.207364 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f17a87-a689-4d68-8bdc-8c87994482c4 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:33.208949 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 237/473] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:33.212043 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f17a87-a689-4d68-8bdc-8c87994482c4 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:33.289647 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8b943-6a6e-4810-9ab7-446c80e74284 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:33.312964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:33.333304 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed787a-38af-42b6-ac7d-2d86ee0b3a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:33.334029 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed787a-38af-42b6-ac7d-2d86ee0b3a43 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:33.334312 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed787a-38af-42b6-ac7d-2d86ee0b3a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:33.334586 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed787a-38af-42b6-ac7d-2d86ee0b3a43 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:33.335263 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed787a-38af-42b6-ac7d-2d86ee0b3a43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:33.335575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed787a-38af-42b6-ac7d-2d86ee0b3a43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:33.336956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed787a-38af-42b6-ac7d-2d86ee0b3a43 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:33.346373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f17a87-a689-4d68-8bdc-8c87994482c4 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:33.351210 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 237/474] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:33.353679 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f88226-f8cd-4fe7-a2f2-37e25c8fbf71 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:33.353679 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f88226-f8cd-4fe7-a2f2-37e25c8fbf71 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:33.353679 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f88226-f8cd-4fe7-a2f2-37e25c8fbf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:33.361434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:33.376400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-29f88226-f8cd-4fe7-a2f2-37e25c8fbf71 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:33.377588 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-29f88226-f8cd-4fe7-a2f2-37e25c8fbf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:33.389569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c4628-d8e1-48f6-a093-1beece39cd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:33.390169 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c4628-d8e1-48f6-a093-1beece39cd87 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:33.390443 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c4628-d8e1-48f6-a093-1beece39cd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:33.390710 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c4628-d8e1-48f6-a093-1beece39cd87 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:33.391388 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c4628-d8e1-48f6-a093-1beece39cd87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:33.392813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c4628-d8e1-48f6-a093-1beece39cd87 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:33.420736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 238/475] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Aug 9 06:56:33 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 06:56:33.421894 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c4628-d8e1-48f6-a093-1beece39cd87 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:33.460138 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 238/476] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:33.500915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f88226-f8cd-4fe7-a2f2-37e25c8fbf71 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:33.553317 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c4628-d8e1-48f6-a093-1beece39cd87 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:33.633193 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f21f5-e478-4e40-9768-eb335519913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:33.633921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f21f5-e478-4e40-9768-eb335519913a None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:33.634272 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f21f5-e478-4e40-9768-eb335519913a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:33.634611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f21f5-e478-4e40-9768-eb335519913a None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:33.635364 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f21f5-e478-4e40-9768-eb335519913a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:33.636879 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f21f5-e478-4e40-9768-eb335519913a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:33.662142 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 239/477] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Aug 9 06:56:33 2022] POST /identity/v3/users => generated 249 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:56:33.686463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f88226-f8cd-4fe7-a2f2-37e25c8fbf71 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:33.699668 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:33.727742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e5315-bf9e-4bd2-9e7f-eda0d40ae648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:33.728799 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e5315-bf9e-4bd2-9e7f-eda0d40ae648 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:33.730369 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e5315-bf9e-4bd2-9e7f-eda0d40ae648 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:33.730895 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e5315-bf9e-4bd2-9e7f-eda0d40ae648 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:33.732546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e5315-bf9e-4bd2-9e7f-eda0d40ae648 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:33.734372 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e5315-bf9e-4bd2-9e7f-eda0d40ae648 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:33.743896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.sql.core [None req-229e5315-bf9e-4bd2-9e7f-eda0d40ae648 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 06:56:33.743896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 09 06:56:33.743896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [parameters: {'id': 'fbd6f6da74f94b1b90c94ecbd60c161a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 09 06:56:33.743896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80234) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 06:56:33.762993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-229e5315-bf9e-4bd2-9e7f-eda0d40ae648 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 09 06:56:33.762993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:33.762993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 06:56:33.762993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 06:56:33.762993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 06:56:33.762993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 06:56:33.762993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 06:56:33.762993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 06:56:33.762993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 06:56:33.762993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application conn.query(q) Aug 09 06:56:33.762993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 06:56:33.762993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 06:56:33.762993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 06:56:33.762993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result.read() Aug 09 06:56:33.762993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 06:56:33.763984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 06:56:33.763984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 06:56:33.763984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 06:56:33.763984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 06:56:33.763984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 06:56:33.763984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 06:56:33.763984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 06:56:33.763984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 06:56:33.763984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:33.763984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 06:56:33.763984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:33.763984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:33.763984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 06:56:33.763984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 06:56:33.763984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 09 06:56:33.763984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return ref.to_dict() Aug 09 06:56:33.763984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 06:56:33.763984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application next(self.gen) Aug 09 06:56:33.764969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 06:56:33.764969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application yield resource Aug 09 06:56:33.764969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 06:56:33.764969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application next(self.gen) Aug 09 06:56:33.764969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 06:56:33.764969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 06:56:33.764969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 06:56:33.764969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 06:56:33.764969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 06:56:33.764969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise self.value Aug 09 06:56:33.764969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 06:56:33.764969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 06:56:33.764969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 06:56:33.764969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application session.commit() Aug 09 06:56:33.764969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 06:56:33.764969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 06:56:33.764969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 06:56:33.765830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 06:56:33.765830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 06:56:33.765830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.session.flush() Aug 09 06:56:33.765830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 06:56:33.765830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 06:56:33.765830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 06:56:33.765830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 06:56:33.765830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 06:56:33.765830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application compat.raise_( Aug 09 06:56:33.765830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 06:56:33.765830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception Aug 09 06:56:33.765830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 06:56:33.765830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 06:56:33.765830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 06:56:33.765830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 06:56:33.765830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 06:56:33.765830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 06:56:33.767514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 06:56:33.767514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 06:56:33.767514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 09 06:56:33.767514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 09 06:56:33.767514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 06:56:33.767514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 06:56:33.767514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 06:56:33.767514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 06:56:33.767514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 06:56:33.767514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 06:56:33.767514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 06:56:33.767514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 06:56:33.767514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 06:56:33.767514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 06:56:33.767514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 06:56:33.767514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception Aug 09 06:56:33.769078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 06:56:33.769078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 06:56:33.769078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 06:56:33.769078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 06:56:33.769078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 06:56:33.769078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 06:56:33.769078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 06:56:33.769078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application conn.query(q) Aug 09 06:56:33.769078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 06:56:33.769078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 06:56:33.769078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 06:56:33.769078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result.read() Aug 09 06:56:33.769078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 06:56:33.769078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 06:56:33.769078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 06:56:33.769078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 06:56:33.771043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 06:56:33.771043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 06:56:33.771043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 06:56:33.771043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 06:56:33.771043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 06:56:33.771043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 09 06:56:33.771043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [parameters: {'id': 'fbd6f6da74f94b1b90c94ecbd60c161a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 09 06:56:33.771043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 06:56:33.771043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:33.771043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:56:33.771043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:33.771043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:33.771043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:33.771043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:33.771043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:33.771043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:33.773022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:33.773022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:33.773022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:33.773022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:33.773022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:33.773022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:33.773022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 09 06:56:33.773022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 09 06:56:33.773022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:33.773022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:33.773022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 09 06:56:33.773022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 09 06:56:33.773022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 06:56:33.773022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 06:56:33.773022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 09 06:56:33.773022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:33.776782 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 239/478] 10.222.0.40 () {60 vars in 1131 bytes} [Tue Aug 9 06:56:33 2022] POST /identity/v3/roles => generated 144 bytes in 276 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:56:33.788517 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f21f5-e478-4e40-9768-eb335519913a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:33.825336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:33.908575 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f21f5-e478-4e40-9768-eb335519913a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:33.949964 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac57432-b193-411f-8484-44aed5e03382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:33.950714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac57432-b193-411f-8484-44aed5e03382 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:33.950954 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac57432-b193-411f-8484-44aed5e03382 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:33.951282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac57432-b193-411f-8484-44aed5e03382 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:33.964587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac57432-b193-411f-8484-44aed5e03382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:33.970906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-2ac57432-b193-411f-8484-44aed5e03382 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:56:33.970906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:33.970906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:33.970906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:33.970906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:33.970906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:33.970906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:33.970906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:33.970906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:33.970906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:33.970906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:33.970906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:33.970906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:33.970906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:33.970906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:33.970906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:33.971850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:33.971850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:33.971850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:33.971850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:33.971850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:33.971850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:33.971850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:33.971850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:33.971850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:33.971850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:33.971850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:33.971850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:33.971850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:33.971850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:33.971850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:33.971850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:33.972654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:33.972654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:33.972654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:33.972654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:33.972654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:33.972654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:33.972654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:33.972654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:33.972654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:33.972654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:33.972654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 06:56:33.972654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:33.972654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 240/479] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:56:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:33.978249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e5315-bf9e-4bd2-9e7f-eda0d40ae648 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:34.084638 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e5315-bf9e-4bd2-9e7f-eda0d40ae648 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:34.119997 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efa8f9-bd70-4479-a083-21f1f6e914f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:34.120935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efa8f9-bd70-4479-a083-21f1f6e914f6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:34.121401 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efa8f9-bd70-4479-a083-21f1f6e914f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:34.122398 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efa8f9-bd70-4479-a083-21f1f6e914f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:34.123270 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46efa8f9-bd70-4479-a083-21f1f6e914f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:34.123788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46efa8f9-bd70-4479-a083-21f1f6e914f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:34.125337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46efa8f9-bd70-4479-a083-21f1f6e914f6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:34.133769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 240/480] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:35.068817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59a2f6-6a70-494d-bc2b-dc6208089b63 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:35.069388 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59a2f6-6a70-494d-bc2b-dc6208089b63 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:35.069388 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59a2f6-6a70-494d-bc2b-dc6208089b63 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:35.070928 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 241/481] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:35.076796 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3e8dd-908a-4384-b8c9-4174bd5c577f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:35.077207 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3e8dd-908a-4384-b8c9-4174bd5c577f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:35.077394 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3e8dd-908a-4384-b8c9-4174bd5c577f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:35.104424 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fab3e8dd-908a-4384-b8c9-4174bd5c577f None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:35.105596 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fab3e8dd-908a-4384-b8c9-4174bd5c577f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:35.141008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:35.196689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 241/482] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:35.241386 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59a2f6-6a70-494d-bc2b-dc6208089b63 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:35.341505 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:35.360036 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59a2f6-6a70-494d-bc2b-dc6208089b63 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:35.405611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88505e1d-f557-4680-a056-b2bcd3e30cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:35.406246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88505e1d-f557-4680-a056-b2bcd3e30cff None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:35.406528 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88505e1d-f557-4680-a056-b2bcd3e30cff None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:35.406800 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88505e1d-f557-4680-a056-b2bcd3e30cff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:35.418023 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88505e1d-f557-4680-a056-b2bcd3e30cff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:35.423584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-88505e1d-f557-4680-a056-b2bcd3e30cff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:35.423584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:35.423584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:35.423584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:35.423584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:35.423584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:35.423584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:35.423584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:35.423584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:35.423584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:35.423584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:35.423584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:35.423584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:35.423584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:35.423584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:35.423584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:35.424584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:35.424584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:35.424584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:35.424584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:35.424584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:35.424584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:35.424584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:35.424584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:35.424584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:35.424584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:35.424584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:35.424584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:35.424584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:35.424584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:35.424584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:35.424584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:35.425373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:35.425373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:35.425373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:35.425373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:35.425373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:35.425373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:35.425373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:35.425373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:35.425373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:35.425373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:35.425373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:35.425373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:35.425373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 242/483] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:56:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:35.431044 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3e8dd-908a-4384-b8c9-4174bd5c577f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:35.444420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45480fd-6934-4080-9a77-81ed2c46bd33 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:35.444713 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45480fd-6934-4080-9a77-81ed2c46bd33 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:35.444973 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45480fd-6934-4080-9a77-81ed2c46bd33 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:35.446634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 243/484] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:56:35.452130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42359461-b27a-463c-a38e-a09e4b9e8554 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:35.452411 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42359461-b27a-463c-a38e-a09e4b9e8554 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:35.452683 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42359461-b27a-463c-a38e-a09e4b9e8554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:35.471889 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-42359461-b27a-463c-a38e-a09e4b9e8554 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:35.473083 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-42359461-b27a-463c-a38e-a09e4b9e8554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:35.571351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 244/485] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:56:35.618270 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3e8dd-908a-4384-b8c9-4174bd5c577f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:35.650893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42359461-b27a-463c-a38e-a09e4b9e8554 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:35.683645 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29578e3-18ad-4eb9-824a-21a23e758a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:35.684846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29578e3-18ad-4eb9-824a-21a23e758a0d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:35.685206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29578e3-18ad-4eb9-824a-21a23e758a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:35.685478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29578e3-18ad-4eb9-824a-21a23e758a0d None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:35.686212 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29578e3-18ad-4eb9-824a-21a23e758a0d None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:35.686516 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29578e3-18ad-4eb9-824a-21a23e758a0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:35.687912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29578e3-18ad-4eb9-824a-21a23e758a0d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:35.703744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 242/486] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:56:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:35.709440 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29578e3-18ad-4eb9-824a-21a23e758a0d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:35.759435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:35.783449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:35.840189 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29578e3-18ad-4eb9-824a-21a23e758a0d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:35.860999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42359461-b27a-463c-a38e-a09e4b9e8554 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:35.893722 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f78a3-676e-4b95-b92a-3162db77709e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:35.894279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f78a3-676e-4b95-b92a-3162db77709e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:35.894586 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f78a3-676e-4b95-b92a-3162db77709e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:35.894868 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f78a3-676e-4b95-b92a-3162db77709e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:35.906360 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f78a3-676e-4b95-b92a-3162db77709e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:35.908038 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f78a3-676e-4b95-b92a-3162db77709e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:35.923313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-eb7f78a3-676e-4b95-b92a-3162db77709e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:35.923313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:35.923313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:35.923313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:35.923313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:35.923313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:35.923313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:35.923313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:35.923313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:35.923313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:35.923313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:35.923313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:35.923313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:35.923313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:35.923313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:35.923313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:35.924253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:35.924253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:35.924253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:35.924253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:35.924253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:35.924253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:35.924253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:35.924253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:35.924253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:35.924253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:35.924253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:35.924253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:35.924253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:35.924253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:35.924253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:35.924253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:35.924253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:35.925101 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:35.925101 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:35.925101 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:35.925101 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 243/487] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:35.930232 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f78a3-676e-4b95-b92a-3162db77709e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:35.952740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a08a63-2953-4d7e-9370-99208611cb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:35.953377 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a08a63-2953-4d7e-9370-99208611cb2a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:35.953706 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a08a63-2953-4d7e-9370-99208611cb2a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:35.953977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a08a63-2953-4d7e-9370-99208611cb2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:35.969812 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a08a63-2953-4d7e-9370-99208611cb2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:35.976475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-e8a08a63-2953-4d7e-9370-99208611cb2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:35.976475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:35.976475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:35.976475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:35.976475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:35.976475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:35.976475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:35.976475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:35.976475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:35.976475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:35.976475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:35.976475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:35.976475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:35.976475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:35.976475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:35.976475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:35.977362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:35.977362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:35.977362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:35.977362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:35.977362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:35.977362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:35.977362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:35.977362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:35.977362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:35.977362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:35.977362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:35.977362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:35.977362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:35.977362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:35.977362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:35.977362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:35.978153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:35.978153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:35.978153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:35.978153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:35.978153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:35.978153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:35.978153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:35.978153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:35.978153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:35.978153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:35.978153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:35.978153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:35.978153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 245/488] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:56:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:56:35.980278 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0095a-5b32-4c68-a870-95bf087a2186 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:35.980559 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0095a-5b32-4c68-a870-95bf087a2186 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:35.982386 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0095a-5b32-4c68-a870-95bf087a2186 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:35.982636 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 246/489] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:35.983543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0095a-5b32-4c68-a870-95bf087a2186 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:36.037962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:36.067668 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f78a3-676e-4b95-b92a-3162db77709e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:36.114278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b569f-7159-4ed1-8925-5eebf524a1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:36.115025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b569f-7159-4ed1-8925-5eebf524a1ac None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:36.115522 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b569f-7159-4ed1-8925-5eebf524a1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:36.115866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b569f-7159-4ed1-8925-5eebf524a1ac None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:36.117137 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b569f-7159-4ed1-8925-5eebf524a1ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:36.117518 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b569f-7159-4ed1-8925-5eebf524a1ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:36.119049 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b569f-7159-4ed1-8925-5eebf524a1ac None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:36.119686 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0095a-5b32-4c68-a870-95bf087a2186 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:36.133426 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 244/490] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:36.135133 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3f9bd-abc6-4e90-9c39-00f77992dfcd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:36.135497 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3f9bd-abc6-4e90-9c39-00f77992dfcd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:36.136008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3f9bd-abc6-4e90-9c39-00f77992dfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:36.159490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c9a3f9bd-abc6-4e90-9c39-00f77992dfcd None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:36.160707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c9a3f9bd-abc6-4e90-9c39-00f77992dfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:36.168199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ff08b-6b7d-4c22-b368-1b00b6213a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:36.169329 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ff08b-6b7d-4c22-b368-1b00b6213a2c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:36.169598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ff08b-6b7d-4c22-b368-1b00b6213a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:36.169746 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ff08b-6b7d-4c22-b368-1b00b6213a2c None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:36.170450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ff08b-6b7d-4c22-b368-1b00b6213a2c None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:36.170754 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ff08b-6b7d-4c22-b368-1b00b6213a2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:36.172227 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ff08b-6b7d-4c22-b368-1b00b6213a2c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:36.173784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:36.183310 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 247/491] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:56:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:36.185028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ff08b-6b7d-4c22-b368-1b00b6213a2c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:36.254956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 245/492] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:36.259775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3f9bd-abc6-4e90-9c39-00f77992dfcd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:36.313407 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ff08b-6b7d-4c22-b368-1b00b6213a2c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:36.344904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:36.349844 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0630d-4192-4827-9c3d-aa51e862b7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:36.350481 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0630d-4192-4827-9c3d-aa51e862b7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:36.350802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0630d-4192-4827-9c3d-aa51e862b7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:36.351077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0630d-4192-4827-9c3d-aa51e862b7c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:36.359436 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0630d-4192-4827-9c3d-aa51e862b7c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:36.360871 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0630d-4192-4827-9c3d-aa51e862b7c9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:36.374299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-25b0630d-4192-4827-9c3d-aa51e862b7c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 06:56:36.374299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:36.374299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:36.374299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:36.374299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:36.374299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:36.374299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:36.374299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:36.374299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:36.374299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:36.374299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:36.374299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:36.374299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:56:36.374299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:56:36.374299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:56:36.374299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:56:36.376473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:36.376473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:36.376473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:56:36.376473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:36.376473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:56:36.376473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:36.376473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:36.376473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:36.376473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:36.376473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:36.376473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:36.376473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:36.376473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:36.376473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:36.376473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:36.376473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:36.376473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:36.376473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:36.378807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:36.378807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:36.378807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:56:36.378807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:56:36.378807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:56:36.378807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:56:36.378807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:56:36.378807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:56:36.378807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 06:56:36.378807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:36.378807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 248/493] 10.222.0.40 () {56 vars in 1093 bytes} [Tue Aug 9 06:56:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:36.378807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0630d-4192-4827-9c3d-aa51e862b7c9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:36.387121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3f9bd-abc6-4e90-9c39-00f77992dfcd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:36.421232 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cb376-e431-41e3-9340-ed3865f7cbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:36.421888 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cb376-e431-41e3-9340-ed3865f7cbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:36.422170 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cb376-e431-41e3-9340-ed3865f7cbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:36.422444 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cb376-e431-41e3-9340-ed3865f7cbe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:36.433529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157cb376-e431-41e3-9340-ed3865f7cbe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:36.435702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:36.436577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157cb376-e431-41e3-9340-ed3865f7cbe8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:36.453611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-157cb376-e431-41e3-9340-ed3865f7cbe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:36.453611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:36.453611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:36.453611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:36.453611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:36.453611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:36.453611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:36.453611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:36.453611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:36.453611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:36.453611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:36.453611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:36.453611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:36.453611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:36.453611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:36.453611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:36.455010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:36.455010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:36.455010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:36.455010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:36.455010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:36.455010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:36.455010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:36.455010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:36.455010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:36.455010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:36.455010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:36.455010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:36.455010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:36.455010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:36.455010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:36.455010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:36.455010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:36.455950 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:36.455950 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:36.455950 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:36.462439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 246/494] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:36.463729 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cb376-e431-41e3-9340-ed3865f7cbe8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:36.483458 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0630d-4192-4827-9c3d-aa51e862b7c9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:36.520116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b9222-0294-40db-848e-7b60cd2b8e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:36.520843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b9222-0294-40db-848e-7b60cd2b8e7d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:36.521004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b9222-0294-40db-848e-7b60cd2b8e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:36.521269 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b9222-0294-40db-848e-7b60cd2b8e7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:36.532331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b9222-0294-40db-848e-7b60cd2b8e7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:36.537741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-cf2b9222-0294-40db-848e-7b60cd2b8e7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:36.537741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:36.537741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:36.537741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:36.537741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:36.537741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:36.537741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:36.537741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:36.537741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:36.537741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:36.537741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:36.537741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:36.537741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:36.537741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:36.537741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:36.537741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:36.538855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:36.538855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:36.538855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:36.538855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:36.538855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:36.538855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:36.538855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:36.538855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:36.538855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:36.538855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:36.538855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:36.538855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:36.538855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:36.538855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:36.538855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:36.538855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:36.539787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:36.539787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:36.539787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:36.539787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:36.539787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:36.539787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:36.539787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:36.539787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:36.539787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:36.539787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:36.539787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:36.539787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:36.543300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 249/495] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:56:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:36.544584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b9222-0294-40db-848e-7b60cd2b8e7d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:36.582355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cb376-e431-41e3-9340-ed3865f7cbe8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:36.603256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:36.620547 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050054ac-6641-45be-adec-69848acb7628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:36.621164 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050054ac-6641-45be-adec-69848acb7628 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:36.621442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050054ac-6641-45be-adec-69848acb7628 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:36.621782 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050054ac-6641-45be-adec-69848acb7628 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:36.622523 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050054ac-6641-45be-adec-69848acb7628 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:36.622811 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050054ac-6641-45be-adec-69848acb7628 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:36.624403 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050054ac-6641-45be-adec-69848acb7628 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:36.658383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b9222-0294-40db-848e-7b60cd2b8e7d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:36.669772 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 247/496] 10.222.0.40 () {56 vars in 1133 bytes} [Tue Aug 9 06:56:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:36.669772 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050054ac-6641-45be-adec-69848acb7628 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:36.679894 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:36.700215 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326e98f-d5f2-426c-a8ed-095271501495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:36.701001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326e98f-d5f2-426c-a8ed-095271501495 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:36.701277 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326e98f-d5f2-426c-a8ed-095271501495 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:36.701542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326e98f-d5f2-426c-a8ed-095271501495 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:36.702182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326e98f-d5f2-426c-a8ed-095271501495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:36.702476 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326e98f-d5f2-426c-a8ed-095271501495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:36.703860 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326e98f-d5f2-426c-a8ed-095271501495 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:36.716594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 250/497] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:36.717780 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61142905-a85d-4005-a8a8-5f58883ef1c4 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:36.718053 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61142905-a85d-4005-a8a8-5f58883ef1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:36.718315 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61142905-a85d-4005-a8a8-5f58883ef1c4 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:36.719681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 251/498] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:36.724434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61142905-a85d-4005-a8a8-5f58883ef1c4 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:36.779302 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050054ac-6641-45be-adec-69848acb7628 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:36.816903 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe47e8a-c38e-494d-92e9-4ba7750fabfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:36.817795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe47e8a-c38e-494d-92e9-4ba7750fabfa None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:36.818085 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe47e8a-c38e-494d-92e9-4ba7750fabfa None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:36.818355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe47e8a-c38e-494d-92e9-4ba7750fabfa None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:36.819015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe47e8a-c38e-494d-92e9-4ba7750fabfa None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:36.819345 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe47e8a-c38e-494d-92e9-4ba7750fabfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:36.820731 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe47e8a-c38e-494d-92e9-4ba7750fabfa None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:36.833478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 248/499] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:56:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:36.833478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe47e8a-c38e-494d-92e9-4ba7750fabfa None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:36.843867 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61142905-a85d-4005-a8a8-5f58883ef1c4 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:36.876787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:36.880685 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f50e4-9c8e-457a-9b2d-80d036aa80ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:36.881287 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f50e4-9c8e-457a-9b2d-80d036aa80ed None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:36.881564 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f50e4-9c8e-457a-9b2d-80d036aa80ed None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:36.881832 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f50e4-9c8e-457a-9b2d-80d036aa80ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:36.929664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:36.944250 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe47e8a-c38e-494d-92e9-4ba7750fabfa None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:36.954900 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f50e4-9c8e-457a-9b2d-80d036aa80ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:36.956381 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f50e4-9c8e-457a-9b2d-80d036aa80ed None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:36.977171 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b064ab1-d704-48aa-b8cf-b84254de4636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:36.977791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b064ab1-d704-48aa-b8cf-b84254de4636 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:36.978069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b064ab1-d704-48aa-b8cf-b84254de4636 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:36.978335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b064ab1-d704-48aa-b8cf-b84254de4636 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:36.985620 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b064ab1-d704-48aa-b8cf-b84254de4636 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:36.987260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b064ab1-d704-48aa-b8cf-b84254de4636 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:37.000489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7b064ab1-d704-48aa-b8cf-b84254de4636 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 06:56:37.000489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:37.000489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:37.000489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:37.000489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:37.000489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:37.000489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:37.000489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:37.000489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:37.000489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:37.000489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:37.000489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:37.000489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:56:37.000489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:56:37.000489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:56:37.000489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:56:37.001490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:37.001490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:37.001490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:56:37.001490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:37.001490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:56:37.001490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:37.001490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:37.001490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:37.001490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:37.001490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:37.001490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:37.001490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:37.001490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:37.001490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:37.001490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:37.001490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:37.001490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:37.001490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:37.002376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:37.002376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:37.002376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:56:37.002376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:56:37.002376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:56:37.002376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:56:37.002376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:56:37.002376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:56:37.002376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 06:56:37.002376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:37.002376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 249/500] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:37.003236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd63ca3-42f5-489a-a753-6a5675c01955 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:37.003236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd63ca3-42f5-489a-a753-6a5675c01955 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:37.003236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd63ca3-42f5-489a-a753-6a5675c01955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:37.021094 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9bd63ca3-42f5-489a-a753-6a5675c01955 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:37.022270 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9bd63ca3-42f5-489a-a753-6a5675c01955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:37.054850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 252/501] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:37.055704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f50e4-9c8e-457a-9b2d-80d036aa80ed None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:37.087168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 250/502] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:37.088405 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761e57f-ee7d-4150-8b61-9c47c0685326 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:37.088688 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761e57f-ee7d-4150-8b61-9c47c0685326 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:37.088960 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761e57f-ee7d-4150-8b61-9c47c0685326 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:37.090185 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 251/503] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:37.091443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761e57f-ee7d-4150-8b61-9c47c0685326 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:37.121067 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:37.141743 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:37.165457 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f50e4-9c8e-457a-9b2d-80d036aa80ed None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:37.191830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761e57f-ee7d-4150-8b61-9c47c0685326 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:37.200317 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4417c2-b210-43a4-8f07-9f27313ea6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:37.200881 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4417c2-b210-43a4-8f07-9f27313ea6ab None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:37.201160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4417c2-b210-43a4-8f07-9f27313ea6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:37.201430 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4417c2-b210-43a4-8f07-9f27313ea6ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:37.211450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4417c2-b210-43a4-8f07-9f27313ea6ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:37.212900 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4417c2-b210-43a4-8f07-9f27313ea6ab None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:37.226061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d526cfb-9daf-4ac8-9e1b-c4d21d3ee0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:37.226661 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d526cfb-9daf-4ac8-9e1b-c4d21d3ee0ce None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:37.226940 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d526cfb-9daf-4ac8-9e1b-c4d21d3ee0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:37.227265 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d526cfb-9daf-4ac8-9e1b-c4d21d3ee0ce None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:37.227450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-8e4417c2-b210-43a4-8f07-9f27313ea6ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:37.227450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:37.227450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:37.227450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:37.227450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:37.227450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:37.227450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:37.227450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:37.227450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:37.227450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:37.227450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:37.227450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:37.227450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:37.227450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:37.227450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:37.227450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:37.228432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:37.228432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:37.228432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:37.228432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:37.228432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:37.228432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:37.228432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:37.228432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:37.228432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:37.228432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:37.228432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:37.228432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:37.228432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:37.228432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:37.228432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:37.228432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:37.228432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:37.229293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:37.229293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:37.229293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:37.229464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d526cfb-9daf-4ac8-9e1b-c4d21d3ee0ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:37.229464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d526cfb-9daf-4ac8-9e1b-c4d21d3ee0ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:37.229598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 253/504] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:37.229598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4417c2-b210-43a4-8f07-9f27313ea6ab None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:37.229714 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d526cfb-9daf-4ac8-9e1b-c4d21d3ee0ce None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:37.250063 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 252/505] 10.222.0.40 () {56 vars in 1137 bytes} [Tue Aug 9 06:56:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:37.251280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe112da-4a36-4663-9135-d2debe1ca1fc None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:37.251559 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe112da-4a36-4663-9135-d2debe1ca1fc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:37.251826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe112da-4a36-4663-9135-d2debe1ca1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:37.268611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ebe112da-4a36-4663-9135-d2debe1ca1fc None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:37.269776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ebe112da-4a36-4663-9135-d2debe1ca1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:37.333604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4417c2-b210-43a4-8f07-9f27313ea6ab None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:37.336412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 253/506] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:37.337242 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe112da-4a36-4663-9135-d2debe1ca1fc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:37.355541 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:37.371332 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:37.379075 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88943e5b-a645-4519-a138-a51f0f0c56fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:37.379713 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88943e5b-a645-4519-a138-a51f0f0c56fc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:37.379985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88943e5b-a645-4519-a138-a51f0f0c56fc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:37.380251 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88943e5b-a645-4519-a138-a51f0f0c56fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:37.391873 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88943e5b-a645-4519-a138-a51f0f0c56fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:37.393391 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88943e5b-a645-4519-a138-a51f0f0c56fc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:37.407239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-88943e5b-a645-4519-a138-a51f0f0c56fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:37.407239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:37.407239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:37.407239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:37.407239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:37.407239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:37.407239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:37.407239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:37.407239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:37.407239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:37.407239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:37.407239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:37.407239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:37.407239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:37.407239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:37.407239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:37.408152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:37.408152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:37.408152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:37.408152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:37.408152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:37.408152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:37.408152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:37.408152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:37.408152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:37.408152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:37.408152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:37.408152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:37.408152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:37.408152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:37.408152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:37.408152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:37.408152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:37.409051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:37.409051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:37.409051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:37.409051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 254/507] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:37.409051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88943e5b-a645-4519-a138-a51f0f0c56fc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:37.439600 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe112da-4a36-4663-9135-d2debe1ca1fc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:37.472758 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16e39f-4721-42e1-b751-7e5a6a5b6dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:37.473463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16e39f-4721-42e1-b751-7e5a6a5b6dde None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:37.473649 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16e39f-4721-42e1-b751-7e5a6a5b6dde None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:37.473915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16e39f-4721-42e1-b751-7e5a6a5b6dde None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:37.484415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16e39f-4721-42e1-b751-7e5a6a5b6dde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:37.489012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-bc16e39f-4721-42e1-b751-7e5a6a5b6dde None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:37.489012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:37.489012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:37.489012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:37.489012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:37.489012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:37.489012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:37.489012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:37.489012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:37.489012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:37.489012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:37.489012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:37.489012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:37.489012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:37.489012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:37.489012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:37.489914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:37.489914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:37.489914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:37.489914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:37.489914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:37.489914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:37.489914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:37.489914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:37.489914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:37.489914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:37.489914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:37.489914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:37.489914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:37.489914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:37.489914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:37.489914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:37.490701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:37.490701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:37.490701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:37.490701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:37.490701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:37.490701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:37.490701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:37.490701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:37.490701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:37.490701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:37.490701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:37.490701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:37.490701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 254/508] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:56:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:37.491565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16e39f-4721-42e1-b751-7e5a6a5b6dde None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:37.512238 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88943e5b-a645-4519-a138-a51f0f0c56fc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:37.544593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f78e2-2c4b-4c02-8076-1635ea90aaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:37.545187 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f78e2-2c4b-4c02-8076-1635ea90aaf5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:37.545464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f78e2-2c4b-4c02-8076-1635ea90aaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:37.545734 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f78e2-2c4b-4c02-8076-1635ea90aaf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:37.546626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f78e2-2c4b-4c02-8076-1635ea90aaf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:37.546732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f78e2-2c4b-4c02-8076-1635ea90aaf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:37.548043 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f78e2-2c4b-4c02-8076-1635ea90aaf5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:37.564276 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 255/509] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:37.564276 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f78e2-2c4b-4c02-8076-1635ea90aaf5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:37.568276 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:37.590116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16e39f-4721-42e1-b751-7e5a6a5b6dde None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:37.603612 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:37.624749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44246a-2d0c-4674-94f0-64ed1034af8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:37.625353 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44246a-2d0c-4674-94f0-64ed1034af8d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:37.625734 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44246a-2d0c-4674-94f0-64ed1034af8d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:37.625895 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44246a-2d0c-4674-94f0-64ed1034af8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:37.664787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f78e2-2c4b-4c02-8076-1635ea90aaf5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:37.693761 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44246a-2d0c-4674-94f0-64ed1034af8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:37.695272 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44246a-2d0c-4674-94f0-64ed1034af8d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:37.697454 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313647c-6920-4c20-abe4-ddefbf6a8b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:37.698072 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313647c-6920-4c20-abe4-ddefbf6a8b9a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:37.698346 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313647c-6920-4c20-abe4-ddefbf6a8b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:37.698612 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313647c-6920-4c20-abe4-ddefbf6a8b9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:37.709820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313647c-6920-4c20-abe4-ddefbf6a8b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:37.711266 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313647c-6920-4c20-abe4-ddefbf6a8b9a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:37.725828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f313647c-6920-4c20-abe4-ddefbf6a8b9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:37.725828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:37.725828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:37.725828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:37.725828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:37.725828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:37.725828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:37.725828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:37.725828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:37.725828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:37.725828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:37.725828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:37.725828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:37.725828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:37.725828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:37.725828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:37.726829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:37.726829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:37.726829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:37.726829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:37.726829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:37.726829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:37.726829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:37.726829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:37.726829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:37.726829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:37.726829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:37.726829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:37.726829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:37.726829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:37.726829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:37.726829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:37.726829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:37.727729 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:37.727729 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:37.727729 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:37.732324 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 256/510] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:37.732776 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313647c-6920-4c20-abe4-ddefbf6a8b9a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:37.770787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:37.793379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 255/511] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:37.794230 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44246a-2d0c-4674-94f0-64ed1034af8d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:37.830041 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:37.838863 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313647c-6920-4c20-abe4-ddefbf6a8b9a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:37.870841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8953f1-397f-4ac0-8f1c-e6c799e86218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:37.871462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8953f1-397f-4ac0-8f1c-e6c799e86218 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:37.872415 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8953f1-397f-4ac0-8f1c-e6c799e86218 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:37.872791 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8953f1-397f-4ac0-8f1c-e6c799e86218 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:37.873442 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8953f1-397f-4ac0-8f1c-e6c799e86218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:37.873744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8953f1-397f-4ac0-8f1c-e6c799e86218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:37.875104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8953f1-397f-4ac0-8f1c-e6c799e86218 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:37.886370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 257/512] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:37.887191 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8953f1-397f-4ac0-8f1c-e6c799e86218 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:37.890931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44246a-2d0c-4674-94f0-64ed1034af8d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:37.923712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62344864-9210-4bcf-a6c5-e0a9412aba74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:37.924316 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62344864-9210-4bcf-a6c5-e0a9412aba74 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:37.924596 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62344864-9210-4bcf-a6c5-e0a9412aba74 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:37.924866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62344864-9210-4bcf-a6c5-e0a9412aba74 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:37.925520 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62344864-9210-4bcf-a6c5-e0a9412aba74 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:37.925830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62344864-9210-4bcf-a6c5-e0a9412aba74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:37.927206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62344864-9210-4bcf-a6c5-e0a9412aba74 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:37.935412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 256/513] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:56:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:37.936188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62344864-9210-4bcf-a6c5-e0a9412aba74 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:37.975658 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:37.988779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8953f1-397f-4ac0-8f1c-e6c799e86218 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:38.023405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c645b1-7b32-40e5-9881-b824d659e765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:38.024031 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c645b1-7b32-40e5-9881-b824d659e765 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:38.024310 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c645b1-7b32-40e5-9881-b824d659e765 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:38.024581 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c645b1-7b32-40e5-9881-b824d659e765 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:38.031466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c645b1-7b32-40e5-9881-b824d659e765 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:38.032887 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c645b1-7b32-40e5-9881-b824d659e765 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:38.034063 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62344864-9210-4bcf-a6c5-e0a9412aba74 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:38.045731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-39c645b1-7b32-40e5-9881-b824d659e765 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 06:56:38.045731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:38.045731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:38.045731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:38.045731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:38.045731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:38.045731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:38.045731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:38.045731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:38.045731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:38.045731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:38.045731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:38.045731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:56:38.045731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:56:38.045731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:56:38.045731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:56:38.046655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:38.046655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:38.046655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:56:38.046655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:38.046655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:56:38.046655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:38.046655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:38.046655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:38.046655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:38.046655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:38.046655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:38.046655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:38.046655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:38.046655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:38.046655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:38.046655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:38.046655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:38.046655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:38.047620 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:38.047620 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:38.047620 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:56:38.047620 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:56:38.047620 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:56:38.047620 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:56:38.047620 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:56:38.047620 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:56:38.047620 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 06:56:38.047620 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:38.047620 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 258/514] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:38.048200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c645b1-7b32-40e5-9881-b824d659e765 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:38.061848 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:38.073519 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242b65d-7b49-4baa-9d43-cf8a5d4c9695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:38.074124 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242b65d-7b49-4baa-9d43-cf8a5d4c9695 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:38.074406 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242b65d-7b49-4baa-9d43-cf8a5d4c9695 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:38.075270 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242b65d-7b49-4baa-9d43-cf8a5d4c9695 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:38.076059 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242b65d-7b49-4baa-9d43-cf8a5d4c9695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:38.076447 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242b65d-7b49-4baa-9d43-cf8a5d4c9695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:38.077759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242b65d-7b49-4baa-9d43-cf8a5d4c9695 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:38.089448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 257/515] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:38.090231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242b65d-7b49-4baa-9d43-cf8a5d4c9695 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:38.145606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c645b1-7b32-40e5-9881-b824d659e765 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:38.178676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f6ccd-8fb8-4d9e-9e40-331332dc75ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:38.179316 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f6ccd-8fb8-4d9e-9e40-331332dc75ab None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:38.179596 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f6ccd-8fb8-4d9e-9e40-331332dc75ab None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:38.179868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f6ccd-8fb8-4d9e-9e40-331332dc75ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:38.183795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:38.187418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242b65d-7b49-4baa-9d43-cf8a5d4c9695 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:38.190744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f6ccd-8fb8-4d9e-9e40-331332dc75ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:38.192216 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f6ccd-8fb8-4d9e-9e40-331332dc75ab None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:38.206494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-a79f6ccd-8fb8-4d9e-9e40-331332dc75ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:38.206494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:38.206494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:38.206494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:38.206494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:38.206494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:38.206494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:38.206494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:38.206494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:38.206494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:38.206494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:38.206494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:38.206494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:38.206494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:38.206494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:38.206494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:38.207473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:38.207473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:38.207473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:38.207473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:38.207473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:38.207473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:38.207473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:38.207473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:38.207473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:38.207473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:38.207473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:38.207473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:38.207473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:38.207473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:38.207473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:38.207473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:38.207473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:38.208340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:38.208340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:38.208340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:38.208340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 259/516] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:38.208340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f6ccd-8fb8-4d9e-9e40-331332dc75ab None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:38.223944 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc75568-b7e1-45eb-be0c-1665e2254f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:38.224572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc75568-b7e1-45eb-be0c-1665e2254f72 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:38.224839 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc75568-b7e1-45eb-be0c-1665e2254f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:38.225102 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc75568-b7e1-45eb-be0c-1665e2254f72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:38.232345 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc75568-b7e1-45eb-be0c-1665e2254f72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:38.233764 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc75568-b7e1-45eb-be0c-1665e2254f72 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:38.245260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-edc75568-b7e1-45eb-be0c-1665e2254f72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:38.245260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:38.245260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:38.245260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:38.245260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:38.245260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:38.245260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:38.245260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:38.245260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:38.245260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:38.245260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:38.245260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:38.245260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:56:38.245260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:56:38.245260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:56:38.246092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:56:38.246092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:38.246092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:38.246092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:38.246092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:38.246092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:38.246092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:38.246092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:38.246092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:38.246092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:38.246092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:38.246092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:38.246092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:38.246092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:38.246092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:38.246092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:38.246092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:38.247981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:56:38.247981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:56:38.247981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:56:38.247981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:56:38.247981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:56:38.247981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:56:38.247981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:38.247981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:38.247981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 258/517] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:38.247981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc75568-b7e1-45eb-be0c-1665e2254f72 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:38.279983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:38.318157 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f6ccd-8fb8-4d9e-9e40-331332dc75ab None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:38.344999 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc75568-b7e1-45eb-be0c-1665e2254f72 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:38.350633 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ef99c-c24c-4791-808a-6ce5f935d892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:38.351280 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ef99c-c24c-4791-808a-6ce5f935d892 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:38.351559 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ef99c-c24c-4791-808a-6ce5f935d892 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:38.351829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ef99c-c24c-4791-808a-6ce5f935d892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:38.362772 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ef99c-c24c-4791-808a-6ce5f935d892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:38.364242 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ef99c-c24c-4791-808a-6ce5f935d892 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:38.377396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec387a-df8f-4b68-be58-2e46039f1e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:38.377767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-7c6ef99c-c24c-4791-808a-6ce5f935d892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:38.377767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:38.377767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:38.377767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:38.377767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:38.377767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:38.377767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:38.377767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:38.377767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:38.377767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:38.377767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:38.377767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:38.377767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:38.377767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:38.377767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:38.377767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:38.378755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:38.378755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:38.378755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:38.378755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:38.378755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:38.378755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:38.378755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:38.378755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:38.378755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:38.378755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:38.378755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:38.378755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:38.378755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:38.378755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:38.378755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:38.378755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:38.378755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:38.379655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:38.379655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:38.379655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:38.379818 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec387a-df8f-4b68-be58-2e46039f1e48 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:38.379818 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec387a-df8f-4b68-be58-2e46039f1e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:38.379818 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec387a-df8f-4b68-be58-2e46039f1e48 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:38.380009 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 260/518] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:38.380009 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ef99c-c24c-4791-808a-6ce5f935d892 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:38.383538 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec387a-df8f-4b68-be58-2e46039f1e48 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:38.383858 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec387a-df8f-4b68-be58-2e46039f1e48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:38.385302 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec387a-df8f-4b68-be58-2e46039f1e48 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:38.403211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 259/519] 10.222.0.40 () {56 vars in 1137 bytes} [Tue Aug 9 06:56:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:38.404206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec387a-df8f-4b68-be58-2e46039f1e48 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:38.425181 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:38.477761 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ef99c-c24c-4791-808a-6ce5f935d892 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:38.493576 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:38.510031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec387a-df8f-4b68-be58-2e46039f1e48 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:38.513285 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479bfc6-de12-47d1-a2f6-92f7721820d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:38.513882 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479bfc6-de12-47d1-a2f6-92f7721820d6 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:38.514159 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479bfc6-de12-47d1-a2f6-92f7721820d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:38.514430 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479bfc6-de12-47d1-a2f6-92f7721820d6 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:38.515064 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479bfc6-de12-47d1-a2f6-92f7721820d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:38.516500 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479bfc6-de12-47d1-a2f6-92f7721820d6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:38.538356 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 261/520] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Aug 9 06:56:38 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:56:38.539249 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479bfc6-de12-47d1-a2f6-92f7721820d6 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:38.544134 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594d890-0f52-4cb5-8c08-3ca323a095df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:38.544943 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594d890-0f52-4cb5-8c08-3ca323a095df None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:38.545306 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594d890-0f52-4cb5-8c08-3ca323a095df None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:38.545636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594d890-0f52-4cb5-8c08-3ca323a095df None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:38.546357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594d890-0f52-4cb5-8c08-3ca323a095df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:38.546724 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594d890-0f52-4cb5-8c08-3ca323a095df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:38.548213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594d890-0f52-4cb5-8c08-3ca323a095df None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:38.560869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 260/521] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:38.566330 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594d890-0f52-4cb5-8c08-3ca323a095df None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:38.664579 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:38.680908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479bfc6-de12-47d1-a2f6-92f7721820d6 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:38.691211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594d890-0f52-4cb5-8c08-3ca323a095df None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:38.725175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fb028-1a3e-44a3-afa8-dd0ab2700afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:38.725919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fb028-1a3e-44a3-afa8-dd0ab2700afc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:38.726819 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fb028-1a3e-44a3-afa8-dd0ab2700afc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:38.727233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fb028-1a3e-44a3-afa8-dd0ab2700afc None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:38.728390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9fb028-1a3e-44a3-afa8-dd0ab2700afc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:38.728390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9fb028-1a3e-44a3-afa8-dd0ab2700afc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:38.730652 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5502a1-abab-44d8-8efd-72e210dc0b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:38.730801 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9fb028-1a3e-44a3-afa8-dd0ab2700afc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:38.730941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5502a1-abab-44d8-8efd-72e210dc0b1a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:38.731397 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5502a1-abab-44d8-8efd-72e210dc0b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:38.732565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5502a1-abab-44d8-8efd-72e210dc0b1a None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:38.734906 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5502a1-abab-44d8-8efd-72e210dc0b1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:38.734906 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5502a1-abab-44d8-8efd-72e210dc0b1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:38.736500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5502a1-abab-44d8-8efd-72e210dc0b1a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:38.751352 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 261/522] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:38.752268 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5502a1-abab-44d8-8efd-72e210dc0b1a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:38.753276 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 262/523] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:56:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:38.754311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fb028-1a3e-44a3-afa8-dd0ab2700afc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:38.788311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:38.860903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fb028-1a3e-44a3-afa8-dd0ab2700afc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:38.871327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5502a1-abab-44d8-8efd-72e210dc0b1a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:38.897000 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f865f-dfb9-4f69-bbfb-82148491604c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:38.897651 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f865f-dfb9-4f69-bbfb-82148491604c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:38.897927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f865f-dfb9-4f69-bbfb-82148491604c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:38.898196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f865f-dfb9-4f69-bbfb-82148491604c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:38.905514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f865f-dfb9-4f69-bbfb-82148491604c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:38.906952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f865f-dfb9-4f69-bbfb-82148491604c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:38.914143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4898cd3-3490-4cb4-95d8-1cec2a9ceecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:38.914875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4898cd3-3490-4cb4-95d8-1cec2a9ceecb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:38.915363 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4898cd3-3490-4cb4-95d8-1cec2a9ceecb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:38.915753 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4898cd3-3490-4cb4-95d8-1cec2a9ceecb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:38.919019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-008f865f-dfb9-4f69-bbfb-82148491604c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:38.919019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:38.919019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:38.919019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:38.919019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:38.919019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:38.919019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:38.919019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:38.919019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:38.919019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:38.919019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:38.919019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:38.919019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:56:38.919019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:56:38.919019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:56:38.920167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:56:38.920167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:38.920167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:38.920167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:38.920167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:38.920167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:38.920167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:38.920167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:38.920167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:38.920167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:38.920167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:38.920167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:38.920167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:38.920167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:38.920167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:38.920167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:38.920167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:38.921145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:56:38.921145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:56:38.921145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:56:38.921145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:56:38.921145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:56:38.921145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:56:38.921145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:38.921145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:38.921145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 263/524] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:38.921862 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f865f-dfb9-4f69-bbfb-82148491604c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:38.932163 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:38.996265 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4898cd3-3490-4cb4-95d8-1cec2a9ceecb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:38.998869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4898cd3-3490-4cb4-95d8-1cec2a9ceecb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:39.019750 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:39.028652 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f865f-dfb9-4f69-bbfb-82148491604c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:39.066614 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ece7a4-f940-419b-abc9-e7cc17a41e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:39.067180 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ece7a4-f940-419b-abc9-e7cc17a41e57 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:39.067456 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ece7a4-f940-419b-abc9-e7cc17a41e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:39.067722 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ece7a4-f940-419b-abc9-e7cc17a41e57 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:39.075435 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ece7a4-f940-419b-abc9-e7cc17a41e57 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:39.076866 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ece7a4-f940-419b-abc9-e7cc17a41e57 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:39.089855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-22ece7a4-f940-419b-abc9-e7cc17a41e57 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 06:56:39.089855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:39.089855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:39.089855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:39.089855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:39.089855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:39.089855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:39.089855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:39.089855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:39.089855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:39.089855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:39.089855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:39.089855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:56:39.089855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:56:39.089855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:56:39.089855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:56:39.091547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:39.091547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:39.091547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:56:39.091547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:39.091547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:56:39.091547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:39.091547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:39.091547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:39.091547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:39.091547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:39.091547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:39.091547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:39.091547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:39.091547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:39.091547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:39.091547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:39.091547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:39.091547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:39.092720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:39.092720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:39.092720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:56:39.092720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:56:39.092720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:56:39.092720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:56:39.092720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:56:39.092720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:56:39.092720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 06:56:39.092720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:39.093767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 264/525] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:56:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:39.094297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ece7a4-f940-419b-abc9-e7cc17a41e57 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:39.111948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 262/526] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:39.112878 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4898cd3-3490-4cb4-95d8-1cec2a9ceecb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:39.160412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:39.204858 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ece7a4-f940-419b-abc9-e7cc17a41e57 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:39.226383 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4898cd3-3490-4cb4-95d8-1cec2a9ceecb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:39.239815 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d1b93-8d1d-4d50-855c-89ca556d29fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:39.240402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d1b93-8d1d-4d50-855c-89ca556d29fc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:39.240675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d1b93-8d1d-4d50-855c-89ca556d29fc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:39.240944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d1b93-8d1d-4d50-855c-89ca556d29fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:39.241759 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d1b93-8d1d-4d50-855c-89ca556d29fc None admin] RBAC: Adding query filter params (role.id=b93b6b2c6da44593a6b95db1309b8a58, scope.project.id=342524b45def418783374ff6733e94b9, user.id=6e949d9666be44a0b6122d510168c7ab) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:39.241962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d1b93-8d1d-4d50-855c-89ca556d29fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:39.243387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d1b93-8d1d-4d50-855c-89ca556d29fc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:39.250273 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 265/527] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:56:39 2022] GET /identity/v3/role_assignments?user.id=6e949d9666be44a0b6122d510168c7ab&scope.project.id=342524b45def418783374ff6733e94b9&role.id=b93b6b2c6da44593a6b95db1309b8a58 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:39.251077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d1b93-8d1d-4d50-855c-89ca556d29fc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:39.273410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3233033-3596-4dd5-a370-2b96f8ee4711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:39.274634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:39.275202 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3233033-3596-4dd5-a370-2b96f8ee4711 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:39.276740 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3233033-3596-4dd5-a370-2b96f8ee4711 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:39.277251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3233033-3596-4dd5-a370-2b96f8ee4711 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:39.279040 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3233033-3596-4dd5-a370-2b96f8ee4711 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:39.280499 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3233033-3596-4dd5-a370-2b96f8ee4711 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:39.282760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3233033-3596-4dd5-a370-2b96f8ee4711 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:39.311319 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 263/528] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:56:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:39.312707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3233033-3596-4dd5-a370-2b96f8ee4711 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:39.387665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d1b93-8d1d-4d50-855c-89ca556d29fc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:39.436094 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ec344-a044-4eb9-84bc-2d588e8a2493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:39.437190 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ec344-a044-4eb9-84bc-2d588e8a2493 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:39.437540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ec344-a044-4eb9-84bc-2d588e8a2493 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:39.437877 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ec344-a044-4eb9-84bc-2d588e8a2493 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:39.438985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ec344-a044-4eb9-84bc-2d588e8a2493 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:39.439391 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ec344-a044-4eb9-84bc-2d588e8a2493 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:39.441737 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ec344-a044-4eb9-84bc-2d588e8a2493 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:39.448970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:39.453521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3233033-3596-4dd5-a370-2b96f8ee4711 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:39.502193 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2cb44-1a44-4f64-ba9c-5e62013a6133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:39.502193 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2cb44-1a44-4f64-ba9c-5e62013a6133 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:39.502193 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2cb44-1a44-4f64-ba9c-5e62013a6133 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:39.502193 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2cb44-1a44-4f64-ba9c-5e62013a6133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:39.502938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 266/529] 10.222.0.40 () {56 vars in 1139 bytes} [Tue Aug 9 06:56:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:39.504452 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ec344-a044-4eb9-84bc-2d588e8a2493 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:39.513864 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2cb44-1a44-4f64-ba9c-5e62013a6133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:39.516094 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2cb44-1a44-4f64-ba9c-5e62013a6133 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:39.538357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8ae2cb44-1a44-4f64-ba9c-5e62013a6133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:39.538357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:39.538357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:39.538357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:39.538357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:39.538357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:39.538357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:39.538357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:39.538357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:39.538357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:39.538357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:39.538357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:39.538357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:39.538357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:39.538357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:39.538357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:39.539573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:39.539573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:39.539573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:39.539573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:39.539573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:39.539573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:39.539573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:39.539573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:39.539573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:39.539573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:39.539573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:39.539573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:39.539573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:39.539573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:39.539573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:39.539573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:39.539573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:39.540615 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:39.540615 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:39.540615 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:39.546499 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 264/530] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:39.546499 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2cb44-1a44-4f64-ba9c-5e62013a6133 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:39.604594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:39.642323 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ec344-a044-4eb9-84bc-2d588e8a2493 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:39.656541 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2cb44-1a44-4f64-ba9c-5e62013a6133 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:39.679793 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0487f88-087d-4ada-9eb2-a9ade8ea2227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:39.680427 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487f88-087d-4ada-9eb2-a9ade8ea2227 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:39.680702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487f88-087d-4ada-9eb2-a9ade8ea2227 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:39.680993 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487f88-087d-4ada-9eb2-a9ade8ea2227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:39.681887 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0487f88-087d-4ada-9eb2-a9ade8ea2227 None admin] RBAC: Adding query filter params (role.id=b93b6b2c6da44593a6b95db1309b8a58, scope.project.id=342524b45def418783374ff6733e94b9, user.id=e44c764958784616b8bdbf59e5692ca6) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:39.682195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0487f88-087d-4ada-9eb2-a9ade8ea2227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:39.683687 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0487f88-087d-4ada-9eb2-a9ade8ea2227 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:39.690447 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 267/531] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:56:39 2022] GET /identity/v3/role_assignments?user.id=e44c764958784616b8bdbf59e5692ca6&scope.project.id=342524b45def418783374ff6733e94b9&role.id=b93b6b2c6da44593a6b95db1309b8a58 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:39.691304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0487f88-087d-4ada-9eb2-a9ade8ea2227 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:39.707138 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff122c-43eb-46bb-8b42-98cf19201494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:39.707798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff122c-43eb-46bb-8b42-98cf19201494 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:39.708073 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff122c-43eb-46bb-8b42-98cf19201494 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:39.708340 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff122c-43eb-46bb-8b42-98cf19201494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:39.744774 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:39.816201 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0487f88-087d-4ada-9eb2-a9ade8ea2227 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:39.857860 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474ffdf-a6f6-488b-8f7d-8125f0faf224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:39.858484 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474ffdf-a6f6-488b-8f7d-8125f0faf224 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:39.858761 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474ffdf-a6f6-488b-8f7d-8125f0faf224 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:39.859030 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474ffdf-a6f6-488b-8f7d-8125f0faf224 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:39.859728 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474ffdf-a6f6-488b-8f7d-8125f0faf224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:39.860031 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474ffdf-a6f6-488b-8f7d-8125f0faf224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:39.861399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474ffdf-a6f6-488b-8f7d-8125f0faf224 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:39.869206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:39.877488 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 268/532] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:39.879768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff122c-43eb-46bb-8b42-98cf19201494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:39.881235 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff122c-43eb-46bb-8b42-98cf19201494 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:39.883206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474ffdf-a6f6-488b-8f7d-8125f0faf224 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:40.008571 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474ffdf-a6f6-488b-8f7d-8125f0faf224 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:40.049103 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c400e7-a4ba-49ab-b01f-ba14f11d3dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:40.049765 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c400e7-a4ba-49ab-b01f-ba14f11d3dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:40.050259 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c400e7-a4ba-49ab-b01f-ba14f11d3dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:40.050529 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c400e7-a4ba-49ab-b01f-ba14f11d3dd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:40.061213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c400e7-a4ba-49ab-b01f-ba14f11d3dd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:40.062908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c400e7-a4ba-49ab-b01f-ba14f11d3dd9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:40.076714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-11c400e7-a4ba-49ab-b01f-ba14f11d3dd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:40.076714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:40.076714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:40.076714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:40.076714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:40.076714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:40.076714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:40.076714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:40.076714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:40.076714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:40.076714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:40.076714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:40.076714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:56:40.076714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:56:40.076714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:56:40.077593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:56:40.077593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:40.077593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:40.077593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:40.077593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:40.077593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:40.077593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:40.077593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:40.077593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:40.077593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:40.077593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:40.077593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:40.077593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:40.077593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:40.077593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:40.077593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:40.077593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:40.078455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:56:40.078455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:56:40.078455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:56:40.078455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:56:40.078455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:56:40.078455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:56:40.078455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:40.078455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:40.083471 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 269/533] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:56:40.084941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c400e7-a4ba-49ab-b01f-ba14f11d3dd9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:40.149186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:40.178400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 265/534] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:40.192321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff122c-43eb-46bb-8b42-98cf19201494 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:40.200379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c400e7-a4ba-49ab-b01f-ba14f11d3dd9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:40.238871 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5821d3-8c88-4233-a720-1feb13af7db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:40.240288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5821d3-8c88-4233-a720-1feb13af7db4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:40.240739 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5821d3-8c88-4233-a720-1feb13af7db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:40.241146 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5821d3-8c88-4233-a720-1feb13af7db4 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:40.241987 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5821d3-8c88-4233-a720-1feb13af7db4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:40.242430 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5821d3-8c88-4233-a720-1feb13af7db4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:40.244188 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5821d3-8c88-4233-a720-1feb13af7db4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:40.263383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 270/535] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:56:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:40.265697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5821d3-8c88-4233-a720-1feb13af7db4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:40.303030 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:40.375104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5821d3-8c88-4233-a720-1feb13af7db4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:40.398016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:40.412760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f816cb1-cfe3-419c-9086-82611f8bc307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:40.413688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f816cb1-cfe3-419c-9086-82611f8bc307 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:40.414122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f816cb1-cfe3-419c-9086-82611f8bc307 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:40.414551 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f816cb1-cfe3-419c-9086-82611f8bc307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:40.415431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f816cb1-cfe3-419c-9086-82611f8bc307 None admin] RBAC: Adding query filter params (role.id=b93b6b2c6da44593a6b95db1309b8a58, scope.project.id=342524b45def418783374ff6733e94b9, user.id=8977d7479b3e405c976fa1a570987704) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:40.415918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f816cb1-cfe3-419c-9086-82611f8bc307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:40.417450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f816cb1-cfe3-419c-9086-82611f8bc307 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:40.427351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 271/536] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:56:40 2022] GET /identity/v3/role_assignments?user.id=8977d7479b3e405c976fa1a570987704&scope.project.id=342524b45def418783374ff6733e94b9&role.id=b93b6b2c6da44593a6b95db1309b8a58 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:40.429901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff122c-43eb-46bb-8b42-98cf19201494 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:40.481123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126d05c-698a-4ac6-8083-92fdc554cd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:40.481809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126d05c-698a-4ac6-8083-92fdc554cd57 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:40.482087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126d05c-698a-4ac6-8083-92fdc554cd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:40.482362 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126d05c-698a-4ac6-8083-92fdc554cd57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:40.493617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126d05c-698a-4ac6-8083-92fdc554cd57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:40.495113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126d05c-698a-4ac6-8083-92fdc554cd57 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:40.510889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-4126d05c-698a-4ac6-8083-92fdc554cd57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:40.510889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:40.510889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:40.510889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:40.510889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:40.510889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:40.510889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:40.510889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:40.510889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:40.510889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:40.510889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:40.510889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:40.510889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:40.510889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:40.510889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:40.510889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:40.511901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:40.511901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:40.511901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:40.511901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:40.511901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:40.511901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:40.511901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:40.511901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:40.511901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:40.511901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:40.511901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:40.511901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:40.511901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:40.511901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:40.511901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:40.511901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:40.511901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:40.513838 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:40.513838 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:40.513838 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:40.513838 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 266/537] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:56:40.520130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f816cb1-cfe3-419c-9086-82611f8bc307 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:40.672811 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f816cb1-cfe3-419c-9086-82611f8bc307 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:40.708790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78b304-d00e-43e6-a681-bef754443004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:40.709391 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78b304-d00e-43e6-a681-bef754443004 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:40.709665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78b304-d00e-43e6-a681-bef754443004 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:40.709931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78b304-d00e-43e6-a681-bef754443004 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:40.710567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78b304-d00e-43e6-a681-bef754443004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:40.710864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78b304-d00e-43e6-a681-bef754443004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:40.712285 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78b304-d00e-43e6-a681-bef754443004 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:40.728117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 272/538] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:40.730331 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126d05c-698a-4ac6-8083-92fdc554cd57 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:40.743433 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdc59b-fb7f-46da-9cef-686c26b68b69 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:40.743714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdc59b-fb7f-46da-9cef-686c26b68b69 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:40.743979 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdc59b-fb7f-46da-9cef-686c26b68b69 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:40.750909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 273/539] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:56:40.752429 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4aa3d-fee2-43b9-8d36-4c6909f1fcd5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:40.752705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4aa3d-fee2-43b9-8d36-4c6909f1fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:40.752979 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4aa3d-fee2-43b9-8d36-4c6909f1fcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:40.784216 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2ff4aa3d-fee2-43b9-8d36-4c6909f1fcd5 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:40.786510 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2ff4aa3d-fee2-43b9-8d36-4c6909f1fcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:40.858085 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:40.923363 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126d05c-698a-4ac6-8083-92fdc554cd57 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:40.925464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:40.948515 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 274/540] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:56:40.976896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6c346-126f-4ecc-bb02-a2a88a04706a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:40.977529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6c346-126f-4ecc-bb02-a2a88a04706a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:40.977806 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6c346-126f-4ecc-bb02-a2a88a04706a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:40.978075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6c346-126f-4ecc-bb02-a2a88a04706a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:40.992231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6c346-126f-4ecc-bb02-a2a88a04706a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:40.993810 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6c346-126f-4ecc-bb02-a2a88a04706a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:41.006937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-85b6c346-126f-4ecc-bb02-a2a88a04706a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:41.006937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:41.006937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:41.006937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:41.006937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:41.006937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:41.006937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:41.006937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:41.006937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:41.006937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:41.006937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:41.006937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:41.006937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:56:41.006937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:56:41.006937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:56:41.007851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:56:41.007851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:41.007851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:41.007851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:41.007851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:41.007851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:41.007851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:41.007851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:41.007851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:41.007851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:41.007851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:41.007851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:41.007851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:41.007851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:41.007851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:41.007851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:41.007851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:41.008715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:56:41.008715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:56:41.008715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:56:41.008715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:56:41.008715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:56:41.008715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:56:41.008715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:41.008715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:41.011265 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 267/541] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:41.015828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4aa3d-fee2-43b9-8d36-4c6909f1fcd5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:41.020114 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6c346-126f-4ecc-bb02-a2a88a04706a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:41.144091 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4aa3d-fee2-43b9-8d36-4c6909f1fcd5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:41.183393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b1ad9-779f-4a2b-8ebb-b1536850989b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:41.184032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b1ad9-779f-4a2b-8ebb-b1536850989b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:41.184454 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b1ad9-779f-4a2b-8ebb-b1536850989b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:41.184953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b1ad9-779f-4a2b-8ebb-b1536850989b None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:41.185958 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b1ad9-779f-4a2b-8ebb-b1536850989b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:41.186318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b1ad9-779f-4a2b-8ebb-b1536850989b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:41.187769 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b1ad9-779f-4a2b-8ebb-b1536850989b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:41.205560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 275/542] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:56:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:41.208151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b1ad9-779f-4a2b-8ebb-b1536850989b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:41.247738 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:41.281368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6c346-126f-4ecc-bb02-a2a88a04706a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:41.330143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b1ad9-779f-4a2b-8ebb-b1536850989b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:41.368047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de14fed-e25d-48be-9b58-df3a4a5c2cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:41.368650 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de14fed-e25d-48be-9b58-df3a4a5c2cad None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:41.368926 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de14fed-e25d-48be-9b58-df3a4a5c2cad None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:41.369198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de14fed-e25d-48be-9b58-df3a4a5c2cad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:41.369919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de14fed-e25d-48be-9b58-df3a4a5c2cad None admin] RBAC: Adding query filter params (role.id=b93b6b2c6da44593a6b95db1309b8a58, scope.project.id=342524b45def418783374ff6733e94b9, user.id=8d75da9360ef490f910fabc3920c8ad0) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:41.370228 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de14fed-e25d-48be-9b58-df3a4a5c2cad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:41.370939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75eefa9-4dd4-4815-b338-15d9bf5b3b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:41.372306 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de14fed-e25d-48be-9b58-df3a4a5c2cad None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:41.372691 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75eefa9-4dd4-4815-b338-15d9bf5b3b35 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:41.373178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75eefa9-4dd4-4815-b338-15d9bf5b3b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:41.373647 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75eefa9-4dd4-4815-b338-15d9bf5b3b35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:41.382420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 276/543] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:56:41 2022] GET /identity/v3/role_assignments?user.id=8d75da9360ef490f910fabc3920c8ad0&scope.project.id=342524b45def418783374ff6733e94b9&role.id=b93b6b2c6da44593a6b95db1309b8a58 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:41.404982 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75eefa9-4dd4-4815-b338-15d9bf5b3b35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:41.411435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c75eefa9-4dd4-4815-b338-15d9bf5b3b35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:41.411435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:41.411435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:41.411435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:41.411435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:41.411435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:41.411435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:41.411435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:41.411435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:41.411435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:41.411435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:41.411435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:41.411435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:41.411435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:41.411435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:41.411435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:41.412399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:41.412399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:41.412399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:41.412399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:41.412399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:41.412399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:41.412399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:41.412399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:41.412399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:41.412399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:41.412399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:41.412399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:41.412399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:41.412399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:41.412399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:41.412399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:41.413211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:41.413211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:41.413211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:41.413211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:41.413211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:41.413211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:41.413211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:41.413211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:41.413211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:41.413211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:41.413211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:41.413211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:41.423119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 268/544] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:56:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:41.423307 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de14fed-e25d-48be-9b58-df3a4a5c2cad None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:41.571940 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:41.589777 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de14fed-e25d-48be-9b58-df3a4a5c2cad None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:41.635107 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c7b67-dc52-460e-ba48-c1792653291d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:41.635249 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c7b67-dc52-460e-ba48-c1792653291d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:41.635424 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c7b67-dc52-460e-ba48-c1792653291d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:41.635699 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c7b67-dc52-460e-ba48-c1792653291d None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:41.636368 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c7b67-dc52-460e-ba48-c1792653291d None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:41.636673 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c7b67-dc52-460e-ba48-c1792653291d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:41.638858 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c7b67-dc52-460e-ba48-c1792653291d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:41.648815 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 277/545] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:56:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:41.654624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75eefa9-4dd4-4815-b338-15d9bf5b3b35 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:41.673741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afc397-5db9-4f55-b815-5ab6f3ef7b0c None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:41.674330 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afc397-5db9-4f55-b815-5ab6f3ef7b0c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:41.674820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afc397-5db9-4f55-b815-5ab6f3ef7b0c None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:41.676740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 278/546] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:56:41.682245 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3b389-eda5-4446-b929-6f83dd4607a7 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:41.682830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3b389-eda5-4446-b929-6f83dd4607a7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:41.683343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3b389-eda5-4446-b929-6f83dd4607a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:41.702318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a5f3b389-eda5-4446-b929-6f83dd4607a7 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:41.703875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a5f3b389-eda5-4446-b929-6f83dd4607a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:41.713459 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:41.813927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75eefa9-4dd4-4815-b338-15d9bf5b3b35 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:41.831176 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 279/547] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:56:41.853597 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3b389-eda5-4446-b929-6f83dd4607a7 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:41.873125 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cced83f-6296-4a40-84ff-33b743341733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:41.873774 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cced83f-6296-4a40-84ff-33b743341733 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:41.874052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cced83f-6296-4a40-84ff-33b743341733 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:41.874319 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cced83f-6296-4a40-84ff-33b743341733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:41.890242 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cced83f-6296-4a40-84ff-33b743341733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:41.891742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cced83f-6296-4a40-84ff-33b743341733 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:41.919937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6cced83f-6296-4a40-84ff-33b743341733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:41.919937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:41.919937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:41.919937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:41.919937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:41.919937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:41.919937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:41.919937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:41.919937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:41.919937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:41.919937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:41.919937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:41.919937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:41.919937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:41.919937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:41.919937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:41.920914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:41.920914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:41.920914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:41.920914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:41.920914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:41.920914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:41.920914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:41.920914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:41.920914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:41.920914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:41.920914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:41.920914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:41.920914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:41.920914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:41.920914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:41.920914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:41.920914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:41.921763 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:41.921763 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:41.921763 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:41.921763 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 269/548] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:41.928526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cced83f-6296-4a40-84ff-33b743341733 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:41.995079 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:42.027512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3b389-eda5-4446-b929-6f83dd4607a7 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:42.071459 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:42.086614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cced83f-6296-4a40-84ff-33b743341733 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:42.113554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84429e1f-6091-47b1-ba1a-fcd99857e232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:42.114189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84429e1f-6091-47b1-ba1a-fcd99857e232 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:42.114463 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84429e1f-6091-47b1-ba1a-fcd99857e232 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:42.114732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84429e1f-6091-47b1-ba1a-fcd99857e232 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:42.125852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84429e1f-6091-47b1-ba1a-fcd99857e232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:42.130543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-84429e1f-6091-47b1-ba1a-fcd99857e232 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:42.130543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:42.130543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:42.130543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:42.130543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:42.130543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:42.130543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:42.130543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:42.130543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:42.130543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:42.130543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:42.130543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:42.130543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:42.130543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:42.130543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:42.130543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:42.131496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:42.131496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:42.131496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:42.131496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:42.131496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:42.131496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:42.131496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:42.131496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:42.131496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:42.131496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:42.131496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:42.131496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:42.131496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:42.131496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:42.131496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:42.131496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:42.132841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:42.132841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:42.132841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:42.132841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:42.132841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:42.132841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:42.132841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:42.132841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:42.132841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:42.132841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:42.132841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:42.132841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:42.136517 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 280/549] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:56:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:56:42.138990 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6168e0-b025-4f8f-9407-e1fb06d69f47 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:42.139538 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6168e0-b025-4f8f-9407-e1fb06d69f47 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:42.139779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6168e0-b025-4f8f-9407-e1fb06d69f47 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:42.141288 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06d601-6169-40e3-9b2a-4664faf7d5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:42.141439 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 281/550] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:42.145752 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6168e0-b025-4f8f-9407-e1fb06d69f47 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:42.147439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06d601-6169-40e3-9b2a-4664faf7d5ae None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:42.147733 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06d601-6169-40e3-9b2a-4664faf7d5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:42.148007 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06d601-6169-40e3-9b2a-4664faf7d5ae None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:42.148666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06d601-6169-40e3-9b2a-4664faf7d5ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:42.148967 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06d601-6169-40e3-9b2a-4664faf7d5ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:42.150332 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06d601-6169-40e3-9b2a-4664faf7d5ae None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:42.163872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 270/551] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:42.165553 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3598a-1a51-4546-add5-18c6ff8c4ec2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:42.165689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3598a-1a51-4546-add5-18c6ff8c4ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:42.165940 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3598a-1a51-4546-add5-18c6ff8c4ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:42.187267 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fac3598a-1a51-4546-add5-18c6ff8c4ec2 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:42.188829 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fac3598a-1a51-4546-add5-18c6ff8c4ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:42.279292 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6168e0-b025-4f8f-9407-e1fb06d69f47 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:42.280033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 271/552] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:42.281259 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3598a-1a51-4546-add5-18c6ff8c4ec2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:42.318813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23183c7-9059-4e26-9b77-1da4c815b18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:42.318813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23183c7-9059-4e26-9b77-1da4c815b18e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:42.318813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23183c7-9059-4e26-9b77-1da4c815b18e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:42.318813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23183c7-9059-4e26-9b77-1da4c815b18e None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:42.319256 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23183c7-9059-4e26-9b77-1da4c815b18e None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:42.319256 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23183c7-9059-4e26-9b77-1da4c815b18e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:42.319256 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23183c7-9059-4e26-9b77-1da4c815b18e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:42.332009 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 282/553] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:56:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:42.333194 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23183c7-9059-4e26-9b77-1da4c815b18e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:42.353527 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:42.373165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:42.423737 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3598a-1a51-4546-add5-18c6ff8c4ec2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:42.463344 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17093d-74e7-4d3b-ac7d-25da03027671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:42.463988 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17093d-74e7-4d3b-ac7d-25da03027671 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:42.464401 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17093d-74e7-4d3b-ac7d-25da03027671 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:42.464794 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17093d-74e7-4d3b-ac7d-25da03027671 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:42.473016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17093d-74e7-4d3b-ac7d-25da03027671 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:42.474620 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17093d-74e7-4d3b-ac7d-25da03027671 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:42.483975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23183c7-9059-4e26-9b77-1da4c815b18e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:42.487116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1f17093d-74e7-4d3b-ac7d-25da03027671 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 06:56:42.487116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:42.487116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:42.487116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:42.487116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:42.487116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:42.487116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:42.487116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:42.487116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:42.487116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:42.487116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:42.487116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:42.487116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:56:42.487116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:56:42.487116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:56:42.487116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:56:42.488498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:42.488498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:42.488498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:56:42.488498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:42.488498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:56:42.488498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:42.488498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:42.488498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:42.488498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:42.488498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:42.488498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:42.488498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:42.488498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:42.488498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:42.488498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:42.488498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:42.488498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:42.488498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:42.489578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:42.489578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:42.489578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:56:42.489578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:56:42.489578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:56:42.489578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:56:42.489578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:56:42.489578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:56:42.489578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 06:56:42.489578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:42.489578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 272/554] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:56:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:42.489578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17093d-74e7-4d3b-ac7d-25da03027671 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:42.532631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf937514-80a8-49a3-86aa-4283e99e0ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:42.534041 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf937514-80a8-49a3-86aa-4283e99e0ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:42.534498 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf937514-80a8-49a3-86aa-4283e99e0ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:42.535012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf937514-80a8-49a3-86aa-4283e99e0ac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:42.550161 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf937514-80a8-49a3-86aa-4283e99e0ac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:42.552619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf937514-80a8-49a3-86aa-4283e99e0ac3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:42.572016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-cf937514-80a8-49a3-86aa-4283e99e0ac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:42.572016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:42.572016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:42.572016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:42.572016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:42.572016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:42.572016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:42.572016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:42.572016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:42.572016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:42.572016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:42.572016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:42.572016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:42.572016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:42.572016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:42.572016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:42.572963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:42.572963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:42.572963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:42.572963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:42.572963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:42.572963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:42.572963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:42.572963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:42.572963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:42.572963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:42.572963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:42.572963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:42.572963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:42.572963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:42.572963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:42.572963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:42.572963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:42.573909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:42.573909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:42.573909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:42.577592 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 283/555] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:42.578654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf937514-80a8-49a3-86aa-4283e99e0ac3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:42.604554 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17093d-74e7-4d3b-ac7d-25da03027671 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:42.645639 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:42.661052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2525b6-07f1-4b64-a4ca-dc0984df8e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:42.662253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2525b6-07f1-4b64-a4ca-dc0984df8e4e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:42.662881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2525b6-07f1-4b64-a4ca-dc0984df8e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:42.663525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2525b6-07f1-4b64-a4ca-dc0984df8e4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:42.667403 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:42.676960 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2525b6-07f1-4b64-a4ca-dc0984df8e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:42.682565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ba2525b6-07f1-4b64-a4ca-dc0984df8e4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:42.682565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:42.682565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:42.682565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:42.682565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:42.682565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:42.682565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:42.682565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:42.682565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:42.682565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:42.682565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:42.682565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:42.682565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:42.682565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:42.682565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:42.682565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:42.685231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:42.685231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:42.685231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:42.685231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:42.685231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:42.685231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:42.685231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:42.685231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:42.685231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:42.685231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:42.685231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:42.685231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:42.685231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:42.685231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:42.685231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:42.685231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:42.687355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:42.687355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:42.687355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:42.687355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:42.687355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:42.687355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:42.687355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:42.687355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:42.687355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:42.687355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:42.687355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:42.687355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:42.690781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 273/556] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:56:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:42.691790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2525b6-07f1-4b64-a4ca-dc0984df8e4e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:42.732313 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf937514-80a8-49a3-86aa-4283e99e0ac3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:42.770805 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e848d5-a3c1-49a8-899b-c6c696691808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:42.771745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e848d5-a3c1-49a8-899b-c6c696691808 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:42.772243 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e848d5-a3c1-49a8-899b-c6c696691808 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:42.772688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e848d5-a3c1-49a8-899b-c6c696691808 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:42.773733 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e848d5-a3c1-49a8-899b-c6c696691808 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:42.774212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e848d5-a3c1-49a8-899b-c6c696691808 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:42.776032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e848d5-a3c1-49a8-899b-c6c696691808 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:42.798542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 284/557] 10.222.0.40 () {56 vars in 1135 bytes} [Tue Aug 9 06:56:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:42.799810 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e848d5-a3c1-49a8-899b-c6c696691808 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:42.801599 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2525b6-07f1-4b64-a4ca-dc0984df8e4e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:42.837674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16050d-56df-4690-a4d9-43a42dbe7518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:42.838327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16050d-56df-4690-a4d9-43a42dbe7518 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:42.838677 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16050d-56df-4690-a4d9-43a42dbe7518 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:42.839040 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16050d-56df-4690-a4d9-43a42dbe7518 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:42.840203 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16050d-56df-4690-a4d9-43a42dbe7518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:42.840203 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16050d-56df-4690-a4d9-43a42dbe7518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:42.841575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16050d-56df-4690-a4d9-43a42dbe7518 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:42.858905 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 274/558] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:42.859901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16050d-56df-4690-a4d9-43a42dbe7518 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:42.906180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:42.914172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e848d5-a3c1-49a8-899b-c6c696691808 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:42.937421 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:42.953587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f5801-4a89-47e4-8968-ed7f57aeacbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:42.954170 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f5801-4a89-47e4-8968-ed7f57aeacbc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:42.954450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f5801-4a89-47e4-8968-ed7f57aeacbc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:42.954974 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f5801-4a89-47e4-8968-ed7f57aeacbc None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:42.955782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f5801-4a89-47e4-8968-ed7f57aeacbc None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:42.956211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f5801-4a89-47e4-8968-ed7f57aeacbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:42.957545 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f5801-4a89-47e4-8968-ed7f57aeacbc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:42.964111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16050d-56df-4690-a4d9-43a42dbe7518 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:42.970583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 285/559] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:56:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:42.970583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f5801-4a89-47e4-8968-ed7f57aeacbc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:43.002462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb951d2-aa54-4ab1-a459-1e6d180cec24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:43.002996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb951d2-aa54-4ab1-a459-1e6d180cec24 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:43.003297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb951d2-aa54-4ab1-a459-1e6d180cec24 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:43.003563 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb951d2-aa54-4ab1-a459-1e6d180cec24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:43.068915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb951d2-aa54-4ab1-a459-1e6d180cec24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:43.070335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb951d2-aa54-4ab1-a459-1e6d180cec24 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:43.072080 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f5801-4a89-47e4-8968-ed7f57aeacbc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:43.110671 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57677ac-1ba3-453f-825c-6a01cedffcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:43.111380 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57677ac-1ba3-453f-825c-6a01cedffcaa None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:43.111656 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57677ac-1ba3-453f-825c-6a01cedffcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:43.111923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57677ac-1ba3-453f-825c-6a01cedffcaa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:43.116009 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:43.119598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57677ac-1ba3-453f-825c-6a01cedffcaa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:43.121011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57677ac-1ba3-453f-825c-6a01cedffcaa None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:43.132199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-d57677ac-1ba3-453f-825c-6a01cedffcaa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 06:56:43.132199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:43.132199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:43.132199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:43.132199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:43.132199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:43.132199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:43.132199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:43.132199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:43.132199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:43.132199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:43.132199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:43.132199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:56:43.132199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:56:43.132199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:56:43.132199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:56:43.133352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:43.133352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:43.133352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:56:43.133352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:43.133352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:56:43.133352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:43.133352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:43.133352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:43.133352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:43.133352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:43.133352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:43.133352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:43.133352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:43.133352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:43.133352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:43.133352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:43.133352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:43.133352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:43.134304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:43.134304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:43.134304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:56:43.134304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:56:43.134304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:56:43.134304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:56:43.134304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:56:43.134304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:56:43.134304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 06:56:43.134304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:43.134304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 286/560] 10.222.0.40 () {56 vars in 1093 bytes} [Tue Aug 9 06:56:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:43.134945 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e8ea0-c3c6-4501-92f1-e15512bcde1d None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:43.135117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e8ea0-c3c6-4501-92f1-e15512bcde1d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:43.135362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e8ea0-c3c6-4501-92f1-e15512bcde1d None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:43.139224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 287/561] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:43.139224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e8ea0-c3c6-4501-92f1-e15512bcde1d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:43.183519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:43.191393 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 275/562] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:43.191393 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb951d2-aa54-4ab1-a459-1e6d180cec24 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:43.243914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e8ea0-c3c6-4501-92f1-e15512bcde1d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:43.290977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88bd97-8e3f-4995-b896-fe5faf327390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:43.291653 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88bd97-8e3f-4995-b896-fe5faf327390 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:43.291917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88bd97-8e3f-4995-b896-fe5faf327390 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:43.292194 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88bd97-8e3f-4995-b896-fe5faf327390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:43.303849 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88bd97-8e3f-4995-b896-fe5faf327390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:43.305282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88bd97-8e3f-4995-b896-fe5faf327390 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:43.314326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb951d2-aa54-4ab1-a459-1e6d180cec24 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:43.319824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-4c88bd97-8e3f-4995-b896-fe5faf327390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:43.319824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:43.319824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:43.319824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:43.319824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:43.319824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:43.319824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:43.319824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:43.319824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:43.319824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:43.319824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:43.319824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:43.319824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:43.319824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:43.319824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:43.319824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:43.320779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:43.320779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:43.320779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:43.320779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:43.320779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:43.320779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:43.320779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:43.320779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:43.320779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:43.320779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:43.320779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:43.320779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:43.320779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:43.320779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:43.320779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:43.320779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:43.320779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:43.321672 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:43.321672 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:43.321672 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:43.326212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 288/563] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:43.327538 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86804610-ad9c-4d82-8497-c5b10869abbc None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:43.327825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86804610-ad9c-4d82-8497-c5b10869abbc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:43.328105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86804610-ad9c-4d82-8497-c5b10869abbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:43.346688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-86804610-ad9c-4d82-8497-c5b10869abbc None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:43.347925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-86804610-ad9c-4d82-8497-c5b10869abbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:43.351325 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e51375-c48f-45d1-99f2-2be4021751b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:43.351921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e51375-c48f-45d1-99f2-2be4021751b3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:43.352192 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e51375-c48f-45d1-99f2-2be4021751b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:43.352455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e51375-c48f-45d1-99f2-2be4021751b3 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:43.353160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e51375-c48f-45d1-99f2-2be4021751b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:43.353459 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e51375-c48f-45d1-99f2-2be4021751b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:43.354868 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e51375-c48f-45d1-99f2-2be4021751b3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:43.372479 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 276/564] 10.222.0.40 () {56 vars in 1133 bytes} [Tue Aug 9 06:56:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:43.377061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e51375-c48f-45d1-99f2-2be4021751b3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:43.379186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:43.421632 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 289/565] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:43.423944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86804610-ad9c-4d82-8497-c5b10869abbc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:43.450908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:43.488124 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e51375-c48f-45d1-99f2-2be4021751b3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:43.522249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e09c3-36b6-43d5-9aee-307b312b1204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:43.522871 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e09c3-36b6-43d5-9aee-307b312b1204 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:43.523169 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e09c3-36b6-43d5-9aee-307b312b1204 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:43.523456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e09c3-36b6-43d5-9aee-307b312b1204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:43.533034 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86804610-ad9c-4d82-8497-c5b10869abbc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:43.533487 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e09c3-36b6-43d5-9aee-307b312b1204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:43.534909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e09c3-36b6-43d5-9aee-307b312b1204 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:43.549747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-213e09c3-36b6-43d5-9aee-307b312b1204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:43.549747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:43.549747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:43.549747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:43.549747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:43.549747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:43.549747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:43.549747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:43.549747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:43.549747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:43.549747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:43.549747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:43.549747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:43.549747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:43.549747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:43.549747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:43.550861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:43.550861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:43.550861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:43.550861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:43.550861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:43.550861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:43.550861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:43.550861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:43.550861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:43.550861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:43.550861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:43.550861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:43.550861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:43.550861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:43.550861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:43.550861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:43.550861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:43.551806 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:43.551806 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:43.551806 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:43.551806 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 277/566] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:43.552030 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e09c3-36b6-43d5-9aee-307b312b1204 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:43.578413 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648cdd2-b308-4c2a-b1ff-a0c506001751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:43.580360 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648cdd2-b308-4c2a-b1ff-a0c506001751 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:43.581020 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648cdd2-b308-4c2a-b1ff-a0c506001751 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:43.581671 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648cdd2-b308-4c2a-b1ff-a0c506001751 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:43.583240 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648cdd2-b308-4c2a-b1ff-a0c506001751 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:43.583813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648cdd2-b308-4c2a-b1ff-a0c506001751 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:43.585364 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648cdd2-b308-4c2a-b1ff-a0c506001751 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:43.602135 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 290/567] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:43.602135 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648cdd2-b308-4c2a-b1ff-a0c506001751 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:43.618182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:43.673328 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e09c3-36b6-43d5-9aee-307b312b1204 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:43.699250 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:43.710396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abc12e-47c4-4585-a2d5-640f40217a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:43.711027 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abc12e-47c4-4585-a2d5-640f40217a58 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:43.711336 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abc12e-47c4-4585-a2d5-640f40217a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:43.711607 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abc12e-47c4-4585-a2d5-640f40217a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:43.715915 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648cdd2-b308-4c2a-b1ff-a0c506001751 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:43.723545 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abc12e-47c4-4585-a2d5-640f40217a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:43.725126 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abc12e-47c4-4585-a2d5-640f40217a58 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:43.740116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c8abc12e-47c4-4585-a2d5-640f40217a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:43.740116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:43.740116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:43.740116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:43.740116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:43.740116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:43.740116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:43.740116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:43.740116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:43.740116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:43.740116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:43.740116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:43.740116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:43.740116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:43.740116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:43.740116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:43.741292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:43.741292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:43.741292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:43.741292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:43.741292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:43.741292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:43.741292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:43.741292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:43.741292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:43.741292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:43.741292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:43.741292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:43.741292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:43.741292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:43.741292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:43.741292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:43.741292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:43.742395 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:43.742395 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:43.742395 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:43.742779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 278/568] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:43.743616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abc12e-47c4-4585-a2d5-640f40217a58 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:43.753319 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a48f83-36b8-4c33-9ffd-c371e4dc4ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:43.753947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a48f83-36b8-4c33-9ffd-c371e4dc4ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:43.754227 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a48f83-36b8-4c33-9ffd-c371e4dc4ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:43.754494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a48f83-36b8-4c33-9ffd-c371e4dc4ae2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:43.764781 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a48f83-36b8-4c33-9ffd-c371e4dc4ae2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:43.769790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-76a48f83-36b8-4c33-9ffd-c371e4dc4ae2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:43.769790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:43.769790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:43.769790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:43.769790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:43.769790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:43.769790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:43.769790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:43.769790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:43.769790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:43.769790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:43.769790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:43.769790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:43.769790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:43.769790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:43.769790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:43.770938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:43.770938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:43.770938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:43.770938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:43.770938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:43.770938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:43.770938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:43.770938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:43.770938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:43.770938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:43.770938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:43.770938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:43.770938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:43.770938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:43.770938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:43.770938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:43.771895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:43.771895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:43.771895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:43.771895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:43.771895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:43.771895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:43.771895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:43.771895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:43.771895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:43.771895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:43.771895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:43.771895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:43.771895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 291/569] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:56:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:43.771895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a48f83-36b8-4c33-9ffd-c371e4dc4ae2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:43.847984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abc12e-47c4-4585-a2d5-640f40217a58 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:43.854686 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:43.868175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a48f83-36b8-4c33-9ffd-c371e4dc4ae2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:43.883433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e87339-7c30-46d8-9d84-223ec0a8e72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:43.884033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e87339-7c30-46d8-9d84-223ec0a8e72a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:43.884305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e87339-7c30-46d8-9d84-223ec0a8e72a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:43.884572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e87339-7c30-46d8-9d84-223ec0a8e72a None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:43.885201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e87339-7c30-46d8-9d84-223ec0a8e72a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:43.885498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e87339-7c30-46d8-9d84-223ec0a8e72a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:43.886858 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e87339-7c30-46d8-9d84-223ec0a8e72a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:43.899874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 279/570] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:43.901113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a7a6f-f82d-4402-91ae-ab8aa974b410 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:43.901394 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a7a6f-f82d-4402-91ae-ab8aa974b410 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:43.901661 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a7a6f-f82d-4402-91ae-ab8aa974b410 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:43.903443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 280/571] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:43.904129 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a7a6f-f82d-4402-91ae-ab8aa974b410 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:43.909006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bbe8f-706d-42db-9c10-3d720820b7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:43.909632 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bbe8f-706d-42db-9c10-3d720820b7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:43.909904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bbe8f-706d-42db-9c10-3d720820b7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:43.910169 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bbe8f-706d-42db-9c10-3d720820b7e5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:43.918111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bbe8f-706d-42db-9c10-3d720820b7e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:43.920330 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bbe8f-706d-42db-9c10-3d720820b7e5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:43.931296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-1e4bbe8f-706d-42db-9c10-3d720820b7e5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 06:56:43.931296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:43.931296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:43.931296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:43.931296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:43.931296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:43.931296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:43.931296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:43.931296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:43.931296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:43.931296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:43.931296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:43.931296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:56:43.931296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:56:43.931296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:56:43.931296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:56:43.932418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:43.932418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:43.932418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:56:43.932418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:43.932418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:56:43.932418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:43.932418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:43.932418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:43.932418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:43.932418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:43.932418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:43.932418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:43.932418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:43.932418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:43.932418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:43.932418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:43.932418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:43.932418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:43.933382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:43.933382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:43.933382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:56:43.933382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:56:43.933382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:56:43.933382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:56:43.933382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:56:43.933382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:56:43.933382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 06:56:43.933382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:43.933382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 292/572] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:43.933382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bbe8f-706d-42db-9c10-3d720820b7e5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:43.936457 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:44.013573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a7a6f-f82d-4402-91ae-ab8aa974b410 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:44.031711 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bbe8f-706d-42db-9c10-3d720820b7e5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:44.047008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c193d-0897-44c6-ba06-b3e151ae29df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:44.047641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c193d-0897-44c6-ba06-b3e151ae29df None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:44.047915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c193d-0897-44c6-ba06-b3e151ae29df None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:44.048178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c193d-0897-44c6-ba06-b3e151ae29df None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:44.048803 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c193d-0897-44c6-ba06-b3e151ae29df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:44.049098 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c193d-0897-44c6-ba06-b3e151ae29df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:44.050459 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c193d-0897-44c6-ba06-b3e151ae29df None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:44.061795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 281/573] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:44.062672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c193d-0897-44c6-ba06-b3e151ae29df None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:44.065728 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b229c01-9f50-4f22-a53d-ffed28559f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:44.066468 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b229c01-9f50-4f22-a53d-ffed28559f95 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:44.066583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b229c01-9f50-4f22-a53d-ffed28559f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:44.066832 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b229c01-9f50-4f22-a53d-ffed28559f95 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:44.067530 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b229c01-9f50-4f22-a53d-ffed28559f95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:44.067835 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b229c01-9f50-4f22-a53d-ffed28559f95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:44.069177 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b229c01-9f50-4f22-a53d-ffed28559f95 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:44.077772 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 293/574] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:56:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:44.078919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90108dfd-65c8-4b0f-857b-51a3e064eb6c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:44.079238 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90108dfd-65c8-4b0f-857b-51a3e064eb6c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:44.079508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90108dfd-65c8-4b0f-857b-51a3e064eb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:44.091199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:44.096687 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-90108dfd-65c8-4b0f-857b-51a3e064eb6c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:44.097853 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-90108dfd-65c8-4b0f-857b-51a3e064eb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:44.154551 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:44.161606 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c193d-0897-44c6-ba06-b3e151ae29df None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:44.162230 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 294/575] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:44.163174 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90108dfd-65c8-4b0f-857b-51a3e064eb6c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:44.195731 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c55fec-6ed8-4ebe-a954-9a7fbdad03d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:44.196355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c55fec-6ed8-4ebe-a954-9a7fbdad03d0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:44.196633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c55fec-6ed8-4ebe-a954-9a7fbdad03d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:44.196912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c55fec-6ed8-4ebe-a954-9a7fbdad03d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:44.203755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c55fec-6ed8-4ebe-a954-9a7fbdad03d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:44.205497 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c55fec-6ed8-4ebe-a954-9a7fbdad03d0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:44.216630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-31c55fec-6ed8-4ebe-a954-9a7fbdad03d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:44.216630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:44.216630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:44.216630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:44.216630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:44.216630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:44.216630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:44.216630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:44.216630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:44.216630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:44.216630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:44.216630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:44.216630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:56:44.216630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:56:44.216630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:56:44.217709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:56:44.217709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:44.217709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:44.217709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:44.217709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:44.217709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:44.217709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:44.217709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:44.217709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:44.217709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:44.217709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:44.217709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:44.217709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:44.217709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:44.217709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:44.217709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:44.217709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:44.218738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:56:44.218738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:56:44.218738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:56:44.218738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:56:44.218738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:56:44.218738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:56:44.218738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:44.218738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:44.218738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 282/576] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:44.218738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c55fec-6ed8-4ebe-a954-9a7fbdad03d0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:44.269931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90108dfd-65c8-4b0f-857b-51a3e064eb6c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:44.304878 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399c152-cd46-4891-aa5f-cf7492155652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:44.305510 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:44.306262 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399c152-cd46-4891-aa5f-cf7492155652 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:44.306542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399c152-cd46-4891-aa5f-cf7492155652 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:44.306812 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399c152-cd46-4891-aa5f-cf7492155652 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:44.307608 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399c152-cd46-4891-aa5f-cf7492155652 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:44.307919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399c152-cd46-4891-aa5f-cf7492155652 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:44.310647 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399c152-cd46-4891-aa5f-cf7492155652 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:44.320747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c55fec-6ed8-4ebe-a954-9a7fbdad03d0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:44.328136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 295/577] 10.222.0.40 () {56 vars in 1137 bytes} [Tue Aug 9 06:56:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:44.328924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399c152-cd46-4891-aa5f-cf7492155652 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:44.353874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8495a7f-cc90-481f-82e6-1e4b6ba84c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:44.354488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495a7f-cc90-481f-82e6-1e4b6ba84c97 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:44.354757 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495a7f-cc90-481f-82e6-1e4b6ba84c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:44.355023 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495a7f-cc90-481f-82e6-1e4b6ba84c97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:44.361960 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8495a7f-cc90-481f-82e6-1e4b6ba84c97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:44.363401 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8495a7f-cc90-481f-82e6-1e4b6ba84c97 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:44.374587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a8495a7f-cc90-481f-82e6-1e4b6ba84c97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:44.374587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:44.374587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:44.374587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:44.374587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:44.374587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:44.374587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:44.374587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:44.374587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:44.374587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:44.374587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:44.374587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:44.374587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:56:44.374587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:56:44.374587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:56:44.375527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:56:44.375527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:44.375527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:44.375527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:44.375527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:44.375527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:44.375527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:44.375527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:44.375527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:44.375527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:44.375527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:44.375527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:44.375527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:44.375527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:44.375527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:44.375527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:44.375527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:44.376410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:56:44.376410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:56:44.376410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:56:44.376410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:56:44.376410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:56:44.376410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:56:44.376410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:44.376410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:44.376410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 283/578] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:44.376410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8495a7f-cc90-481f-82e6-1e4b6ba84c97 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:44.386820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:44.430999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399c152-cd46-4891-aa5f-cf7492155652 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:44.466262 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc74aa-33df-4769-a634-08fbdedacf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:44.466883 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc74aa-33df-4769-a634-08fbdedacf0e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:44.467186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc74aa-33df-4769-a634-08fbdedacf0e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:44.467459 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc74aa-33df-4769-a634-08fbdedacf0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:44.472810 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8495a7f-cc90-481f-82e6-1e4b6ba84c97 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:44.477056 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc74aa-33df-4769-a634-08fbdedacf0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:44.478482 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc74aa-33df-4769-a634-08fbdedacf0e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:44.492721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-70fc74aa-33df-4769-a634-08fbdedacf0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:44.492721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:44.492721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:44.492721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:44.492721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:44.492721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:44.492721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:44.492721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:44.492721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:44.492721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:44.492721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:44.492721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:44.492721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:44.492721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:44.492721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:44.492721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:44.493837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:44.493837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:44.493837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:44.493837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:44.493837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:44.493837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:44.493837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:44.493837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:44.493837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:44.493837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:44.493837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:44.493837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:44.493837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:44.493837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:44.493837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:44.493837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:44.493837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:44.494772 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:44.494772 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:44.494772 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:44.494772 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 296/579] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:44.494772 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc74aa-33df-4769-a634-08fbdedacf0e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:44.514318 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d92fee-6a16-4f93-b07d-c7ed1e1fc154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:44.514945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d92fee-6a16-4f93-b07d-c7ed1e1fc154 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:44.515249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d92fee-6a16-4f93-b07d-c7ed1e1fc154 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:44.515507 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d92fee-6a16-4f93-b07d-c7ed1e1fc154 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:44.525265 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d92fee-6a16-4f93-b07d-c7ed1e1fc154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:44.530624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-59d92fee-6a16-4f93-b07d-c7ed1e1fc154 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:44.530624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:44.530624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:44.530624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:44.530624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:44.530624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:44.530624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:44.530624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:44.530624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:44.530624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:44.530624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:44.530624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:44.530624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:44.530624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:44.530624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:44.530624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:44.536848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:44.536848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:44.536848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:44.536848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:44.536848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:44.536848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:44.536848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:44.536848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:44.536848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:44.536848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:44.536848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:44.536848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:44.536848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:44.536848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:44.536848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:44.536848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:44.537856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:44.537856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:44.537856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:44.537856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:44.537856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:44.537856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:44.537856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:44.537856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:44.537856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:44.537856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:44.537856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:44.537856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:44.537856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 284/580] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:56:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:44.537856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d92fee-6a16-4f93-b07d-c7ed1e1fc154 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:44.545698 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:44.596453 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc74aa-33df-4769-a634-08fbdedacf0e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:44.603325 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:44.632449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43bbb0-1e25-49db-a8f4-1219b15aada6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:44.633053 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43bbb0-1e25-49db-a8f4-1219b15aada6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:44.633331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43bbb0-1e25-49db-a8f4-1219b15aada6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:44.633603 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43bbb0-1e25-49db-a8f4-1219b15aada6 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:44.634292 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43bbb0-1e25-49db-a8f4-1219b15aada6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:44.634599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43bbb0-1e25-49db-a8f4-1219b15aada6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:44.636036 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43bbb0-1e25-49db-a8f4-1219b15aada6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:44.638465 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d92fee-6a16-4f93-b07d-c7ed1e1fc154 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:44.649249 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 297/581] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:56:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:44.649680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43bbb0-1e25-49db-a8f4-1219b15aada6 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:44.671724 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ea95d-a43a-43f1-b439-1187abddae88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:44.672345 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ea95d-a43a-43f1-b439-1187abddae88 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:44.672618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ea95d-a43a-43f1-b439-1187abddae88 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:44.672885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ea95d-a43a-43f1-b439-1187abddae88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:44.682988 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ea95d-a43a-43f1-b439-1187abddae88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:44.685046 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ea95d-a43a-43f1-b439-1187abddae88 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:44.698141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-151ea95d-a43a-43f1-b439-1187abddae88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:44.698141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:44.698141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:44.698141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:44.698141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:44.698141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:44.698141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:44.698141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:44.698141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:44.698141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:44.698141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:44.698141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:44.698141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:44.698141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:44.698141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:44.698141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:44.699219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:44.699219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:44.699219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:44.699219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:44.699219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:44.699219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:44.699219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:44.699219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:44.699219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:44.699219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:44.699219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:44.699219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:44.699219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:44.699219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:44.699219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:44.699219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:44.699219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:44.700734 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:44.700734 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:44.700734 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:44.700734 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 285/582] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:44.700966 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ea95d-a43a-43f1-b439-1187abddae88 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:44.754073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43bbb0-1e25-49db-a8f4-1219b15aada6 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:44.758118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:44.789162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f948f-84f6-427b-a229-ebfe91505323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:44.789756 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f948f-84f6-427b-a229-ebfe91505323 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:44.790030 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f948f-84f6-427b-a229-ebfe91505323 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:44.790297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f948f-84f6-427b-a229-ebfe91505323 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:44.790974 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f948f-84f6-427b-a229-ebfe91505323 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:44.791308 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f948f-84f6-427b-a229-ebfe91505323 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:44.792722 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f948f-84f6-427b-a229-ebfe91505323 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:44.801909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ea95d-a43a-43f1-b439-1187abddae88 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:44.804622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 298/583] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:56:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:44.805391 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f948f-84f6-427b-a229-ebfe91505323 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:44.837029 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fa5f0-6ebb-48db-87f1-97095834382c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:44.837256 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:44.837631 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fa5f0-6ebb-48db-87f1-97095834382c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:44.837904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fa5f0-6ebb-48db-87f1-97095834382c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:44.838173 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fa5f0-6ebb-48db-87f1-97095834382c None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:44.838805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fa5f0-6ebb-48db-87f1-97095834382c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:44.839113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fa5f0-6ebb-48db-87f1-97095834382c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:44.840681 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fa5f0-6ebb-48db-87f1-97095834382c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:44.852674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 286/584] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:44.853537 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fa5f0-6ebb-48db-87f1-97095834382c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:44.911630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f948f-84f6-427b-a229-ebfe91505323 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:44.944854 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ad9a3-2a1c-4b15-adb2-44f9cced275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:44.945380 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ad9a3-2a1c-4b15-adb2-44f9cced275e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:44.945653 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ad9a3-2a1c-4b15-adb2-44f9cced275e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:44.945916 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ad9a3-2a1c-4b15-adb2-44f9cced275e None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:44.946560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ad9a3-2a1c-4b15-adb2-44f9cced275e None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:44.946856 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ad9a3-2a1c-4b15-adb2-44f9cced275e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:44.948268 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ad9a3-2a1c-4b15-adb2-44f9cced275e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:44.956299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 299/585] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:56:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:44.957063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ad9a3-2a1c-4b15-adb2-44f9cced275e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:44.957540 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fa5f0-6ebb-48db-87f1-97095834382c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:44.975462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:44.993260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafd351-1ce3-49bd-bc1c-a92d5fc1abf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:44.993858 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafd351-1ce3-49bd-bc1c-a92d5fc1abf3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:44.994133 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafd351-1ce3-49bd-bc1c-a92d5fc1abf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:44.994402 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafd351-1ce3-49bd-bc1c-a92d5fc1abf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:44.995144 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafd351-1ce3-49bd-bc1c-a92d5fc1abf3 None admin] RBAC: Adding query filter params (role.id=b93b6b2c6da44593a6b95db1309b8a58, scope.project.id=342524b45def418783374ff6733e94b9, user.id=92f19a17424c44eea58efb957246cb48) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:44.995449 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafd351-1ce3-49bd-bc1c-a92d5fc1abf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:44.998014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafd351-1ce3-49bd-bc1c-a92d5fc1abf3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:45.003162 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 287/586] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:56:44 2022] GET /identity/v3/role_assignments?user.id=92f19a17424c44eea58efb957246cb48&scope.project.id=342524b45def418783374ff6733e94b9&role.id=b93b6b2c6da44593a6b95db1309b8a58 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:45.003904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafd351-1ce3-49bd-bc1c-a92d5fc1abf3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:45.048781 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:45.063752 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ad9a3-2a1c-4b15-adb2-44f9cced275e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:45.102099 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69615d3-07c4-461a-a576-330d2ea39e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:45.102714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69615d3-07c4-461a-a576-330d2ea39e66 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:45.102988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69615d3-07c4-461a-a576-330d2ea39e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:45.103282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69615d3-07c4-461a-a576-330d2ea39e66 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:45.103936 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69615d3-07c4-461a-a576-330d2ea39e66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:45.104294 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69615d3-07c4-461a-a576-330d2ea39e66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:45.105693 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69615d3-07c4-461a-a576-330d2ea39e66 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:45.119301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 300/587] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:45.119992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69615d3-07c4-461a-a576-330d2ea39e66 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:45.141725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafd351-1ce3-49bd-bc1c-a92d5fc1abf3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:45.182012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bef93-6b83-4e56-a8d1-30ec9f2554ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:45.182669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bef93-6b83-4e56-a8d1-30ec9f2554ac None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:45.182945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bef93-6b83-4e56-a8d1-30ec9f2554ac None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:45.183274 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bef93-6b83-4e56-a8d1-30ec9f2554ac None admin] PATH_INFO: `/v3/projects/342524b45def418783374ff6733e94b9/users/6e949d9666be44a0b6122d510168c7ab/roles/b93b6b2c6da44593a6b95db1309b8a58` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:45.198827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25bef93-6b83-4e56-a8d1-30ec9f2554ac None admin] RBAC: Authorizing `identity:create_grant(project_id=342524b45def418783374ff6733e94b9, user_id=6e949d9666be44a0b6122d510168c7ab, role_id=b93b6b2c6da44593a6b95db1309b8a58)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:45.200822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25bef93-6b83-4e56-a8d1-30ec9f2554ac None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:45.216927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 288/588] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:56:45 2022] PUT /identity/v3/projects/342524b45def418783374ff6733e94b9/users/6e949d9666be44a0b6122d510168c7ab/roles/b93b6b2c6da44593a6b95db1309b8a58 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:56:45.218168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bef93-6b83-4e56-a8d1-30ec9f2554ac None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:45.253031 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69615d3-07c4-461a-a576-330d2ea39e66 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:45.264729 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:45.295578 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3121526-29a5-454b-8ad6-2e837943d7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:45.296625 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3121526-29a5-454b-8ad6-2e837943d7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:45.296742 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3121526-29a5-454b-8ad6-2e837943d7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:45.296964 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3121526-29a5-454b-8ad6-2e837943d7c5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:45.310331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3121526-29a5-454b-8ad6-2e837943d7c5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:45.311874 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3121526-29a5-454b-8ad6-2e837943d7c5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:45.330210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-c3121526-29a5-454b-8ad6-2e837943d7c5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 06:56:45.330210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:45.330210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:45.330210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:45.330210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:45.330210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:45.330210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:45.330210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:45.330210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:45.330210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:45.330210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:45.330210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:45.330210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:56:45.330210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:56:45.330210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:56:45.330210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:56:45.331508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:45.331508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:45.331508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:56:45.331508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:45.331508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:56:45.331508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:45.331508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:45.331508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:45.331508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:45.331508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:45.331508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:45.331508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:45.331508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:45.331508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:45.331508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:45.331508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:45.331508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:45.331508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:45.332503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:45.332503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:45.332503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:56:45.332503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:56:45.332503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:56:45.332503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:56:45.332503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:56:45.332503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:56:45.332503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 06:56:45.332503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:45.339905 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 301/589] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:45.342474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3121526-29a5-454b-8ad6-2e837943d7c5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:45.354981 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:45.385503 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bef93-6b83-4e56-a8d1-30ec9f2554ac None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:45.433020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f3d74-a278-481a-a7c7-b2abda8d20ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:45.434728 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f3d74-a278-481a-a7c7-b2abda8d20ca None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:45.435879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f3d74-a278-481a-a7c7-b2abda8d20ca None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:45.436448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f3d74-a278-481a-a7c7-b2abda8d20ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:45.451707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f3d74-a278-481a-a7c7-b2abda8d20ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:45.454371 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f3d74-a278-481a-a7c7-b2abda8d20ca None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:45.462170 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3121526-29a5-454b-8ad6-2e837943d7c5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:45.477380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-0e3f3d74-a278-481a-a7c7-b2abda8d20ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:45.477380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:45.477380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:45.477380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:45.477380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:45.477380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:45.477380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:45.477380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:45.477380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:45.477380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:45.477380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:45.477380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:45.477380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:45.477380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:45.477380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:45.477380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:45.478723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:45.478723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:45.478723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:45.478723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:45.478723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:45.478723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:45.478723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:45.478723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:45.478723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:45.478723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:45.478723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:45.478723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:45.478723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:45.478723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:45.478723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:45.478723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:45.478723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:45.479675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:45.479675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:45.479675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:45.483409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 289/590] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:45.483409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f3d74-a278-481a-a7c7-b2abda8d20ca None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:45.510096 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c588f5a-83b2-4776-b97a-a8a94b8ccb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:45.511145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588f5a-83b2-4776-b97a-a8a94b8ccb6d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:45.511626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588f5a-83b2-4776-b97a-a8a94b8ccb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:45.512815 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588f5a-83b2-4776-b97a-a8a94b8ccb6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:45.520919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c588f5a-83b2-4776-b97a-a8a94b8ccb6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:45.522763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c588f5a-83b2-4776-b97a-a8a94b8ccb6d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:45.536248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-8c588f5a-83b2-4776-b97a-a8a94b8ccb6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:45.536248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:45.536248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:45.536248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:45.536248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:45.536248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:45.536248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:45.536248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:45.536248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:45.536248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:45.536248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:45.536248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:45.536248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:56:45.536248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:56:45.536248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:56:45.537173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:56:45.537173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:45.537173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:45.537173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:45.537173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:45.537173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:45.537173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:45.537173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:45.537173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:45.537173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:45.537173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:45.537173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:45.537173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:45.537173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:45.537173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:45.537173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:45.537173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:45.538063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:56:45.538063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:56:45.538063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:56:45.538063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:56:45.538063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:56:45.538063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:56:45.538063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:45.538063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:45.541154 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 302/591] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:45.542221 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c588f5a-83b2-4776-b97a-a8a94b8ccb6d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:45.586342 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:45.603889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f3d74-a278-481a-a7c7-b2abda8d20ca None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:45.619375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:45.643546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70405e-a0ae-4ac8-b1e8-3350ada9889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:45.644496 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70405e-a0ae-4ac8-b1e8-3350ada9889d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:45.644956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70405e-a0ae-4ac8-b1e8-3350ada9889d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:45.645405 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70405e-a0ae-4ac8-b1e8-3350ada9889d None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:45.646298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70405e-a0ae-4ac8-b1e8-3350ada9889d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:45.646793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70405e-a0ae-4ac8-b1e8-3350ada9889d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:45.648449 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70405e-a0ae-4ac8-b1e8-3350ada9889d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:45.663851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c588f5a-83b2-4776-b97a-a8a94b8ccb6d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:45.671969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 290/592] 10.222.0.40 () {56 vars in 1137 bytes} [Tue Aug 9 06:56:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:45.673155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70405e-a0ae-4ac8-b1e8-3350ada9889d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:45.703543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17786427-9b11-4cad-8a10-bbfdd5c71084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:45.703915 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17786427-9b11-4cad-8a10-bbfdd5c71084 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:45.704200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17786427-9b11-4cad-8a10-bbfdd5c71084 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:45.704474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17786427-9b11-4cad-8a10-bbfdd5c71084 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:45.705469 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17786427-9b11-4cad-8a10-bbfdd5c71084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:45.705676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17786427-9b11-4cad-8a10-bbfdd5c71084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:45.707050 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17786427-9b11-4cad-8a10-bbfdd5c71084 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:45.725818 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 303/593] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:45.726862 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17786427-9b11-4cad-8a10-bbfdd5c71084 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:45.797253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70405e-a0ae-4ac8-b1e8-3350ada9889d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:45.842209 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17786427-9b11-4cad-8a10-bbfdd5c71084 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:45.847346 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae4073-85a7-4a3e-b5b8-e4aaf40b4c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:45.848228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae4073-85a7-4a3e-b5b8-e4aaf40b4c89 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:45.848708 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae4073-85a7-4a3e-b5b8-e4aaf40b4c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:45.849182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae4073-85a7-4a3e-b5b8-e4aaf40b4c89 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:45.850079 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae4073-85a7-4a3e-b5b8-e4aaf40b4c89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:45.851071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae4073-85a7-4a3e-b5b8-e4aaf40b4c89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:45.853182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae4073-85a7-4a3e-b5b8-e4aaf40b4c89 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:45.874693 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 291/594] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:56:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:45.874693 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae4073-85a7-4a3e-b5b8-e4aaf40b4c89 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:45.876101 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:45.878996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:45.888271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8882d9b-d60d-4d87-b70b-0ecb661705bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:45.889012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8882d9b-d60d-4d87-b70b-0ecb661705bf None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:45.889361 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8882d9b-d60d-4d87-b70b-0ecb661705bf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:45.889751 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8882d9b-d60d-4d87-b70b-0ecb661705bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:45.900806 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8882d9b-d60d-4d87-b70b-0ecb661705bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:45.902341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8882d9b-d60d-4d87-b70b-0ecb661705bf None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:45.917773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-e8882d9b-d60d-4d87-b70b-0ecb661705bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:45.917773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:45.917773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:45.917773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:45.917773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:45.917773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:45.917773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:45.917773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:45.917773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:45.917773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:45.917773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:45.917773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:45.917773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:45.917773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:45.917773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:45.917773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:45.918959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:45.918959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:45.918959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:45.918959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:45.918959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:45.918959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:45.918959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:45.918959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:45.918959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:45.918959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:45.918959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:45.918959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:45.918959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:45.918959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:45.918959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:45.918959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:45.918959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:45.920029 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:45.920029 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:45.920029 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:45.920029 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 304/595] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:45.925453 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8882d9b-d60d-4d87-b70b-0ecb661705bf None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:46.002986 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae4073-85a7-4a3e-b5b8-e4aaf40b4c89 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:46.029911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8882d9b-d60d-4d87-b70b-0ecb661705bf None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:46.041253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbf779-8e39-4822-8179-7db43d5b40ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:46.041889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbf779-8e39-4822-8179-7db43d5b40ef None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:46.042167 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbf779-8e39-4822-8179-7db43d5b40ef None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:46.042434 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbf779-8e39-4822-8179-7db43d5b40ef None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:46.050639 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbf779-8e39-4822-8179-7db43d5b40ef None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:46.052383 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbf779-8e39-4822-8179-7db43d5b40ef None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:46.064915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c2bbf779-8e39-4822-8179-7db43d5b40ef None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 06:56:46.064915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:46.064915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:46.064915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:46.064915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:46.064915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:46.064915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:46.064915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:46.064915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:46.064915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:46.064915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:46.064915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:46.064915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:56:46.064915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:56:46.064915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:56:46.064915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:56:46.065837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:46.065837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:46.065837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:56:46.065837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:46.065837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:56:46.065837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:46.065837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:46.065837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:46.065837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:46.065837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:46.065837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:46.065837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:46.065837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:46.065837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:46.065837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:46.065837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:46.065837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:46.065837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:46.066775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:46.066775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:46.066775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:56:46.066775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:56:46.066775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:56:46.066775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:56:46.066775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:56:46.066775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:56:46.066775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 06:56:46.066775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:46.066775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 292/596] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:56:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:46.067383 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbf779-8e39-4822-8179-7db43d5b40ef None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:46.072559 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b0cd6-608e-40fe-87e3-875b1def67d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:46.073472 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0cd6-608e-40fe-87e3-875b1def67d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:46.073942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0cd6-608e-40fe-87e3-875b1def67d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:46.074442 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0cd6-608e-40fe-87e3-875b1def67d5 None admin] PATH_INFO: `/v3/projects/342524b45def418783374ff6733e94b9/users/e44c764958784616b8bdbf59e5692ca6/roles/b93b6b2c6da44593a6b95db1309b8a58` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:46.090935 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b0cd6-608e-40fe-87e3-875b1def67d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=342524b45def418783374ff6733e94b9, user_id=e44c764958784616b8bdbf59e5692ca6, role_id=b93b6b2c6da44593a6b95db1309b8a58)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:46.092726 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b0cd6-608e-40fe-87e3-875b1def67d5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:46.108733 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 305/597] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:56:45 2022] PUT /identity/v3/projects/342524b45def418783374ff6733e94b9/users/e44c764958784616b8bdbf59e5692ca6/roles/b93b6b2c6da44593a6b95db1309b8a58 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:56:46.109810 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b0cd6-608e-40fe-87e3-875b1def67d5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:46.136635 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:46.151692 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:46.227779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbf779-8e39-4822-8179-7db43d5b40ef None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:46.297790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b0cd6-608e-40fe-87e3-875b1def67d5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:46.303552 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b08f3-aa7a-4d77-8921-9fb856800ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:46.304235 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b08f3-aa7a-4d77-8921-9fb856800ffb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:46.304520 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b08f3-aa7a-4d77-8921-9fb856800ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:46.304793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b08f3-aa7a-4d77-8921-9fb856800ffb None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:46.305451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b08f3-aa7a-4d77-8921-9fb856800ffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:46.305755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b08f3-aa7a-4d77-8921-9fb856800ffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:46.307185 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b08f3-aa7a-4d77-8921-9fb856800ffb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:46.332900 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 293/598] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:46.338964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b08f3-aa7a-4d77-8921-9fb856800ffb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:46.353562 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a82f52-b25f-4a3f-b62a-a5f05f8299c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:46.354244 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a82f52-b25f-4a3f-b62a-a5f05f8299c9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:46.354448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a82f52-b25f-4a3f-b62a-a5f05f8299c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:46.354722 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a82f52-b25f-4a3f-b62a-a5f05f8299c9 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:46.355494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a82f52-b25f-4a3f-b62a-a5f05f8299c9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:46.356325 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a82f52-b25f-4a3f-b62a-a5f05f8299c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:46.357742 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a82f52-b25f-4a3f-b62a-a5f05f8299c9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:46.377040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 306/599] 10.222.0.40 () {56 vars in 1139 bytes} [Tue Aug 9 06:56:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:46.381961 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a82f52-b25f-4a3f-b62a-a5f05f8299c9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:46.456468 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b08f3-aa7a-4d77-8921-9fb856800ffb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:46.479700 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:46.482719 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:46.495057 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a82f52-b25f-4a3f-b62a-a5f05f8299c9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:46.497193 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f70059-efe8-4d5a-8a65-d1dffd559f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:46.498108 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f70059-efe8-4d5a-8a65-d1dffd559f08 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:46.498545 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f70059-efe8-4d5a-8a65-d1dffd559f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:46.498965 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f70059-efe8-4d5a-8a65-d1dffd559f08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:46.506326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f70059-efe8-4d5a-8a65-d1dffd559f08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:46.508055 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f70059-efe8-4d5a-8a65-d1dffd559f08 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:46.520935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-54f70059-efe8-4d5a-8a65-d1dffd559f08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:46.520935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:46.520935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:46.520935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:46.520935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:46.520935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:46.520935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:46.520935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:46.520935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:46.520935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:46.520935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:46.520935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:46.520935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:56:46.520935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:56:46.520935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:56:46.522002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:56:46.522002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:46.522002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:46.522002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:46.522002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:46.522002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:46.522002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:46.522002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:46.522002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:46.522002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:46.522002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:46.522002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:46.522002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:46.522002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:46.522002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:46.522002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:46.522002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:46.523069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:56:46.523069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:56:46.523069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:56:46.523069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:56:46.523069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:56:46.523069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:56:46.523069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:46.523069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:46.525045 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 294/600] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:46.532579 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f70059-efe8-4d5a-8a65-d1dffd559f08 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:46.545541 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d69199-f322-4ba0-bd21-1d8f2f9ea1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:46.546304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d69199-f322-4ba0-bd21-1d8f2f9ea1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:46.546683 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d69199-f322-4ba0-bd21-1d8f2f9ea1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:46.547052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d69199-f322-4ba0-bd21-1d8f2f9ea1c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:46.558634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d69199-f322-4ba0-bd21-1d8f2f9ea1c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:46.560221 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d69199-f322-4ba0-bd21-1d8f2f9ea1c9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:46.575903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-80d69199-f322-4ba0-bd21-1d8f2f9ea1c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:46.575903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:46.575903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:46.575903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:46.575903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:46.575903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:46.575903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:46.575903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:46.575903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:46.575903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:46.575903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:46.575903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:46.575903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:46.575903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:46.575903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:46.575903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:46.576972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:46.576972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:46.576972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:46.576972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:46.576972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:46.576972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:46.576972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:46.576972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:46.576972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:46.576972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:46.576972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:46.576972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:46.576972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:46.576972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:46.576972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:46.576972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:46.576972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:46.577897 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:46.577897 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:46.577897 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:46.578070 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 307/601] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:56:46.584067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d69199-f322-4ba0-bd21-1d8f2f9ea1c9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:46.746333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f70059-efe8-4d5a-8a65-d1dffd559f08 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:46.769304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d69199-f322-4ba0-bd21-1d8f2f9ea1c9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:46.805473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170e490-333e-4b8c-a56c-17de9ae7cc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:46.806248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170e490-333e-4b8c-a56c-17de9ae7cc6f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:46.806712 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170e490-333e-4b8c-a56c-17de9ae7cc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:46.807129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170e490-333e-4b8c-a56c-17de9ae7cc6f None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:46.807961 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170e490-333e-4b8c-a56c-17de9ae7cc6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:46.808336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170e490-333e-4b8c-a56c-17de9ae7cc6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:46.810513 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170e490-333e-4b8c-a56c-17de9ae7cc6f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:46.823197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:46.828920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 308/602] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:46.832472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8827aef-149c-48ed-987c-376d2b65b4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:46.833509 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8827aef-149c-48ed-987c-376d2b65b4cb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:46.833999 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8827aef-149c-48ed-987c-376d2b65b4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:46.834397 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8827aef-149c-48ed-987c-376d2b65b4cb None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:46.835764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170e490-333e-4b8c-a56c-17de9ae7cc6f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:46.836147 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8827aef-149c-48ed-987c-376d2b65b4cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:46.836457 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8827aef-149c-48ed-987c-376d2b65b4cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:46.841693 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8827aef-149c-48ed-987c-376d2b65b4cb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:46.872250 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 295/603] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:56:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:46.877818 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8827aef-149c-48ed-987c-376d2b65b4cb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:46.971472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:47.039237 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170e490-333e-4b8c-a56c-17de9ae7cc6f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:47.088373 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8827aef-149c-48ed-987c-376d2b65b4cb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:47.119515 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131dbd8-405e-4d44-a1dc-06024ef9e3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:47.120158 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131dbd8-405e-4d44-a1dc-06024ef9e3eb None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:47.120487 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131dbd8-405e-4d44-a1dc-06024ef9e3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:47.120757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131dbd8-405e-4d44-a1dc-06024ef9e3eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:47.134952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131dbd8-405e-4d44-a1dc-06024ef9e3eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:47.136404 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131dbd8-405e-4d44-a1dc-06024ef9e3eb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:47.154073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-1131dbd8-405e-4d44-a1dc-06024ef9e3eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:47.154073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:47.154073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:47.154073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:47.154073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:47.154073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:47.154073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:47.154073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:47.154073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:47.154073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:47.154073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:47.154073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:47.154073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:56:47.154073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:56:47.154073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:56:47.154977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:56:47.154977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:47.154977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:47.154977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:47.154977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:47.154977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:47.154977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:47.154977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:47.154977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:47.154977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:47.154977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:47.154977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:47.154977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:47.154977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:47.154977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:47.154977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:47.154977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:47.155904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:56:47.155904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:56:47.155904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:56:47.155904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:56:47.155904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:56:47.155904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:56:47.155904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:47.155904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:47.155904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 309/604] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:47.161365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131dbd8-405e-4d44-a1dc-06024ef9e3eb None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:47.165653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f7e7e-c572-4be0-9692-debab7b27970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:47.166547 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f7e7e-c572-4be0-9692-debab7b27970 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:47.167123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f7e7e-c572-4be0-9692-debab7b27970 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:47.167611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f7e7e-c572-4be0-9692-debab7b27970 None admin] PATH_INFO: `/v3/projects/342524b45def418783374ff6733e94b9/users/8977d7479b3e405c976fa1a570987704/roles/b93b6b2c6da44593a6b95db1309b8a58` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:47.182814 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f7e7e-c572-4be0-9692-debab7b27970 None admin] RBAC: Authorizing `identity:create_grant(project_id=342524b45def418783374ff6733e94b9, user_id=8977d7479b3e405c976fa1a570987704, role_id=b93b6b2c6da44593a6b95db1309b8a58)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:47.184842 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f7e7e-c572-4be0-9692-debab7b27970 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:47.207392 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 296/605] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:56:46 2022] PUT /identity/v3/projects/342524b45def418783374ff6733e94b9/users/8977d7479b3e405c976fa1a570987704/roles/b93b6b2c6da44593a6b95db1309b8a58 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:56:47.251172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:47.252922 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f832b-dc45-4009-b401-a33fdeba96ce None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:47.253211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f832b-dc45-4009-b401-a33fdeba96ce None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:47.253475 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f832b-dc45-4009-b401-a33fdeba96ce None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:47.255167 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 297/606] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:47.261457 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f2bab-435e-421a-8e96-c103c7b933da None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:47.261735 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f2bab-435e-421a-8e96-c103c7b933da None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:47.262610 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f2bab-435e-421a-8e96-c103c7b933da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:47.296959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-850f2bab-435e-421a-8e96-c103c7b933da None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:47.299521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-850f2bab-435e-421a-8e96-c103c7b933da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:47.325669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131dbd8-405e-4d44-a1dc-06024ef9e3eb None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:47.363521 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e1b2e-a25d-4bda-9008-83d55c3cdb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:47.364137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e1b2e-a25d-4bda-9008-83d55c3cdb1d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:47.364365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e1b2e-a25d-4bda-9008-83d55c3cdb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:47.364577 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e1b2e-a25d-4bda-9008-83d55c3cdb1d None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:47.365286 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e1b2e-a25d-4bda-9008-83d55c3cdb1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:47.365591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e1b2e-a25d-4bda-9008-83d55c3cdb1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:47.367029 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e1b2e-a25d-4bda-9008-83d55c3cdb1d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:47.380523 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 310/607] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:56:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:47.385954 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e1b2e-a25d-4bda-9008-83d55c3cdb1d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:47.445801 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 298/608] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:47.472797 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f2bab-435e-421a-8e96-c103c7b933da None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:47.496834 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e1b2e-a25d-4bda-9008-83d55c3cdb1d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:47.502527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:47.520297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:47.536237 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d74beb-1015-4250-b33e-816566264abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:47.536899 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d74beb-1015-4250-b33e-816566264abc None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:47.537176 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d74beb-1015-4250-b33e-816566264abc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:47.537450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d74beb-1015-4250-b33e-816566264abc None admin] PATH_INFO: `/v3/projects/342524b45def418783374ff6733e94b9/users/8d75da9360ef490f910fabc3920c8ad0/roles/b93b6b2c6da44593a6b95db1309b8a58` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:47.560593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d74beb-1015-4250-b33e-816566264abc None admin] RBAC: Authorizing `identity:create_grant(project_id=342524b45def418783374ff6733e94b9, user_id=8d75da9360ef490f910fabc3920c8ad0, role_id=b93b6b2c6da44593a6b95db1309b8a58)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:47.562024 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d74beb-1015-4250-b33e-816566264abc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:47.583526 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 311/609] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:56:47 2022] PUT /identity/v3/projects/342524b45def418783374ff6733e94b9/users/8d75da9360ef490f910fabc3920c8ad0/roles/b93b6b2c6da44593a6b95db1309b8a58 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:56:47.585287 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1a424-336d-401b-9ef3-5cccd92ea0dd None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:47.585578 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1a424-336d-401b-9ef3-5cccd92ea0dd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:47.585856 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1a424-336d-401b-9ef3-5cccd92ea0dd None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:47.592503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 312/610] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:47.596796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe837f0f-fe35-43b9-b9ec-e13fa9040536 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:47.597425 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe837f0f-fe35-43b9-b9ec-e13fa9040536 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:47.597904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe837f0f-fe35-43b9-b9ec-e13fa9040536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:47.635178 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-fe837f0f-fe35-43b9-b9ec-e13fa9040536 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:47.638714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fe837f0f-fe35-43b9-b9ec-e13fa9040536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:47.641895 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f2bab-435e-421a-8e96-c103c7b933da None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:47.702391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2f5cf-aec8-4ab8-a83e-8dba43922199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:47.703040 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2f5cf-aec8-4ab8-a83e-8dba43922199 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:47.703328 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2f5cf-aec8-4ab8-a83e-8dba43922199 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:47.703597 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2f5cf-aec8-4ab8-a83e-8dba43922199 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:47.729354 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2f5cf-aec8-4ab8-a83e-8dba43922199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:47.742709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c7b2f5cf-aec8-4ab8-a83e-8dba43922199 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:47.742709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:47.742709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:47.742709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:47.742709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:47.742709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:47.742709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:47.742709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:47.742709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:47.742709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:47.742709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:47.742709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:47.742709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:47.742709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:47.742709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:47.742709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:47.743773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:47.743773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:47.743773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:47.743773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:47.743773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:47.743773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:47.743773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:47.743773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:47.743773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:47.743773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:47.743773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:47.743773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:47.743773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:47.743773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:47.743773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:47.743773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:47.745248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:47.745248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:47.745248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:47.745248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:47.745248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:47.745248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:47.745248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:47.745248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:47.745248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:47.745248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:47.745248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:47.745248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:47.745248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 299/611] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:56:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:47.752758 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2f5cf-aec8-4ab8-a83e-8dba43922199 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:47.794761 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 313/612] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:47.819021 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe837f0f-fe35-43b9-b9ec-e13fa9040536 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:47.872196 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:47.903585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2f5cf-aec8-4ab8-a83e-8dba43922199 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:47.942945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c232859-2461-4f36-92dd-94c56d1880ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:47.943837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c232859-2461-4f36-92dd-94c56d1880ee None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:47.944118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c232859-2461-4f36-92dd-94c56d1880ee None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:47.944390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c232859-2461-4f36-92dd-94c56d1880ee None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:47.945046 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c232859-2461-4f36-92dd-94c56d1880ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:47.945349 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c232859-2461-4f36-92dd-94c56d1880ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:47.946725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c232859-2461-4f36-92dd-94c56d1880ee None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:47.965784 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 300/613] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:56:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:47.971677 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c232859-2461-4f36-92dd-94c56d1880ee None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:47.986416 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:47.994504 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe837f0f-fe35-43b9-b9ec-e13fa9040536 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:48.044530 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40858d-0e97-45c6-b6f6-6521fb1975d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:48.045172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40858d-0e97-45c6-b6f6-6521fb1975d3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:48.045447 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40858d-0e97-45c6-b6f6-6521fb1975d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:48.045718 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40858d-0e97-45c6-b6f6-6521fb1975d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:48.057047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40858d-0e97-45c6-b6f6-6521fb1975d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:48.062963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-ed40858d-0e97-45c6-b6f6-6521fb1975d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:48.062963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:48.062963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:48.062963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:48.062963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:48.062963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:48.062963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:48.062963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:48.062963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:48.062963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:48.062963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:48.062963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:48.062963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:48.062963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:48.062963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:48.062963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:48.063994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:48.063994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:48.063994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:48.063994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:48.063994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:48.063994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:48.063994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:48.063994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:48.063994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:48.063994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:48.063994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:48.063994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:48.063994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:48.063994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:48.063994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:48.063994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:48.065293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:48.065293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:48.065293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:48.065293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:48.065293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:48.065293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:48.065293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:48.065293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:48.065293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:48.065293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:48.065293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:48.065293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:48.065293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 314/614] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:56:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:56:48.072004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40858d-0e97-45c6-b6f6-6521fb1975d3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:48.157158 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c232859-2461-4f36-92dd-94c56d1880ee None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:48.182141 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40858d-0e97-45c6-b6f6-6521fb1975d3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:48.219560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ffd18-1b6e-499d-b4fa-481e2583a578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:48.220161 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ffd18-1b6e-499d-b4fa-481e2583a578 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:48.220434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ffd18-1b6e-499d-b4fa-481e2583a578 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:48.220703 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ffd18-1b6e-499d-b4fa-481e2583a578 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:48.221356 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ffd18-1b6e-499d-b4fa-481e2583a578 None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:48.221652 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ffd18-1b6e-499d-b4fa-481e2583a578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:48.222995 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ffd18-1b6e-499d-b4fa-481e2583a578 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:48.232361 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 315/615] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:56:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:48.239117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ffd18-1b6e-499d-b4fa-481e2583a578 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:48.244757 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366fdb7-fe51-468b-8f19-01dede49c1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:48.245396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366fdb7-fe51-468b-8f19-01dede49c1fa None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:48.245676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366fdb7-fe51-468b-8f19-01dede49c1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:48.245947 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366fdb7-fe51-468b-8f19-01dede49c1fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:48.270185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:48.276152 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366fdb7-fe51-468b-8f19-01dede49c1fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:48.277654 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366fdb7-fe51-468b-8f19-01dede49c1fa None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:48.288442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:48.314010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8366fdb7-fe51-468b-8f19-01dede49c1fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:48.314010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:48.314010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:48.314010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:48.314010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:48.314010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:48.314010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:48.314010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:48.314010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:48.314010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:48.314010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:48.314010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:48.314010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:48.314010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:48.314010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:48.314010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:48.316348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:48.316348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:48.316348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:48.316348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:48.316348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:48.316348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:48.316348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:48.316348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:48.316348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:48.316348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:48.316348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:48.316348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:48.316348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:48.316348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:48.316348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:48.316348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:48.316348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:48.318513 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:48.318513 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:48.318513 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:48.323509 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 301/616] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:48.333311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366fdb7-fe51-468b-8f19-01dede49c1fa None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:48.383468 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ffd18-1b6e-499d-b4fa-481e2583a578 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:48.432041 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe19ec-d20f-40f5-9dce-08124e38bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:48.432584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe19ec-d20f-40f5-9dce-08124e38bf7e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:48.433126 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe19ec-d20f-40f5-9dce-08124e38bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:48.433381 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe19ec-d20f-40f5-9dce-08124e38bf7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:48.445241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe19ec-d20f-40f5-9dce-08124e38bf7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:48.446792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe19ec-d20f-40f5-9dce-08124e38bf7e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:48.461875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-e8fe19ec-d20f-40f5-9dce-08124e38bf7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:48.461875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:48.461875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:48.461875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:48.461875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:48.461875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:48.461875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:48.461875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:48.461875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:48.461875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:48.461875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:48.461875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:48.461875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:48.461875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:48.461875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:48.461875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:48.462843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:48.462843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:48.462843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:48.462843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:48.462843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:48.462843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:48.462843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:48.462843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:48.462843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:48.462843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:48.462843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:48.462843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:48.462843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:48.462843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:48.462843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:48.462843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:48.462843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:48.464162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:48.464162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:48.464162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:48.464162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 316/617] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:56:48.470587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe19ec-d20f-40f5-9dce-08124e38bf7e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:48.541107 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366fdb7-fe51-468b-8f19-01dede49c1fa None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:48.572977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:48.581632 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed15744-3881-4d57-9ea5-0fe71ca8ba4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:48.582401 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed15744-3881-4d57-9ea5-0fe71ca8ba4b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:48.582774 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed15744-3881-4d57-9ea5-0fe71ca8ba4b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:48.583179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed15744-3881-4d57-9ea5-0fe71ca8ba4b None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:48.583941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed15744-3881-4d57-9ea5-0fe71ca8ba4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:48.584334 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed15744-3881-4d57-9ea5-0fe71ca8ba4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:48.585782 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed15744-3881-4d57-9ea5-0fe71ca8ba4b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:48.598619 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 302/618] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:48.603302 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e5ce5-b699-4a24-9306-d65808c212da None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:48.603302 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e5ce5-b699-4a24-9306-d65808c212da None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:48.603302 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e5ce5-b699-4a24-9306-d65808c212da None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:48.606432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe19ec-d20f-40f5-9dce-08124e38bf7e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:48.606672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 303/619] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:48.607607 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e5ce5-b699-4a24-9306-d65808c212da None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:48.667875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bf581-30d0-4608-96fd-29b4752aa5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:48.669879 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bf581-30d0-4608-96fd-29b4752aa5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:48.670626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bf581-30d0-4608-96fd-29b4752aa5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:48.671111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bf581-30d0-4608-96fd-29b4752aa5a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:48.672200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bf581-30d0-4608-96fd-29b4752aa5a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:48.672972 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:48.673516 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bf581-30d0-4608-96fd-29b4752aa5a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:48.676566 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bf581-30d0-4608-96fd-29b4752aa5a0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:48.690038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 317/620] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:48.691533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc2e55-1177-4e6a-976d-a799e0f7f4ee None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:48.692419 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc2e55-1177-4e6a-976d-a799e0f7f4ee None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:48.692419 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc2e55-1177-4e6a-976d-a799e0f7f4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:48.713175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1ebc2e55-1177-4e6a-976d-a799e0f7f4ee None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:48.715296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1ebc2e55-1177-4e6a-976d-a799e0f7f4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:48.725787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e5ce5-b699-4a24-9306-d65808c212da None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:48.768994 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04063c4e-148b-4805-8c3f-0ff5352898b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:48.769822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063c4e-148b-4805-8c3f-0ff5352898b6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:48.770192 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063c4e-148b-4805-8c3f-0ff5352898b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:48.770553 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063c4e-148b-4805-8c3f-0ff5352898b6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:48.781352 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04063c4e-148b-4805-8c3f-0ff5352898b6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:48.782916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04063c4e-148b-4805-8c3f-0ff5352898b6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:48.796923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-04063c4e-148b-4805-8c3f-0ff5352898b6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 06:56:48.796923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:48.796923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:48.796923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:48.796923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:48.796923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:48.796923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:48.796923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:48.796923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:48.796923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:48.796923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:48.796923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:48.796923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:56:48.796923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:56:48.796923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:56:48.796923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:56:48.797869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:48.797869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:48.797869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:56:48.797869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:48.797869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:56:48.797869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:48.797869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:48.797869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:48.797869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:48.797869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:48.797869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:48.797869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:48.797869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:48.797869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:48.797869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:48.797869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:48.797869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:48.797869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:48.798827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:48.798827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:48.798827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:56:48.798827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:56:48.798827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:56:48.798827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:56:48.798827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:56:48.798827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:56:48.798827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 06:56:48.798827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:48.806129 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 304/622] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:56:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:48.807195 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04063c4e-148b-4805-8c3f-0ff5352898b6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:48.807303 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 318/622] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:48.808163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc2e55-1177-4e6a-976d-a799e0f7f4ee None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:48.885018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:48.935867 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc2e55-1177-4e6a-976d-a799e0f7f4ee None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:48.948475 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04063c4e-148b-4805-8c3f-0ff5352898b6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:48.973486 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:48.987965 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa291354-b9f9-4482-91b4-39137d75f842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:48.988579 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa291354-b9f9-4482-91b4-39137d75f842 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:48.988906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa291354-b9f9-4482-91b4-39137d75f842 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:48.989187 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa291354-b9f9-4482-91b4-39137d75f842 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:48.990011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa291354-b9f9-4482-91b4-39137d75f842 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:48.990148 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134833a-616e-4806-a628-d7cd1c2aac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:48.990318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa291354-b9f9-4482-91b4-39137d75f842 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:48.990711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134833a-616e-4806-a628-d7cd1c2aac92 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:48.990986 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134833a-616e-4806-a628-d7cd1c2aac92 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:48.991280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134833a-616e-4806-a628-d7cd1c2aac92 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:48.991772 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa291354-b9f9-4482-91b4-39137d75f842 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:49.001193 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134833a-616e-4806-a628-d7cd1c2aac92 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:49.002631 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134833a-616e-4806-a628-d7cd1c2aac92 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:49.016406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 319/623] 10.222.0.40 () {56 vars in 1135 bytes} [Tue Aug 9 06:56:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:49.017303 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa291354-b9f9-4482-91b4-39137d75f842 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:49.017746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1134833a-616e-4806-a628-d7cd1c2aac92 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 06:56:49.017746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:49.017746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:49.017746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:49.017746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:49.017746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:49.017746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:49.017746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:49.017746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:49.017746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:49.017746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:49.017746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:49.017746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:56:49.017746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:56:49.017746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:56:49.017746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:56:49.018646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:49.018646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:49.018646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:56:49.018646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:49.018646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:56:49.018646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:49.018646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:49.018646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:49.018646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:49.018646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:49.018646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:49.018646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:49.018646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:49.018646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:49.018646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:49.018646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:49.018646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:49.018646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:49.019697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:49.019697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:49.019697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:56:49.019697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:56:49.019697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:56:49.019697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:56:49.019697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:56:49.019697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:56:49.019697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 06:56:49.019697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:49.023106 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 305/624] 10.222.0.40 () {56 vars in 1093 bytes} [Tue Aug 9 06:56:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:49.024144 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134833a-616e-4806-a628-d7cd1c2aac92 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:49.139869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134833a-616e-4806-a628-d7cd1c2aac92 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:49.141909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa291354-b9f9-4482-91b4-39137d75f842 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:49.172812 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:49.176411 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f2db0-f759-4f2d-bc92-530279644e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:49.177151 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2db0-f759-4f2d-bc92-530279644e6b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:49.177612 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2db0-f759-4f2d-bc92-530279644e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:49.177936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2db0-f759-4f2d-bc92-530279644e6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:49.187376 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac859550-aab6-4047-9825-bec29562dd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:49.188204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac859550-aab6-4047-9825-bec29562dd04 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:49.189015 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac859550-aab6-4047-9825-bec29562dd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:49.189441 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac859550-aab6-4047-9825-bec29562dd04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:49.191071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f2db0-f759-4f2d-bc92-530279644e6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:49.192898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f2db0-f759-4f2d-bc92-530279644e6b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:49.203048 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac859550-aab6-4047-9825-bec29562dd04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:49.208241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-ac859550-aab6-4047-9825-bec29562dd04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:49.208241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:49.208241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:49.208241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:49.208241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:49.208241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:49.208241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:49.208241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:49.208241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:49.208241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:49.208241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:49.208241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:49.208241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:49.208241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:49.208241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:49.208241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:49.209171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:49.209171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:49.209171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:49.209171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:49.209171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:49.209171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:49.209171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:49.209171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:49.209171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:49.209171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:49.209171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:49.209171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:49.209171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:49.209171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:49.209171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:49.209171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:49.210004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:49.210004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:49.210004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:49.210004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:49.210004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:49.210004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:49.210004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:49.210004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:49.210004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:49.210004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:49.210004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:49.210004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:49.210653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ae7f2db0-f759-4f2d-bc92-530279644e6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:49.210653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:49.210653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:49.210653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:49.210653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:49.210653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:49.210653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:49.210653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:49.210653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:49.210653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:49.210653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:49.210653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:49.210653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:49.210653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:49.210653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:49.210653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:49.211573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:49.211573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:49.211573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:49.211573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:49.211573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:49.211573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:49.211573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:49.211573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:49.211573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:49.211573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:49.211573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:49.211573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:49.211573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:49.211573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:49.211573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:49.211573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:49.211573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:49.212492 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:49.212492 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:49.212492 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:49.212492 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 306/625] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:49.212492 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f2db0-f759-4f2d-bc92-530279644e6b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:49.216385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 320/626] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:56:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:49.217453 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac859550-aab6-4047-9825-bec29562dd04 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:49.242851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:49.324811 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f2db0-f759-4f2d-bc92-530279644e6b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:49.358454 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac859550-aab6-4047-9825-bec29562dd04 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:49.363762 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989823d-0010-4a40-9758-379e3a821d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:49.364437 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989823d-0010-4a40-9758-379e3a821d27 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:49.364778 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989823d-0010-4a40-9758-379e3a821d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:49.365115 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989823d-0010-4a40-9758-379e3a821d27 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:49.365894 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989823d-0010-4a40-9758-379e3a821d27 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:49.366278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989823d-0010-4a40-9758-379e3a821d27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:49.367784 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989823d-0010-4a40-9758-379e3a821d27 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:49.385845 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 307/627] 10.222.0.40 () {56 vars in 1133 bytes} [Tue Aug 9 06:56:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:49.387402 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989823d-0010-4a40-9758-379e3a821d27 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:49.406870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1f045-ce8f-4341-ac15-05996e4cec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:49.408258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1f045-ce8f-4341-ac15-05996e4cec37 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:49.408793 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1f045-ce8f-4341-ac15-05996e4cec37 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:49.409237 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1f045-ce8f-4341-ac15-05996e4cec37 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:49.410103 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1f045-ce8f-4341-ac15-05996e4cec37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:49.410578 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1f045-ce8f-4341-ac15-05996e4cec37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:49.412279 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1f045-ce8f-4341-ac15-05996e4cec37 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:49.426312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 321/628] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:49.427481 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1f045-ce8f-4341-ac15-05996e4cec37 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:49.476471 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:49.477414 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:49.493971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989823d-0010-4a40-9758-379e3a821d27 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:49.531416 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f71d2c-405d-48a2-9132-8fcccc3557cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:49.532046 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f71d2c-405d-48a2-9132-8fcccc3557cf None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:49.532320 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f71d2c-405d-48a2-9132-8fcccc3557cf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:49.532588 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f71d2c-405d-48a2-9132-8fcccc3557cf None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:49.533344 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f71d2c-405d-48a2-9132-8fcccc3557cf None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:49.533651 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f71d2c-405d-48a2-9132-8fcccc3557cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:49.534995 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f71d2c-405d-48a2-9132-8fcccc3557cf None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:49.542842 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1f045-ce8f-4341-ac15-05996e4cec37 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:49.545196 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 308/629] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:56:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:49.546135 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f71d2c-405d-48a2-9132-8fcccc3557cf None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:49.582277 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cdf94-a7a5-4cdb-9ad0-9b73865a6887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:49.583071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cdf94-a7a5-4cdb-9ad0-9b73865a6887 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:49.583381 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cdf94-a7a5-4cdb-9ad0-9b73865a6887 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:49.584449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cdf94-a7a5-4cdb-9ad0-9b73865a6887 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:49.654354 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f71d2c-405d-48a2-9132-8fcccc3557cf None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:49.660336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cdf94-a7a5-4cdb-9ad0-9b73865a6887 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:49.661776 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cdf94-a7a5-4cdb-9ad0-9b73865a6887 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:49.690021 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3f191-3608-48ca-a246-3f265cdf5a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:49.690960 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3f191-3608-48ca-a246-3f265cdf5a1d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:49.691553 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3f191-3608-48ca-a246-3f265cdf5a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:49.692112 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3f191-3608-48ca-a246-3f265cdf5a1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:49.698948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3f191-3608-48ca-a246-3f265cdf5a1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:49.700933 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3f191-3608-48ca-a246-3f265cdf5a1d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:49.704350 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:49.713266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-0ee3f191-3608-48ca-a246-3f265cdf5a1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:49.713266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:49.713266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:49.713266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:49.713266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:49.713266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:49.713266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:49.713266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:49.713266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:49.713266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:49.713266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:49.713266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:49.713266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:56:49.713266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:56:49.713266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:56:49.714201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:56:49.714201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:49.714201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:49.714201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:49.714201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:49.714201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:49.714201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:49.714201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:49.714201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:49.714201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:49.714201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:49.714201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:49.714201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:49.714201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:49.714201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:49.714201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:49.714201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:49.716016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:56:49.716016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:56:49.716016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:56:49.716016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:56:49.716016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:56:49.716016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:56:49.716016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:49.716016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:49.716016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 309/630] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:49.716016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3f191-3608-48ca-a246-3f265cdf5a1d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:49.729576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:49.775032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 322/631] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:49.776795 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1581aa4-754f-4c70-a7df-28e007dab7fc None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:49.777167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1581aa4-754f-4c70-a7df-28e007dab7fc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:49.778052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1581aa4-754f-4c70-a7df-28e007dab7fc None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:49.783126 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 323/632] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:49.783126 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1581aa4-754f-4c70-a7df-28e007dab7fc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:49.829848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3f191-3608-48ca-a246-3f265cdf5a1d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:49.867565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55502c3e-b33f-4121-a6f1-088262d62f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:49.868195 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55502c3e-b33f-4121-a6f1-088262d62f8f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:49.868472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55502c3e-b33f-4121-a6f1-088262d62f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:49.868806 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55502c3e-b33f-4121-a6f1-088262d62f8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:49.879438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55502c3e-b33f-4121-a6f1-088262d62f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:49.880877 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55502c3e-b33f-4121-a6f1-088262d62f8f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:49.891255 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1581aa4-754f-4c70-a7df-28e007dab7fc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:49.894641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-55502c3e-b33f-4121-a6f1-088262d62f8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:49.894641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:49.894641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:49.894641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:49.894641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:49.894641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:49.894641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:49.894641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:49.894641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:49.894641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:49.894641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:49.894641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:49.894641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:49.894641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:49.894641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:49.894641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:49.895790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:49.895790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:49.895790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:49.895790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:49.895790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:49.895790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:49.895790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:49.895790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:49.895790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:49.895790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:49.895790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:49.895790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:49.895790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:49.895790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:49.895790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:49.895790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:49.895790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:49.896724 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:49.896724 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:49.896724 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:49.900772 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 310/633] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:49.901455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55502c3e-b33f-4121-a6f1-088262d62f8f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:49.925574 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4380ce2-9bda-40ce-bb5d-3db0cb116662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:49.926179 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4380ce2-9bda-40ce-bb5d-3db0cb116662 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:49.926444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4380ce2-9bda-40ce-bb5d-3db0cb116662 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:49.926711 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4380ce2-9bda-40ce-bb5d-3db0cb116662 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:49.927420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4380ce2-9bda-40ce-bb5d-3db0cb116662 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:49.927724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4380ce2-9bda-40ce-bb5d-3db0cb116662 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:49.929135 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4380ce2-9bda-40ce-bb5d-3db0cb116662 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:49.946515 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 324/634] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:56:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:49.947821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ac6e-1f6a-4481-8ec6-bc4cc0c1db08 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:49.948240 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ac6e-1f6a-4481-8ec6-bc4cc0c1db08 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:49.948375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ac6e-1f6a-4481-8ec6-bc4cc0c1db08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:49.954420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:49.966721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c5e4ac6e-1f6a-4481-8ec6-bc4cc0c1db08 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:49.967925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c5e4ac6e-1f6a-4481-8ec6-bc4cc0c1db08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:49.968204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:50.008078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55502c3e-b33f-4121-a6f1-088262d62f8f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:50.034512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 325/635] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:50.035427 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4ac6e-1f6a-4481-8ec6-bc4cc0c1db08 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:50.042136 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4ecfa-abb9-46f9-be5f-a8977fed81e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:50.042765 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4ecfa-abb9-46f9-be5f-a8977fed81e3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:50.043902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4ecfa-abb9-46f9-be5f-a8977fed81e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:50.043902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4ecfa-abb9-46f9-be5f-a8977fed81e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:50.055749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4ecfa-abb9-46f9-be5f-a8977fed81e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:50.057271 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4ecfa-abb9-46f9-be5f-a8977fed81e3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:50.071186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-98b4ecfa-abb9-46f9-be5f-a8977fed81e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:50.071186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:50.071186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:50.071186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:50.071186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:50.071186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:50.071186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:50.071186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:50.071186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:50.071186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:50.071186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:50.071186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:50.071186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:50.071186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:50.071186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:50.071186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:50.072307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:50.072307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:50.072307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:50.072307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:50.072307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:50.072307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:50.072307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:50.072307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:50.072307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:50.072307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:50.072307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:50.072307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:50.072307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:50.072307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:50.072307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:50.072307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:50.072307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:50.073413 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:50.073413 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:50.073413 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:50.077418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 311/636] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:50.078098 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4ecfa-abb9-46f9-be5f-a8977fed81e3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:50.134616 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4ac6e-1f6a-4481-8ec6-bc4cc0c1db08 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:50.163396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:50.168487 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0677b9-56dd-4546-9cc2-1106273f7f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:50.169076 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0677b9-56dd-4546-9cc2-1106273f7f8b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:50.169345 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0677b9-56dd-4546-9cc2-1106273f7f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:50.169610 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0677b9-56dd-4546-9cc2-1106273f7f8b None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:50.170239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0677b9-56dd-4546-9cc2-1106273f7f8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:50.170611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0677b9-56dd-4546-9cc2-1106273f7f8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:50.171902 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0677b9-56dd-4546-9cc2-1106273f7f8b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:50.175270 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4ecfa-abb9-46f9-be5f-a8977fed81e3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:50.182642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 326/637] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:50.183926 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60328727-a4a9-4070-9799-c74b2624dc55 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:50.184219 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60328727-a4a9-4070-9799-c74b2624dc55 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:50.184486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60328727-a4a9-4070-9799-c74b2624dc55 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:50.185833 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 327/638] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:50.186370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60328727-a4a9-4070-9799-c74b2624dc55 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:50.193482 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:50.216068 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f75486-869d-44b6-82b0-8a51f8f73622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:50.216707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f75486-869d-44b6-82b0-8a51f8f73622 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:50.216981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f75486-869d-44b6-82b0-8a51f8f73622 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:50.217245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f75486-869d-44b6-82b0-8a51f8f73622 None admin] PATH_INFO: `/v3/projects/342524b45def418783374ff6733e94b9/users/92f19a17424c44eea58efb957246cb48/roles/b93b6b2c6da44593a6b95db1309b8a58` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:50.231376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f75486-869d-44b6-82b0-8a51f8f73622 None admin] RBAC: Authorizing `identity:create_grant(project_id=342524b45def418783374ff6733e94b9, user_id=92f19a17424c44eea58efb957246cb48, role_id=b93b6b2c6da44593a6b95db1309b8a58)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:50.232809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f75486-869d-44b6-82b0-8a51f8f73622 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:50.244503 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 312/639] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:56:50 2022] PUT /identity/v3/projects/342524b45def418783374ff6733e94b9/users/92f19a17424c44eea58efb957246cb48/roles/b93b6b2c6da44593a6b95db1309b8a58 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:56:50.245301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f75486-869d-44b6-82b0-8a51f8f73622 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:50.294211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60328727-a4a9-4070-9799-c74b2624dc55 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:50.333173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79704a8c-ff9c-4365-83a4-84817fb54738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:50.333811 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79704a8c-ff9c-4365-83a4-84817fb54738 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:50.334100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79704a8c-ff9c-4365-83a4-84817fb54738 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:50.335900 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79704a8c-ff9c-4365-83a4-84817fb54738 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:50.349628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79704a8c-ff9c-4365-83a4-84817fb54738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:50.357512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-79704a8c-ff9c-4365-83a4-84817fb54738 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:50.357512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:50.357512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:50.357512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:50.357512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:50.357512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:50.357512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:50.357512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:50.357512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:50.357512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:50.357512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:50.357512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:50.357512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:50.357512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:50.357512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:50.357512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:50.358676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:50.358676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:50.358676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:50.358676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:50.358676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:50.358676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:50.358676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:50.358676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:50.358676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:50.358676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:50.358676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:50.358676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:50.358676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:50.358676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:50.358676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:50.358676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:50.359593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:50.359593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:50.359593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:50.359593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:50.359593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:50.359593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:50.359593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:50.359593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:50.359593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:50.359593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:50.359593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:50.359593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:50.359593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 328/640] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:56:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:50.360726 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79704a8c-ff9c-4365-83a4-84817fb54738 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:50.383691 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f75486-869d-44b6-82b0-8a51f8f73622 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:50.422496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:50.430312 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c008ebf-7e6b-4a55-9147-6404330e1886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:50.430921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c008ebf-7e6b-4a55-9147-6404330e1886 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:50.431377 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c008ebf-7e6b-4a55-9147-6404330e1886 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:50.431650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c008ebf-7e6b-4a55-9147-6404330e1886 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:50.432399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c008ebf-7e6b-4a55-9147-6404330e1886 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:50.432701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c008ebf-7e6b-4a55-9147-6404330e1886 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:50.434603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c008ebf-7e6b-4a55-9147-6404330e1886 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:50.451114 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 313/641] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:50.451114 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ff8cd-de23-40ff-8382-9b6ad5b1cbaa None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:50.451114 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ff8cd-de23-40ff-8382-9b6ad5b1cbaa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:50.451114 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ff8cd-de23-40ff-8382-9b6ad5b1cbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:50.467918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-298ff8cd-de23-40ff-8382-9b6ad5b1cbaa None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:50.469218 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-298ff8cd-de23-40ff-8382-9b6ad5b1cbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:50.475917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79704a8c-ff9c-4365-83a4-84817fb54738 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:50.486803 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:50.512594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92017cb7-25eb-42c4-ac8a-ada4230f87d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:50.513319 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92017cb7-25eb-42c4-ac8a-ada4230f87d3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:50.513668 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92017cb7-25eb-42c4-ac8a-ada4230f87d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:50.514005 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92017cb7-25eb-42c4-ac8a-ada4230f87d3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:50.521573 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92017cb7-25eb-42c4-ac8a-ada4230f87d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:50.523090 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92017cb7-25eb-42c4-ac8a-ada4230f87d3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:50.535071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-92017cb7-25eb-42c4-ac8a-ada4230f87d3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 06:56:50.535071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:50.535071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:50.535071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:50.535071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:50.535071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:50.535071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:50.535071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:50.535071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:50.535071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:50.535071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:50.535071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:50.535071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:56:50.535071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:56:50.535071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:56:50.535071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:56:50.536136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:50.536136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:50.536136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:56:50.536136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:50.536136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:56:50.536136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:50.536136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:50.536136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:50.536136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:50.536136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:50.536136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:50.536136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:50.536136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:50.536136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:50.536136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:50.536136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:50.536136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:50.536136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:50.537110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:50.537110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:50.537110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:56:50.537110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:56:50.537110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:56:50.537110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:56:50.537110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:56:50.537110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:56:50.537110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 06:56:50.537110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:50.537110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 329/642] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:50.537110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92017cb7-25eb-42c4-ac8a-ada4230f87d3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:50.559489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 314/643] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:50.560298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ff8cd-de23-40ff-8382-9b6ad5b1cbaa None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:50.646199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92017cb7-25eb-42c4-ac8a-ada4230f87d3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:50.662373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:50.678948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ff8cd-de23-40ff-8382-9b6ad5b1cbaa None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:50.686288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13300937-0bd9-4817-ab28-ed0bf4fdb5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:50.686903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13300937-0bd9-4817-ab28-ed0bf4fdb5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:50.687279 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13300937-0bd9-4817-ab28-ed0bf4fdb5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:50.687694 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13300937-0bd9-4817-ab28-ed0bf4fdb5a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:50.688375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13300937-0bd9-4817-ab28-ed0bf4fdb5a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:50.688677 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13300937-0bd9-4817-ab28-ed0bf4fdb5a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:50.690182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13300937-0bd9-4817-ab28-ed0bf4fdb5a5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:50.701675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 330/644] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:56:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:50.701675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13300937-0bd9-4817-ab28-ed0bf4fdb5a5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:50.719876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e8c19-20d8-4087-ad49-2a92d3a17f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:50.720750 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e8c19-20d8-4087-ad49-2a92d3a17f10 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:50.721093 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e8c19-20d8-4087-ad49-2a92d3a17f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:50.721366 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e8c19-20d8-4087-ad49-2a92d3a17f10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:50.728879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e8c19-20d8-4087-ad49-2a92d3a17f10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:50.730620 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e8c19-20d8-4087-ad49-2a92d3a17f10 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:50.742931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-af0e8c19-20d8-4087-ad49-2a92d3a17f10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:50.742931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:50.742931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:50.742931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:50.742931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:50.742931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:50.742931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:50.742931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:50.742931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:50.742931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:50.742931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:50.742931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:50.742931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:56:50.742931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:56:50.742931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:56:50.743889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:56:50.743889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:50.743889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:50.743889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:50.743889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:50.743889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:50.743889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:50.743889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:50.743889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:50.743889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:50.743889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:50.743889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:50.743889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:50.743889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:50.743889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:50.743889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:50.743889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:50.744956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:56:50.744956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:56:50.744956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:56:50.744956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:56:50.744956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:56:50.744956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:56:50.744956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:50.744956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:50.747448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 315/645] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:50.748488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e8c19-20d8-4087-ad49-2a92d3a17f10 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:50.765670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:50.827879 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13300937-0bd9-4817-ab28-ed0bf4fdb5a5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:50.864656 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62883d5d-2916-4158-a07d-27e98559f9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:50.871219 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62883d5d-2916-4158-a07d-27e98559f9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:50.871219 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62883d5d-2916-4158-a07d-27e98559f9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:50.871219 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62883d5d-2916-4158-a07d-27e98559f9e2 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:50.871219 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62883d5d-2916-4158-a07d-27e98559f9e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:50.871219 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62883d5d-2916-4158-a07d-27e98559f9e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:50.871219 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62883d5d-2916-4158-a07d-27e98559f9e2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:50.881497 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e8c19-20d8-4087-ad49-2a92d3a17f10 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:50.896592 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 331/646] 10.222.0.40 () {56 vars in 1137 bytes} [Tue Aug 9 06:56:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:50.897654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62883d5d-2916-4158-a07d-27e98559f9e2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:50.923682 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6818c-2710-408d-94c9-78685615d44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:50.924311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6818c-2710-408d-94c9-78685615d44d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:50.924586 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6818c-2710-408d-94c9-78685615d44d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:50.924964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6818c-2710-408d-94c9-78685615d44d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:50.929114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:50.937817 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6818c-2710-408d-94c9-78685615d44d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:50.943130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1ab6818c-2710-408d-94c9-78685615d44d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:50.943130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:50.943130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:50.943130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:50.943130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:50.943130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:50.943130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:50.943130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:50.943130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:50.943130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:50.943130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:50.943130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:50.943130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:50.943130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:50.943130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:50.943130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:50.944120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:50.944120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:50.944120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:50.944120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:50.944120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:50.944120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:50.944120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:50.944120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:50.944120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:50.944120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:50.944120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:50.944120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:50.944120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:50.944120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:50.944120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:50.944120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:50.945012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:50.945012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:50.945012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:50.945012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:50.945012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:50.945012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:50.945012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:50.945012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:50.945012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:50.945012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:50.945012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:50.945012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:50.945012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 316/647] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:56:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:50.945012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6818c-2710-408d-94c9-78685615d44d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:51.005418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62883d5d-2916-4158-a07d-27e98559f9e2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:51.021775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:51.049251 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b319a-9214-4501-b896-70bb5a9bf95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:51.050190 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b319a-9214-4501-b896-70bb5a9bf95e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:51.050723 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b319a-9214-4501-b896-70bb5a9bf95e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:51.051017 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b319a-9214-4501-b896-70bb5a9bf95e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:51.052438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6818c-2710-408d-94c9-78685615d44d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:51.061667 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b319a-9214-4501-b896-70bb5a9bf95e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:51.063105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b319a-9214-4501-b896-70bb5a9bf95e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:51.077507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-7f2b319a-9214-4501-b896-70bb5a9bf95e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:51.077507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:51.077507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:51.077507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:51.077507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:51.077507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:51.077507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:51.077507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:51.077507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:51.077507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:51.077507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:51.077507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:51.077507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:51.077507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:51.077507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:51.077507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:51.078519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:51.078519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:51.078519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:51.078519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:51.078519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:51.078519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:51.078519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:51.078519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:51.078519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:51.078519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:51.078519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:51.078519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:51.078519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:51.078519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:51.078519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:51.078519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:51.078519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:51.079470 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:51.079470 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:51.079470 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:51.079470 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 332/648] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:51.079965 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b319a-9214-4501-b896-70bb5a9bf95e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:51.095738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb6fb7-5153-4c24-9c95-7857ec064817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:51.096618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb6fb7-5153-4c24-9c95-7857ec064817 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:51.097039 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb6fb7-5153-4c24-9c95-7857ec064817 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:51.097293 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb6fb7-5153-4c24-9c95-7857ec064817 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:51.098034 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb6fb7-5153-4c24-9c95-7857ec064817 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:51.098400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb6fb7-5153-4c24-9c95-7857ec064817 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:51.099861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb6fb7-5153-4c24-9c95-7857ec064817 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:51.113135 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 317/649] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:56:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:51.114015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb6fb7-5153-4c24-9c95-7857ec064817 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:51.173486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:51.190501 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b319a-9214-4501-b896-70bb5a9bf95e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:51.217564 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb6fb7-5153-4c24-9c95-7857ec064817 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:51.225048 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0eb142-655d-43b9-8ecc-6270b49f9322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:51.225645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eb142-655d-43b9-8ecc-6270b49f9322 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:51.225917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eb142-655d-43b9-8ecc-6270b49f9322 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:51.226185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eb142-655d-43b9-8ecc-6270b49f9322 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:51.250348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:51.256369 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370784b-3164-47ca-9365-5ed724f0dc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:51.257094 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370784b-3164-47ca-9365-5ed724f0dc01 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:51.257264 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370784b-3164-47ca-9365-5ed724f0dc01 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:51.257493 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370784b-3164-47ca-9365-5ed724f0dc01 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:51.258150 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370784b-3164-47ca-9365-5ed724f0dc01 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:51.258448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370784b-3164-47ca-9365-5ed724f0dc01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:51.259857 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370784b-3164-47ca-9365-5ed724f0dc01 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:51.275756 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 318/650] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:56:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:51.275756 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370784b-3164-47ca-9365-5ed724f0dc01 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:51.313642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0eb142-655d-43b9-8ecc-6270b49f9322 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:51.315108 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0eb142-655d-43b9-8ecc-6270b49f9322 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:51.382609 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370784b-3164-47ca-9365-5ed724f0dc01 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:51.407298 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:51.418705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5285b-02a0-4bbb-b450-3c3fc378633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:51.419319 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5285b-02a0-4bbb-b450-3c3fc378633b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:51.419592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5285b-02a0-4bbb-b450-3c3fc378633b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:51.419859 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5285b-02a0-4bbb-b450-3c3fc378633b None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:51.420488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5285b-02a0-4bbb-b450-3c3fc378633b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:51.420786 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5285b-02a0-4bbb-b450-3c3fc378633b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:51.422145 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5285b-02a0-4bbb-b450-3c3fc378633b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:51.425538 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 333/651] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:51.426935 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0eb142-655d-43b9-8ecc-6270b49f9322 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:51.436140 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 319/652] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:51.436963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5285b-02a0-4bbb-b450-3c3fc378633b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:51.493280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:51.535777 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0eb142-655d-43b9-8ecc-6270b49f9322 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:51.544341 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5285b-02a0-4bbb-b450-3c3fc378633b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:51.572279 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593e688-6e77-4a24-a092-b58a32ce5115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:51.572877 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593e688-6e77-4a24-a092-b58a32ce5115 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:51.573156 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593e688-6e77-4a24-a092-b58a32ce5115 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:51.573428 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593e688-6e77-4a24-a092-b58a32ce5115 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:51.574140 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593e688-6e77-4a24-a092-b58a32ce5115 None admin] RBAC: Adding query filter params (role.id=b93b6b2c6da44593a6b95db1309b8a58, scope.project.id=342524b45def418783374ff6733e94b9, user.id=6e949d9666be44a0b6122d510168c7ab) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:51.575043 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593e688-6e77-4a24-a092-b58a32ce5115 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:51.576469 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593e688-6e77-4a24-a092-b58a32ce5115 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:51.582518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 334/653] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:56:51 2022] GET /identity/v3/role_assignments?user.id=6e949d9666be44a0b6122d510168c7ab&scope.project.id=342524b45def418783374ff6733e94b9&role.id=b93b6b2c6da44593a6b95db1309b8a58 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:51.582694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd621d4b-5576-4f0d-aec3-7929ba69c895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:51.583330 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd621d4b-5576-4f0d-aec3-7929ba69c895 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:51.583667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd621d4b-5576-4f0d-aec3-7929ba69c895 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:51.583938 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd621d4b-5576-4f0d-aec3-7929ba69c895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:51.592143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593e688-6e77-4a24-a092-b58a32ce5115 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:51.596155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd621d4b-5576-4f0d-aec3-7929ba69c895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:51.597791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd621d4b-5576-4f0d-aec3-7929ba69c895 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:51.623443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-fd621d4b-5576-4f0d-aec3-7929ba69c895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:51.623443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:51.623443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:51.623443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:51.623443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:51.623443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:51.623443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:51.623443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:51.623443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:51.623443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:51.623443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:51.623443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:51.623443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:51.623443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:51.623443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:51.623443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:51.624768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:51.624768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:51.624768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:51.624768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:51.624768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:51.624768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:51.624768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:51.624768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:51.624768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:51.624768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:51.624768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:51.624768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:51.624768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:51.624768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:51.624768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:51.624768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:51.624768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:51.625896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:51.625896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:51.625896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:51.637442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 320/654] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:51.637442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd621d4b-5576-4f0d-aec3-7929ba69c895 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:51.667421 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:51.725907 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593e688-6e77-4a24-a092-b58a32ce5115 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:51.763736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c9df5-b8f8-4458-ade9-108c8da83349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:51.764540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c9df5-b8f8-4458-ade9-108c8da83349 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:51.769261 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c9df5-b8f8-4458-ade9-108c8da83349 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:51.769261 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c9df5-b8f8-4458-ade9-108c8da83349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:51.772214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd621d4b-5576-4f0d-aec3-7929ba69c895 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:51.778959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c9df5-b8f8-4458-ade9-108c8da83349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:51.780136 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:51.781711 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c9df5-b8f8-4458-ade9-108c8da83349 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:51.802893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-131c9df5-b8f8-4458-ade9-108c8da83349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:51.802893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:51.802893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:51.802893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:51.802893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:51.802893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:51.802893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:51.802893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:51.802893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:51.802893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:51.802893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:51.802893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:51.802893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:51.802893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:51.802893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:51.802893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:51.804132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:51.804132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:51.804132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:51.804132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:51.804132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:51.804132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:51.804132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:51.804132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:51.804132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:51.804132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:51.804132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:51.804132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:51.804132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:51.804132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:51.804132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:51.804132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:51.804132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:51.805212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:51.805212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:51.805212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:51.805212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 335/655] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:51.805501 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c9df5-b8f8-4458-ade9-108c8da83349 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:51.818314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dce76-654c-4148-b715-43eb34fa4973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:51.819124 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dce76-654c-4148-b715-43eb34fa4973 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:51.819939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dce76-654c-4148-b715-43eb34fa4973 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:51.819939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dce76-654c-4148-b715-43eb34fa4973 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:51.828376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6dce76-654c-4148-b715-43eb34fa4973 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:51.830198 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6dce76-654c-4148-b715-43eb34fa4973 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:51.845666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8d6dce76-654c-4148-b715-43eb34fa4973 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 06:56:51.845666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:51.845666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:51.845666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:51.845666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:51.845666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:51.845666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:51.845666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:51.845666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:51.845666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:51.845666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:51.845666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:51.845666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:56:51.845666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:56:51.845666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:56:51.845666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:56:51.846672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:51.846672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:51.846672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:56:51.846672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:51.846672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:56:51.846672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:51.846672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:51.846672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:51.846672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:51.846672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:51.846672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:51.846672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:51.846672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:51.846672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:51.846672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:51.846672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:51.846672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:51.846672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:51.847912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:51.847912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:51.847912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:56:51.847912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:56:51.847912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:56:51.847912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:56:51.847912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:56:51.847912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:56:51.847912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 06:56:51.847912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:51.851795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 321/656] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:51.851795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dce76-654c-4148-b715-43eb34fa4973 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:51.929464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:51.933031 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c9df5-b8f8-4458-ade9-108c8da83349 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:51.976726 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913970d3-af27-45d3-af28-e14efcb6d56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:51.977328 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913970d3-af27-45d3-af28-e14efcb6d56c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:51.977602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913970d3-af27-45d3-af28-e14efcb6d56c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:51.977920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913970d3-af27-45d3-af28-e14efcb6d56c None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:51.978503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913970d3-af27-45d3-af28-e14efcb6d56c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:51.978805 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913970d3-af27-45d3-af28-e14efcb6d56c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:51.980183 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913970d3-af27-45d3-af28-e14efcb6d56c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:51.981904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dce76-654c-4148-b715-43eb34fa4973 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:51.994037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 336/657] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:51.994605 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913970d3-af27-45d3-af28-e14efcb6d56c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:52.019687 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7f59e-90ca-4363-b4ff-014c2ab4f32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:52.020716 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7f59e-90ca-4363-b4ff-014c2ab4f32f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:52.021195 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7f59e-90ca-4363-b4ff-014c2ab4f32f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:52.021674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7f59e-90ca-4363-b4ff-014c2ab4f32f None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:52.022504 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7f59e-90ca-4363-b4ff-014c2ab4f32f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:52.023014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7f59e-90ca-4363-b4ff-014c2ab4f32f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:52.024610 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7f59e-90ca-4363-b4ff-014c2ab4f32f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:52.038748 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 322/658] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:52.039996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7f59e-90ca-4363-b4ff-014c2ab4f32f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:52.076864 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:52.110215 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913970d3-af27-45d3-af28-e14efcb6d56c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:52.147009 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc74ce-925f-46c7-aa87-b643069144c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:52.147645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc74ce-925f-46c7-aa87-b643069144c3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:52.147918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc74ce-925f-46c7-aa87-b643069144c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:52.148184 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc74ce-925f-46c7-aa87-b643069144c3 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:52.148911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc74ce-925f-46c7-aa87-b643069144c3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:52.149209 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc74ce-925f-46c7-aa87-b643069144c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:52.150649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc74ce-925f-46c7-aa87-b643069144c3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:52.169493 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7f59e-90ca-4363-b4ff-014c2ab4f32f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:52.174735 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 337/659] 10.222.0.40 () {56 vars in 1137 bytes} [Tue Aug 9 06:56:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:52.175670 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc74ce-925f-46c7-aa87-b643069144c3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:52.195370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:52.215547 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490d13a-4e46-44f3-848c-00fe08319e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:52.216754 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490d13a-4e46-44f3-848c-00fe08319e9c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:52.217241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490d13a-4e46-44f3-848c-00fe08319e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:52.217732 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490d13a-4e46-44f3-848c-00fe08319e9c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:52.225668 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490d13a-4e46-44f3-848c-00fe08319e9c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:52.227374 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490d13a-4e46-44f3-848c-00fe08319e9c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:52.240694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d490d13a-4e46-44f3-848c-00fe08319e9c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 06:56:52.240694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:52.240694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:52.240694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:52.240694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:52.240694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:52.240694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:52.240694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:52.240694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:52.240694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:52.240694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:52.240694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:52.240694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:56:52.240694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:56:52.240694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:56:52.240694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:56:52.241707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:52.241707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:52.241707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:56:52.241707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:52.241707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:56:52.241707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:52.241707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:52.241707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:52.241707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:52.241707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:52.241707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:52.241707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:52.241707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:52.241707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:52.241707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:52.241707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:52.241707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:52.241707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:52.242650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:52.242650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:52.242650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:56:52.242650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:56:52.242650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:56:52.242650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:56:52.242650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:56:52.242650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:56:52.242650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 06:56:52.242650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:52.245203 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 323/660] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:56:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:52.247002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490d13a-4e46-44f3-848c-00fe08319e9c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:52.291618 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc74ce-925f-46c7-aa87-b643069144c3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:52.328424 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e127a-6d29-468f-9d02-bf645ad77709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:52.328754 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e127a-6d29-468f-9d02-bf645ad77709 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:52.328980 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e127a-6d29-468f-9d02-bf645ad77709 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:52.329249 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e127a-6d29-468f-9d02-bf645ad77709 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:52.336321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e127a-6d29-468f-9d02-bf645ad77709 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:52.337705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e127a-6d29-468f-9d02-bf645ad77709 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:52.341855 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:52.348725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-635e127a-6d29-468f-9d02-bf645ad77709 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:52.348725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:52.348725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:52.348725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:52.348725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:52.348725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:52.348725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:52.348725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:52.348725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:52.348725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:52.348725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:52.348725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:52.348725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:56:52.348725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:56:52.348725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:56:52.349631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:56:52.349631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:52.349631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:52.349631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:52.349631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:52.349631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:52.349631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:52.349631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:52.349631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:52.349631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:52.349631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:52.349631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:52.349631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:52.349631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:52.349631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:52.349631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:52.349631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:52.350642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:56:52.350642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:56:52.350642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:56:52.350642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:56:52.350642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:56:52.350642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:56:52.350642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:52.350642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:52.354479 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 338/661] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:52.355314 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e127a-6d29-468f-9d02-bf645ad77709 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:52.360178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490d13a-4e46-44f3-848c-00fe08319e9c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:52.397532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45c222-126b-4c7c-8c60-fa1c57d572dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:52.398087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45c222-126b-4c7c-8c60-fa1c57d572dc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:52.398367 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45c222-126b-4c7c-8c60-fa1c57d572dc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:52.398634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45c222-126b-4c7c-8c60-fa1c57d572dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:52.464985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:52.477636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45c222-126b-4c7c-8c60-fa1c57d572dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:52.480285 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45c222-126b-4c7c-8c60-fa1c57d572dc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:52.494606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e127a-6d29-468f-9d02-bf645ad77709 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:52.534911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d2c99-a41c-48e9-9c28-123e49a9cc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:52.535960 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d2c99-a41c-48e9-9c28-123e49a9cc50 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:52.536688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d2c99-a41c-48e9-9c28-123e49a9cc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:52.537156 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d2c99-a41c-48e9-9c28-123e49a9cc50 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:52.538049 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d2c99-a41c-48e9-9c28-123e49a9cc50 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:52.538556 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d2c99-a41c-48e9-9c28-123e49a9cc50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:52.540495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d2c99-a41c-48e9-9c28-123e49a9cc50 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:52.561798 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 339/662] 10.222.0.40 () {56 vars in 1139 bytes} [Tue Aug 9 06:56:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:52.563021 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecabe9-c51a-4ac9-985a-5d1e5b5d7bd8 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:52.563331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecabe9-c51a-4ac9-985a-5d1e5b5d7bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:52.563602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecabe9-c51a-4ac9-985a-5d1e5b5d7bd8 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:52.564939 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 340/663] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:52.565482 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecabe9-c51a-4ac9-985a-5d1e5b5d7bd8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:52.597742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:52.627370 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 324/664] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:52.628995 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eddb83-e4c3-4837-89b5-a0240682b083 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:52.629285 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eddb83-e4c3-4837-89b5-a0240682b083 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:52.629559 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eddb83-e4c3-4837-89b5-a0240682b083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:52.651248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-37eddb83-e4c3-4837-89b5-a0240682b083 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:52.652551 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-37eddb83-e4c3-4837-89b5-a0240682b083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:52.726955 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecabe9-c51a-4ac9-985a-5d1e5b5d7bd8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:52.771267 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df44b52-addd-4087-bdf5-ce57d2200e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:52.771886 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44b52-addd-4087-bdf5-ce57d2200e24 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:52.772163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44b52-addd-4087-bdf5-ce57d2200e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:52.772433 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44b52-addd-4087-bdf5-ce57d2200e24 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:52.773135 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df44b52-addd-4087-bdf5-ce57d2200e24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:52.773440 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df44b52-addd-4087-bdf5-ce57d2200e24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:52.774938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df44b52-addd-4087-bdf5-ce57d2200e24 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:52.778520 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:52.790078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 341/665] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:56:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:52.791040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df44b52-addd-4087-bdf5-ce57d2200e24 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:52.846602 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 325/666] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:52.847485 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eddb83-e4c3-4837-89b5-a0240682b083 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:52.905143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df44b52-addd-4087-bdf5-ce57d2200e24 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:52.941648 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccf9f4-9700-4a63-87f6-f7c4c8b71e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:52.942250 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccf9f4-9700-4a63-87f6-f7c4c8b71e1e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:52.942752 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccf9f4-9700-4a63-87f6-f7c4c8b71e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:52.942752 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccf9f4-9700-4a63-87f6-f7c4c8b71e1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:52.959923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eddb83-e4c3-4837-89b5-a0240682b083 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:52.977205 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:52.997122 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2743479-949f-4abe-810d-74a83e5cb429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:52.997754 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2743479-949f-4abe-810d-74a83e5cb429 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:52.998085 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2743479-949f-4abe-810d-74a83e5cb429 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:52.998359 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2743479-949f-4abe-810d-74a83e5cb429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:53.007985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:53.009247 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2743479-949f-4abe-810d-74a83e5cb429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:53.010685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2743479-949f-4abe-810d-74a83e5cb429 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:53.015014 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccf9f4-9700-4a63-87f6-f7c4c8b71e1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:53.016478 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccf9f4-9700-4a63-87f6-f7c4c8b71e1e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:53.028228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c2743479-949f-4abe-810d-74a83e5cb429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:53.028228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:53.028228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:53.028228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:53.028228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:53.028228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:53.028228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:53.028228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:53.028228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:53.028228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:53.028228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:53.028228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:53.028228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:53.028228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:53.028228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:53.028228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:53.029251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:53.029251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:53.029251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:53.029251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:53.029251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:53.029251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:53.029251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:53.029251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:53.029251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:53.029251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:53.029251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:53.029251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:53.029251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:53.029251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:53.029251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:53.029251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:53.029251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:53.030185 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:53.030185 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:53.030185 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:53.031223 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 326/667] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:53.032026 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2743479-949f-4abe-810d-74a83e5cb429 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:53.127334 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 342/668] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:53.127334 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccf9f4-9700-4a63-87f6-f7c4c8b71e1e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:53.139819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2743479-949f-4abe-810d-74a83e5cb429 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:53.174962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdee07-6fd1-4d11-a3db-0bfe140b0f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:53.175590 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdee07-6fd1-4d11-a3db-0bfe140b0f0e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:53.175869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdee07-6fd1-4d11-a3db-0bfe140b0f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:53.176124 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdee07-6fd1-4d11-a3db-0bfe140b0f0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:53.176826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdee07-6fd1-4d11-a3db-0bfe140b0f0e None admin] RBAC: Adding query filter params (role.id=b93b6b2c6da44593a6b95db1309b8a58, scope.project.id=342524b45def418783374ff6733e94b9, user.id=e44c764958784616b8bdbf59e5692ca6) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:53.177118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdee07-6fd1-4d11-a3db-0bfe140b0f0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:53.178529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdee07-6fd1-4d11-a3db-0bfe140b0f0e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:53.195454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 327/669] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:56:53 2022] GET /identity/v3/role_assignments?user.id=e44c764958784616b8bdbf59e5692ca6&scope.project.id=342524b45def418783374ff6733e94b9&role.id=b93b6b2c6da44593a6b95db1309b8a58 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:53.196281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdee07-6fd1-4d11-a3db-0bfe140b0f0e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:53.228371 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:53.234998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccf9f4-9700-4a63-87f6-f7c4c8b71e1e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:53.240293 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:53.275171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59323a-3671-4068-b76d-4e77972e24e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:53.275977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59323a-3671-4068-b76d-4e77972e24e1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:53.276673 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59323a-3671-4068-b76d-4e77972e24e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:53.276673 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59323a-3671-4068-b76d-4e77972e24e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:53.288611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59323a-3671-4068-b76d-4e77972e24e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:53.296196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-bd59323a-3671-4068-b76d-4e77972e24e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:53.296196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:53.296196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:53.296196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:53.296196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:53.296196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:53.296196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:53.296196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:53.296196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:53.296196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:53.296196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:53.296196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:53.296196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:53.296196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:53.296196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:53.296196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:53.297431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:53.297431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:53.297431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:53.297431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:53.297431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:53.297431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:53.297431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:53.297431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:53.297431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:53.297431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:53.297431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:53.297431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:53.297431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:53.297431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:53.297431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:53.297431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:53.298390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:53.298390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:53.298390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:53.298390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:53.298390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:53.298390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:53.298390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:53.298390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:53.298390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:53.298390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:53.298390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:53.298390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:53.303978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 343/670] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:56:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:53.304944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59323a-3671-4068-b76d-4e77972e24e1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:53.330276 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdee07-6fd1-4d11-a3db-0bfe140b0f0e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:53.372432 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283da63-bcf0-420f-bf26-eb9888d6ff8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:53.373367 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283da63-bcf0-420f-bf26-eb9888d6ff8e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:53.373825 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283da63-bcf0-420f-bf26-eb9888d6ff8e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:53.374363 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283da63-bcf0-420f-bf26-eb9888d6ff8e None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:53.375333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283da63-bcf0-420f-bf26-eb9888d6ff8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:53.375826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283da63-bcf0-420f-bf26-eb9888d6ff8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:53.377295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283da63-bcf0-420f-bf26-eb9888d6ff8e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:53.389896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 328/671] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:53.390549 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283da63-bcf0-420f-bf26-eb9888d6ff8e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:53.420600 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59323a-3671-4068-b76d-4e77972e24e1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:53.464502 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df158475-8095-4d5f-8879-8e49a61250f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:53.465691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df158475-8095-4d5f-8879-8e49a61250f7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:53.466221 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df158475-8095-4d5f-8879-8e49a61250f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:53.466221 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df158475-8095-4d5f-8879-8e49a61250f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:53.484274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df158475-8095-4d5f-8879-8e49a61250f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:53.485955 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df158475-8095-4d5f-8879-8e49a61250f7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:53.501843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-df158475-8095-4d5f-8879-8e49a61250f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:53.501843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:53.501843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:53.501843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:53.501843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:53.501843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:53.501843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:53.501843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:53.501843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:53.501843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:53.501843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:53.501843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:53.501843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:53.501843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:53.501843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:53.501843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:53.502976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:53.502976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:53.502976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:53.502976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:53.502976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:53.502976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:53.502976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:53.502976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:53.502976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:53.502976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:53.502976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:53.502976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:53.502976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:53.502976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:53.502976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:53.502976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:53.502976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:53.504109 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:53.504109 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:53.504109 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:53.504380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:53.506064 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 344/672] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:53.511169 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df158475-8095-4d5f-8879-8e49a61250f7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:53.514720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283da63-bcf0-420f-bf26-eb9888d6ff8e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:53.522877 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:53.557389 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45530e48-03fe-4803-a974-e8a74f9a9127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:53.559079 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45530e48-03fe-4803-a974-e8a74f9a9127 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:53.559650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45530e48-03fe-4803-a974-e8a74f9a9127 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:53.560298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45530e48-03fe-4803-a974-e8a74f9a9127 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:53.561267 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45530e48-03fe-4803-a974-e8a74f9a9127 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:53.561873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45530e48-03fe-4803-a974-e8a74f9a9127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:53.563538 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45530e48-03fe-4803-a974-e8a74f9a9127 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:53.573173 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 329/673] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:56:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:53.574626 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45530e48-03fe-4803-a974-e8a74f9a9127 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:53.616664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df158475-8095-4d5f-8879-8e49a61250f7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:53.653358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e8f9e-75a0-48ee-b5d7-77ef1ed615df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:53.653792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e8f9e-75a0-48ee-b5d7-77ef1ed615df None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:53.654071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e8f9e-75a0-48ee-b5d7-77ef1ed615df None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:53.654341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e8f9e-75a0-48ee-b5d7-77ef1ed615df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:53.661605 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e8f9e-75a0-48ee-b5d7-77ef1ed615df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:53.663048 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e8f9e-75a0-48ee-b5d7-77ef1ed615df None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:53.674462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-030e8f9e-75a0-48ee-b5d7-77ef1ed615df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:53.674462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:53.674462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:53.674462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:53.674462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:53.674462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:53.674462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:53.674462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:53.674462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:53.674462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:53.674462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:53.674462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:53.674462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:56:53.674462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:56:53.674462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:56:53.675659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:56:53.675659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:53.675659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:53.675659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:53.675659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:53.675659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:53.675659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:53.675659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:53.675659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:53.675659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:53.675659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:53.675659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:53.675659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:53.675659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:53.675659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:53.675659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:53.675659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:53.676587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:56:53.676587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:56:53.676587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:56:53.676587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:56:53.676587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:56:53.676587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:56:53.676587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:53.676587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:53.676587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 345/674] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:53.677087 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e8f9e-75a0-48ee-b5d7-77ef1ed615df None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:53.692565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45530e48-03fe-4803-a974-e8a74f9a9127 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:53.731459 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc1aa1-3ae5-4ecd-a654-fb7fd7b088b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:53.732520 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc1aa1-3ae5-4ecd-a654-fb7fd7b088b9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:53.733020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc1aa1-3ae5-4ecd-a654-fb7fd7b088b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:53.733481 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc1aa1-3ae5-4ecd-a654-fb7fd7b088b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:53.734358 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc1aa1-3ae5-4ecd-a654-fb7fd7b088b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:53.734988 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc1aa1-3ae5-4ecd-a654-fb7fd7b088b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:53.736727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc1aa1-3ae5-4ecd-a654-fb7fd7b088b9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:53.745733 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:53.757802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 330/675] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:53.759346 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc1aa1-3ae5-4ecd-a654-fb7fd7b088b9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:53.778445 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:53.874674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc1aa1-3ae5-4ecd-a654-fb7fd7b088b9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:53.899298 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e8f9e-75a0-48ee-b5d7-77ef1ed615df None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:53.910863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48ea21-e8c6-4dc0-91c6-0bed9d38993b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:53.911495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48ea21-e8c6-4dc0-91c6-0bed9d38993b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:53.911772 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48ea21-e8c6-4dc0-91c6-0bed9d38993b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:53.912034 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48ea21-e8c6-4dc0-91c6-0bed9d38993b None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:53.912703 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48ea21-e8c6-4dc0-91c6-0bed9d38993b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:53.913000 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48ea21-e8c6-4dc0-91c6-0bed9d38993b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:53.914410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48ea21-e8c6-4dc0-91c6-0bed9d38993b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:53.925654 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 331/676] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:56:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:53.926439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48ea21-e8c6-4dc0-91c6-0bed9d38993b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:53.941022 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c13792-23ac-4a6d-9865-361fd706c425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:53.942000 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c13792-23ac-4a6d-9865-361fd706c425 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:53.942463 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c13792-23ac-4a6d-9865-361fd706c425 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:53.942921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c13792-23ac-4a6d-9865-361fd706c425 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:53.953838 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c13792-23ac-4a6d-9865-361fd706c425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:53.955706 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c13792-23ac-4a6d-9865-361fd706c425 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:53.970554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-38c13792-23ac-4a6d-9865-361fd706c425 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:53.970554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:53.970554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:53.970554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:53.970554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:53.970554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:53.970554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:53.970554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:53.970554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:53.970554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:53.970554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:53.970554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:53.970554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:53.970554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:53.970554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:53.970554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:53.971744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:53.971744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:53.971744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:53.971744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:53.971744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:53.971744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:53.971744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:53.971744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:53.971744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:53.971744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:53.971744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:53.971744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:53.971744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:53.971744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:53.971744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:53.971744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:53.971744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:53.972853 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:53.972853 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:53.972853 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:53.974245 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 346/677] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:53.975646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e9fd0-cce6-4a1b-ad98-5e75bf9eb8a2 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:53.975927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e9fd0-cce6-4a1b-ad98-5e75bf9eb8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:53.976193 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e9fd0-cce6-4a1b-ad98-5e75bf9eb8a2 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:53.977547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 347/678] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:53.978091 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e9fd0-cce6-4a1b-ad98-5e75bf9eb8a2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:54.010005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:54.036690 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48ea21-e8c6-4dc0-91c6-0bed9d38993b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:54.071515 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34b955-1b76-49cc-82ea-a2a10b274dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:54.072145 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34b955-1b76-49cc-82ea-a2a10b274dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:54.072417 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34b955-1b76-49cc-82ea-a2a10b274dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:54.072681 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34b955-1b76-49cc-82ea-a2a10b274dc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:54.080226 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34b955-1b76-49cc-82ea-a2a10b274dc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:54.081646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34b955-1b76-49cc-82ea-a2a10b274dc0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:54.084776 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e9fd0-cce6-4a1b-ad98-5e75bf9eb8a2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:54.093275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-af34b955-1b76-49cc-82ea-a2a10b274dc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:54.093275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:54.093275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:54.093275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:54.093275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:54.093275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:54.093275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:54.093275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:54.093275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:54.093275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:54.093275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:54.093275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:54.093275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:56:54.093275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:56:54.093275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:56:54.094209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:56:54.094209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:54.094209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:54.094209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:54.094209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:54.094209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:54.094209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:54.094209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:54.094209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:54.094209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:54.094209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:54.094209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:54.094209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:54.094209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:54.094209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:54.094209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:54.094209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:54.095128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:56:54.095128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:56:54.095128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:56:54.095128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:56:54.095128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:56:54.095128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:56:54.095128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:54.095128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:54.099108 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 332/679] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:54.099755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34b955-1b76-49cc-82ea-a2a10b274dc0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:54.108346 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:54.126200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d85df8-e889-45d9-8cfa-9d8e729c0a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:54.127027 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d85df8-e889-45d9-8cfa-9d8e729c0a0f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:54.127497 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d85df8-e889-45d9-8cfa-9d8e729c0a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:54.127931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d85df8-e889-45d9-8cfa-9d8e729c0a0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:54.128650 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d85df8-e889-45d9-8cfa-9d8e729c0a0f None admin] RBAC: Adding query filter params (role.id=b93b6b2c6da44593a6b95db1309b8a58, scope.project.id=342524b45def418783374ff6733e94b9, user.id=8977d7479b3e405c976fa1a570987704) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:54.128956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d85df8-e889-45d9-8cfa-9d8e729c0a0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:54.130465 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d85df8-e889-45d9-8cfa-9d8e729c0a0f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:54.137175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 348/680] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:56:53 2022] GET /identity/v3/role_assignments?user.id=8977d7479b3e405c976fa1a570987704&scope.project.id=342524b45def418783374ff6733e94b9&role.id=b93b6b2c6da44593a6b95db1309b8a58 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:54.145473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611720c-9182-4b8b-bf01-8fdc758062e2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:54.146008 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611720c-9182-4b8b-bf01-8fdc758062e2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:54.146771 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611720c-9182-4b8b-bf01-8fdc758062e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:54.172176 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5611720c-9182-4b8b-bf01-8fdc758062e2 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:54.174535 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5611720c-9182-4b8b-bf01-8fdc758062e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:54.221190 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34b955-1b76-49cc-82ea-a2a10b274dc0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:54.260572 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 349/681] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:54.262341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611720c-9182-4b8b-bf01-8fdc758062e2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:54.267333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d845077-908e-4937-a010-010d6a2adcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:54.268144 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d845077-908e-4937-a010-010d6a2adcff None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:54.268686 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d845077-908e-4937-a010-010d6a2adcff None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:54.269277 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d845077-908e-4937-a010-010d6a2adcff None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:54.270684 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d845077-908e-4937-a010-010d6a2adcff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:54.271472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d845077-908e-4937-a010-010d6a2adcff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:54.274478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d845077-908e-4937-a010-010d6a2adcff None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:54.276893 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:54.290226 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 333/682] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:54.296964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d845077-908e-4937-a010-010d6a2adcff None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:54.374161 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611720c-9182-4b8b-bf01-8fdc758062e2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:54.397743 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:54.424841 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d845077-908e-4937-a010-010d6a2adcff None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:54.425655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73750ce-7997-40f4-be82-a909d74b9d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:54.426505 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73750ce-7997-40f4-be82-a909d74b9d70 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:54.426794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73750ce-7997-40f4-be82-a909d74b9d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:54.427172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73750ce-7997-40f4-be82-a909d74b9d70 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:54.429079 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73750ce-7997-40f4-be82-a909d74b9d70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:54.429385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73750ce-7997-40f4-be82-a909d74b9d70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:54.430869 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73750ce-7997-40f4-be82-a909d74b9d70 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:54.448752 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 350/683] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:56:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:54.450940 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73750ce-7997-40f4-be82-a909d74b9d70 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:54.489244 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894236e2-7f71-40d6-84bc-c54fdac7157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:54.490150 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894236e2-7f71-40d6-84bc-c54fdac7157a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:54.491394 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894236e2-7f71-40d6-84bc-c54fdac7157a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:54.491676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894236e2-7f71-40d6-84bc-c54fdac7157a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:54.502119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894236e2-7f71-40d6-84bc-c54fdac7157a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:54.503930 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894236e2-7f71-40d6-84bc-c54fdac7157a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:54.519916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-894236e2-7f71-40d6-84bc-c54fdac7157a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 06:56:54.519916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:54.519916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:54.519916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:54.519916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:54.519916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:54.519916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:54.519916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:54.519916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:54.519916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:54.519916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:54.519916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:54.519916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:56:54.519916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:56:54.519916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:56:54.519916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:56:54.521355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:54.521355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:54.521355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:56:54.521355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:54.521355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:56:54.521355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:54.521355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:54.521355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:54.521355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:54.521355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:54.521355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:54.521355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:54.521355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:54.521355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:54.521355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:54.521355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:54.521355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:54.521355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:54.522424 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:54.522424 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:54.522424 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:56:54.522424 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:56:54.522424 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:56:54.522424 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:56:54.522424 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:56:54.522424 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:56:54.522424 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 06:56:54.522424 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:54.525683 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 334/684] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:56:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:56:54.526571 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894236e2-7f71-40d6-84bc-c54fdac7157a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:54.591719 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73750ce-7997-40f4-be82-a909d74b9d70 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:54.595433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:54.642105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a40596-69d2-457f-8a8c-480654c06a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:54.643070 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a40596-69d2-457f-8a8c-480654c06a4c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:54.643594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a40596-69d2-457f-8a8c-480654c06a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:54.644095 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a40596-69d2-457f-8a8c-480654c06a4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:54.655143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894236e2-7f71-40d6-84bc-c54fdac7157a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:54.656262 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a40596-69d2-457f-8a8c-480654c06a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:54.662621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-a8a40596-69d2-457f-8a8c-480654c06a4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:56:54.662621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:54.662621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:54.662621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:54.662621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:54.662621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:54.662621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:54.662621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:54.662621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:54.662621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:54.662621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:54.662621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:54.662621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:54.662621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:54.662621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:54.662621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:54.663631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:54.663631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:54.663631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:54.663631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:54.663631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:54.663631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:54.663631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:54.663631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:54.663631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:54.663631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:54.663631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:54.663631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:54.663631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:54.663631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:54.663631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:54.663631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:54.664495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:54.664495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:54.664495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:54.664495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:54.664495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:54.664495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:54.664495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:54.664495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:54.664495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:54.664495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:54.664495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:56:54.664495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:54.672750 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 351/685] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:56:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:54.673977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a40596-69d2-457f-8a8c-480654c06a4c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:54.703381 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619e891-0a9b-4472-ad0f-197f4febeab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:54.704065 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619e891-0a9b-4472-ad0f-197f4febeab4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:54.704269 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619e891-0a9b-4472-ad0f-197f4febeab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:54.704783 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619e891-0a9b-4472-ad0f-197f4febeab4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:54.705523 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619e891-0a9b-4472-ad0f-197f4febeab4 None admin] RBAC: Adding query filter params (role.id=b93b6b2c6da44593a6b95db1309b8a58, scope.project.id=342524b45def418783374ff6733e94b9, user.id=8d75da9360ef490f910fabc3920c8ad0) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:54.705828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619e891-0a9b-4472-ad0f-197f4febeab4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:54.707881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619e891-0a9b-4472-ad0f-197f4febeab4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:54.723116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 335/686] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:56:54 2022] GET /identity/v3/role_assignments?user.id=8d75da9360ef490f910fabc3920c8ad0&scope.project.id=342524b45def418783374ff6733e94b9&role.id=b93b6b2c6da44593a6b95db1309b8a58 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:54.723116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619e891-0a9b-4472-ad0f-197f4febeab4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:54.728793 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:54.863066 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a40596-69d2-457f-8a8c-480654c06a4c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:54.935414 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619e891-0a9b-4472-ad0f-197f4febeab4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:54.940429 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18d63b-80c6-4ba0-af0a-c4cb3252973f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:54.941062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18d63b-80c6-4ba0-af0a-c4cb3252973f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:54.941351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18d63b-80c6-4ba0-af0a-c4cb3252973f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:54.941608 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18d63b-80c6-4ba0-af0a-c4cb3252973f None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:54.942338 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18d63b-80c6-4ba0-af0a-c4cb3252973f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:54.942650 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18d63b-80c6-4ba0-af0a-c4cb3252973f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:54.944132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18d63b-80c6-4ba0-af0a-c4cb3252973f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:54.964227 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:54.980518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 352/687] 10.222.0.40 () {56 vars in 1135 bytes} [Tue Aug 9 06:56:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:54.989685 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18d63b-80c6-4ba0-af0a-c4cb3252973f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:54.991222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8912a88-5b47-4d55-800a-21bffc0e486a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:54.991222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8912a88-5b47-4d55-800a-21bffc0e486a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:54.991443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8912a88-5b47-4d55-800a-21bffc0e486a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:54.991591 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8912a88-5b47-4d55-800a-21bffc0e486a None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:54.992244 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8912a88-5b47-4d55-800a-21bffc0e486a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:54.992545 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8912a88-5b47-4d55-800a-21bffc0e486a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:54.993939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8912a88-5b47-4d55-800a-21bffc0e486a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:55.008521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 336/688] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:56:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:55.009800 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8912a88-5b47-4d55-800a-21bffc0e486a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:55.125807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:55.138202 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18d63b-80c6-4ba0-af0a-c4cb3252973f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:55.162863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8912a88-5b47-4d55-800a-21bffc0e486a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:55.186698 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e985d7-4d82-4c57-aaa1-cd333c6933de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:55.187597 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e985d7-4d82-4c57-aaa1-cd333c6933de None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:55.187870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e985d7-4d82-4c57-aaa1-cd333c6933de None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:55.188146 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e985d7-4d82-4c57-aaa1-cd333c6933de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:55.227185 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d0f2e-3446-45fa-978b-9ec22226521a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:55.228331 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d0f2e-3446-45fa-978b-9ec22226521a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:55.229932 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d0f2e-3446-45fa-978b-9ec22226521a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:55.234004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d0f2e-3446-45fa-978b-9ec22226521a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:55.265253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d0f2e-3446-45fa-978b-9ec22226521a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:55.266744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d0f2e-3446-45fa-978b-9ec22226521a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:55.283854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-fb0d0f2e-3446-45fa-978b-9ec22226521a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:55.283854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:55.283854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:55.283854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:55.283854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:55.283854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:55.283854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:55.283854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:55.283854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:55.283854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:55.283854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:55.283854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:55.283854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:55.283854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:55.283854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:55.283854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:55.284909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:55.284909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:55.284909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:55.284909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:55.284909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:55.284909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:55.284909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:55.284909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:55.284909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:55.284909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:55.284909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:55.284909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:55.284909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:55.284909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:55.284909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:55.284909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:55.284909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:55.285817 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:55.285817 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:55.285817 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:55.285817 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 337/689] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:55.298803 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d0f2e-3446-45fa-978b-9ec22226521a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:55.314567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e985d7-4d82-4c57-aaa1-cd333c6933de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:55.316319 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e985d7-4d82-4c57-aaa1-cd333c6933de None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:55.359249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:55.423813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 353/690] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:55.424474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:55.436076 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e985d7-4d82-4c57-aaa1-cd333c6933de None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:55.484824 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d0f2e-3446-45fa-978b-9ec22226521a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:55.552525 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e985d7-4d82-4c57-aaa1-cd333c6933de None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:55.557406 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefa012-06d5-4517-bb0a-b99df5c71878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:55.558420 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefa012-06d5-4517-bb0a-b99df5c71878 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:55.559708 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefa012-06d5-4517-bb0a-b99df5c71878 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:55.560268 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefa012-06d5-4517-bb0a-b99df5c71878 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:55.561198 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefa012-06d5-4517-bb0a-b99df5c71878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:55.561696 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefa012-06d5-4517-bb0a-b99df5c71878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:55.563295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefa012-06d5-4517-bb0a-b99df5c71878 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:55.589071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e2827-9884-45b3-bf32-ad3f9dbec6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:55.589747 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e2827-9884-45b3-bf32-ad3f9dbec6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:55.590028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e2827-9884-45b3-bf32-ad3f9dbec6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:55.590417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e2827-9884-45b3-bf32-ad3f9dbec6c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:55.590633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 338/691] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:55.595457 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefa012-06d5-4517-bb0a-b99df5c71878 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:55.623942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e2827-9884-45b3-bf32-ad3f9dbec6c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:55.625391 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e2827-9884-45b3-bf32-ad3f9dbec6c7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:55.645462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-864e2827-9884-45b3-bf32-ad3f9dbec6c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:55.645462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:55.645462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:55.645462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:55.645462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:55.645462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:55.645462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:55.645462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:55.645462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:55.645462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:55.645462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:55.645462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:55.645462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:55.645462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:55.645462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:55.645462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:55.646455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:55.646455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:55.646455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:55.646455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:55.646455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:55.646455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:55.646455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:55.646455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:55.646455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:55.646455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:55.646455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:55.646455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:55.646455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:55.646455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:55.646455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:55.646455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:55.646455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:55.647396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:55.647396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:55.647396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:55.651266 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 354/692] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:55.653253 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc558949-fb2d-4f17-875d-bc49a07730eb None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:55.653539 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc558949-fb2d-4f17-875d-bc49a07730eb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:55.653809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc558949-fb2d-4f17-875d-bc49a07730eb None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:55.656893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 355/693] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:55.656893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc558949-fb2d-4f17-875d-bc49a07730eb None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:55.709825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:55.724263 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:55.734197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefa012-06d5-4517-bb0a-b99df5c71878 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:55.771018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8eaa9e-1b8c-47d5-ada9-e7597316e576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:55.771808 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eaa9e-1b8c-47d5-ada9-e7597316e576 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:55.772225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eaa9e-1b8c-47d5-ada9-e7597316e576 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:55.772634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eaa9e-1b8c-47d5-ada9-e7597316e576 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:55.773880 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc558949-fb2d-4f17-875d-bc49a07730eb None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:55.780256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8eaa9e-1b8c-47d5-ada9-e7597316e576 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:55.781994 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8eaa9e-1b8c-47d5-ada9-e7597316e576 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:55.793939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ca8eaa9e-1b8c-47d5-ada9-e7597316e576 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 06:56:55.793939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:55.793939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:55.793939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:55.793939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:55.793939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:55.793939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:55.793939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:55.793939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:55.793939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:55.793939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:55.793939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:55.793939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:56:55.793939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:56:55.793939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:56:55.793939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:56:55.794892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:55.794892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:55.794892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:56:55.794892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:55.794892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:56:55.794892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:56:55.794892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:55.794892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:55.794892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:55.794892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:55.794892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:55.794892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:55.794892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:55.794892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:55.794892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:55.794892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:55.794892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:55.794892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:55.796290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:55.796290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:55.796290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:56:55.796290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:56:55.796290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:56:55.796290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:56:55.796290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:56:55.796290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:56:55.796290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 06:56:55.796290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:55.799649 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 339/694] 10.222.0.40 () {56 vars in 1093 bytes} [Tue Aug 9 06:56:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:56:55.800920 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b652fd3-72c1-45ab-aacb-a28d393bb02d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:55.801196 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b652fd3-72c1-45ab-aacb-a28d393bb02d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:55.801465 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b652fd3-72c1-45ab-aacb-a28d393bb02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:55.814236 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad0526-8e4e-480c-849a-59780c953b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:55.815220 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad0526-8e4e-480c-849a-59780c953b25 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:55.815704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad0526-8e4e-480c-849a-59780c953b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:55.816166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad0526-8e4e-480c-849a-59780c953b25 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:55.816985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad0526-8e4e-480c-849a-59780c953b25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:55.817463 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad0526-8e4e-480c-849a-59780c953b25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:55.818976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad0526-8e4e-480c-849a-59780c953b25 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:55.819922 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1b652fd3-72c1-45ab-aacb-a28d393bb02d None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:55.821097 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1b652fd3-72c1-45ab-aacb-a28d393bb02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:55.837512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 356/695] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:55.838759 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad0526-8e4e-480c-849a-59780c953b25 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:55.895217 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 340/696] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:55.896095 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b652fd3-72c1-45ab-aacb-a28d393bb02d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:55.947345 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad0526-8e4e-480c-849a-59780c953b25 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:55.974047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:55.985579 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184bacd-321a-422b-8eb0-13ae26158a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:55.987441 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184bacd-321a-422b-8eb0-13ae26158a00 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:55.987921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184bacd-321a-422b-8eb0-13ae26158a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:55.988409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184bacd-321a-422b-8eb0-13ae26158a00 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:55.989655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184bacd-321a-422b-8eb0-13ae26158a00 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:55.990143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184bacd-321a-422b-8eb0-13ae26158a00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:55.991764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184bacd-321a-422b-8eb0-13ae26158a00 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:56.000672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:56.019835 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 357/697] 10.222.0.40 () {56 vars in 1133 bytes} [Tue Aug 9 06:56:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:56.021058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184bacd-321a-422b-8eb0-13ae26158a00 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:56.024397 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b652fd3-72c1-45ab-aacb-a28d393bb02d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:56.067667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252eca9d-e033-4a1c-b319-243b130d2645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:56.068400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252eca9d-e033-4a1c-b319-243b130d2645 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:56.068734 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252eca9d-e033-4a1c-b319-243b130d2645 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:56.069068 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252eca9d-e033-4a1c-b319-243b130d2645 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:56.077173 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252eca9d-e033-4a1c-b319-243b130d2645 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:56.078769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252eca9d-e033-4a1c-b319-243b130d2645 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:56.090466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-252eca9d-e033-4a1c-b319-243b130d2645 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:56.090466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:56.090466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:56.090466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:56.090466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:56.090466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:56.090466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:56.090466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:56.090466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:56.090466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:56.090466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:56.090466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:56.090466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:56:56.090466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:56:56.090466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:56:56.091488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:56:56.091488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:56.091488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:56.091488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:56.091488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:56.091488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:56.091488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:56.091488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:56.091488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:56.091488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:56.091488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:56.091488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:56.091488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:56.091488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:56.091488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:56.091488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:56.091488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:56.092431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:56:56.092431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:56:56.092431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:56:56.092431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:56:56.092431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:56:56.092431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:56:56.092431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:56.092431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:56.095595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 341/698] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:56.096486 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252eca9d-e033-4a1c-b319-243b130d2645 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:56.153786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184bacd-321a-422b-8eb0-13ae26158a00 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:56.201867 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28da8a-8d10-44df-b5ff-71d3f2037753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:56.202657 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28da8a-8d10-44df-b5ff-71d3f2037753 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:56.202921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28da8a-8d10-44df-b5ff-71d3f2037753 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:56.203283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28da8a-8d10-44df-b5ff-71d3f2037753 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:56.214107 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28da8a-8d10-44df-b5ff-71d3f2037753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:56.215413 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252eca9d-e033-4a1c-b319-243b130d2645 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:56.216257 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28da8a-8d10-44df-b5ff-71d3f2037753 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:56.231836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-1a28da8a-8d10-44df-b5ff-71d3f2037753 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:56.231836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:56.231836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:56.231836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:56.231836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:56.231836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:56.231836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:56.231836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:56.231836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:56.231836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:56.231836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:56.231836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:56.231836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:56.231836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:56.231836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:56.231836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:56.232841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:56.232841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:56.232841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:56.232841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:56.232841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:56.232841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:56.232841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:56.232841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:56.232841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:56.232841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:56.232841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:56.232841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:56.232841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:56.232841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:56.232841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:56.232841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:56.232841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:56.233751 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:56.233751 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:56.233751 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:56.237983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 358/699] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:56.239077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28da8a-8d10-44df-b5ff-71d3f2037753 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:56.257305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:56.266204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fc8e0-2b3a-4ec2-a67a-703fb32e24aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:56.268327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fc8e0-2b3a-4ec2-a67a-703fb32e24aa None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:56.269159 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fc8e0-2b3a-4ec2-a67a-703fb32e24aa None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:56.269720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fc8e0-2b3a-4ec2-a67a-703fb32e24aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:56.286942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:56.366336 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469fc8e0-2b3a-4ec2-a67a-703fb32e24aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:56.368807 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469fc8e0-2b3a-4ec2-a67a-703fb32e24aa None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:56.377180 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28da8a-8d10-44df-b5ff-71d3f2037753 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:56.413045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cabe09-30b2-4e4b-875e-49fba5a26cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:56.413734 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cabe09-30b2-4e4b-875e-49fba5a26cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:56.414098 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cabe09-30b2-4e4b-875e-49fba5a26cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:56.414432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cabe09-30b2-4e4b-875e-49fba5a26cc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:56.415214 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cabe09-30b2-4e4b-875e-49fba5a26cc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:56.415584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cabe09-30b2-4e4b-875e-49fba5a26cc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:56.417040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cabe09-30b2-4e4b-875e-49fba5a26cc6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:56.437151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 359/700] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:56:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:56.438170 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cabe09-30b2-4e4b-875e-49fba5a26cc6 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:56.499726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 342/701] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:56:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:56.500567 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fc8e0-2b3a-4ec2-a67a-703fb32e24aa None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:56.521683 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:56.548809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:56.552873 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cabe09-30b2-4e4b-875e-49fba5a26cc6 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:56.593896 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e216a1-280a-4faa-9973-7294ef0ac793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:56.594499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e216a1-280a-4faa-9973-7294ef0ac793 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:56.594767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e216a1-280a-4faa-9973-7294ef0ac793 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:56.595032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e216a1-280a-4faa-9973-7294ef0ac793 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:56.595699 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e216a1-280a-4faa-9973-7294ef0ac793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:56.595996 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e216a1-280a-4faa-9973-7294ef0ac793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:56.597334 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e216a1-280a-4faa-9973-7294ef0ac793 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:56.615030 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 360/702] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:56.615225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fc8e0-2b3a-4ec2-a67a-703fb32e24aa None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:56.615309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979e188-8e98-4314-b433-fed337fae88f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:56.615309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979e188-8e98-4314-b433-fed337fae88f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:56.615309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979e188-8e98-4314-b433-fed337fae88f None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:56.615309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 361/703] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:56.617514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979e188-8e98-4314-b433-fed337fae88f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:56.671667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392d716-cf29-4076-934e-3d9a729e2df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:56.672279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392d716-cf29-4076-934e-3d9a729e2df8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:56.672686 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392d716-cf29-4076-934e-3d9a729e2df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:56.672865 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392d716-cf29-4076-934e-3d9a729e2df8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:56.673587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392d716-cf29-4076-934e-3d9a729e2df8 None admin] RBAC: Adding query filter params (role.id=b93b6b2c6da44593a6b95db1309b8a58, scope.project.id=342524b45def418783374ff6733e94b9, user.id=92f19a17424c44eea58efb957246cb48) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:56.673897 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392d716-cf29-4076-934e-3d9a729e2df8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:56.675374 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392d716-cf29-4076-934e-3d9a729e2df8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:56.690989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 343/704] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:56:56 2022] GET /identity/v3/role_assignments?user.id=92f19a17424c44eea58efb957246cb48&scope.project.id=342524b45def418783374ff6733e94b9&role.id=b93b6b2c6da44593a6b95db1309b8a58 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:56.690989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392d716-cf29-4076-934e-3d9a729e2df8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:56.735068 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979e188-8e98-4314-b433-fed337fae88f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:56.790006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc6274-0500-4121-abf8-d62f4fd24e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:56.790568 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc6274-0500-4121-abf8-d62f4fd24e68 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:56.791137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc6274-0500-4121-abf8-d62f4fd24e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:56.791417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc6274-0500-4121-abf8-d62f4fd24e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:56.795779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:56.810322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc6274-0500-4121-abf8-d62f4fd24e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:56.812250 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc6274-0500-4121-abf8-d62f4fd24e68 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:56.828645 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392d716-cf29-4076-934e-3d9a729e2df8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:56.834642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-1dcc6274-0500-4121-abf8-d62f4fd24e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:56.834642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:56.834642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:56.834642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:56.834642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:56.834642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:56.834642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:56.834642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:56.834642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:56.834642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:56.834642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:56.834642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:56.834642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:56:56.834642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:56:56.834642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:56:56.834642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:56:56.835705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:56.835705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:56.835705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:56.835705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:56.835705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:56.835705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:56.835705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:56.835705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:56.835705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:56.835705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:56.835705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:56.835705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:56.835705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:56.835705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:56.835705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:56.835705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:56.835705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:56:56.836625 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:56:56.836625 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:56:56.836625 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:56.836625 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 362/705] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:56.837485 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f95143-c717-459c-b8a3-10b4a5e0546c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:56.838393 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:56.839641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f95143-c717-459c-b8a3-10b4a5e0546c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:56.841387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f95143-c717-459c-b8a3-10b4a5e0546c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:56.865096 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-61f95143-c717-459c-b8a3-10b4a5e0546c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:56.866397 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-61f95143-c717-459c-b8a3-10b4a5e0546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:56.888281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e76f6-5000-49b9-8db8-a8bfcf021aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:56.888968 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e76f6-5000-49b9-8db8-a8bfcf021aeb None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:56.889255 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e76f6-5000-49b9-8db8-a8bfcf021aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:56.889531 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e76f6-5000-49b9-8db8-a8bfcf021aeb None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:56.890262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e76f6-5000-49b9-8db8-a8bfcf021aeb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:56.891752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e76f6-5000-49b9-8db8-a8bfcf021aeb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:56.927251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 344/706] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Aug 9 06:56:56 2022] POST /identity/v3/users => generated 254 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:56:56.928267 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e76f6-5000-49b9-8db8-a8bfcf021aeb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:56.950944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 363/707] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:56.974947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f95143-c717-459c-b8a3-10b4a5e0546c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:57.076871 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e76f6-5000-49b9-8db8-a8bfcf021aeb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:57.104873 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f95143-c717-459c-b8a3-10b4a5e0546c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:57.122138 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2de01-77ab-4569-b2ab-b227e8564b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:57.123231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2de01-77ab-4569-b2ab-b227e8564b90 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:57.123231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2de01-77ab-4569-b2ab-b227e8564b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:57.123682 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2de01-77ab-4569-b2ab-b227e8564b90 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:57.124496 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2de01-77ab-4569-b2ab-b227e8564b90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:57.124848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2de01-77ab-4569-b2ab-b227e8564b90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:57.126313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2de01-77ab-4569-b2ab-b227e8564b90 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:57.135691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:57.142599 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 345/708] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:57.149147 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2de01-77ab-4569-b2ab-b227e8564b90 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:57.150398 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9779efe-5162-45ef-bf6d-9c5b8c93e7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:57.151143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9779efe-5162-45ef-bf6d-9c5b8c93e7eb None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:57.151405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9779efe-5162-45ef-bf6d-9c5b8c93e7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:57.151677 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9779efe-5162-45ef-bf6d-9c5b8c93e7eb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:57.153197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9779efe-5162-45ef-bf6d-9c5b8c93e7eb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:57.155553 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9779efe-5162-45ef-bf6d-9c5b8c93e7eb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:57.173117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-c9779efe-5162-45ef-bf6d-9c5b8c93e7eb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 06:56:57.173117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:57.173117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:56:57.173117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:56:57.173117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:56:57.173117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:56:57.173117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:56:57.173117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:56:57.173117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 06:56:57.173117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:57.173117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:56:57.173117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:57.173117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:57.173117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:57.173117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:57.173117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:57.173117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:57.174195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:57.174195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:57.174195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:57.174195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:57.174195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:57.174195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:57.174195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:56:57.174195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:56:57.174195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:56:57.174195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:56:57.174195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:57.174195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:57.174195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:57.174195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:57.174195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:57.174195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:57.175038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:57.175038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:57.175038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:57.175038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:57.175038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:57.175038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:57.175038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:57.175038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:57.175038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:57.175038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:57.175038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:56:57.175038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:56:57.175038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 06:56:57.175038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:57.177188 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 364/709] 10.222.0.40 () {56 vars in 1129 bytes} [Tue Aug 9 06:56:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:56:57.177450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80115cd-1c4d-4634-b563-7942c9f531e6 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:57.177731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80115cd-1c4d-4634-b563-7942c9f531e6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:57.178002 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80115cd-1c4d-4634-b563-7942c9f531e6 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:57.179522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 365/710] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:56:57.180976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:57.184880 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80115cd-1c4d-4634-b563-7942c9f531e6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:57.289557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2de01-77ab-4569-b2ab-b227e8564b90 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:57.319908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80115cd-1c4d-4634-b563-7942c9f531e6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:57.340347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef326c7f-3656-4ad7-a030-17e46d1608fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:57.341327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef326c7f-3656-4ad7-a030-17e46d1608fd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:57.341799 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef326c7f-3656-4ad7-a030-17e46d1608fd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:57.342262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef326c7f-3656-4ad7-a030-17e46d1608fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:57.352832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef326c7f-3656-4ad7-a030-17e46d1608fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:57.354778 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef326c7f-3656-4ad7-a030-17e46d1608fd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:57.357979 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2230d8-6d07-422b-9528-6b599e3c8b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:57.358790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2230d8-6d07-422b-9528-6b599e3c8b2c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:57.358949 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2230d8-6d07-422b-9528-6b599e3c8b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:57.359361 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2230d8-6d07-422b-9528-6b599e3c8b2c None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:57.360113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2230d8-6d07-422b-9528-6b599e3c8b2c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:57.360485 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2230d8-6d07-422b-9528-6b599e3c8b2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:57.362021 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2230d8-6d07-422b-9528-6b599e3c8b2c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:57.367151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 366/711] 10.222.0.40 () {56 vars in 1124 bytes} [Tue Aug 9 06:56:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:57.368433 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6325e-7fa5-4578-9e43-cfef266e7d19 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:57.368798 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6325e-7fa5-4578-9e43-cfef266e7d19 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:57.369142 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6325e-7fa5-4578-9e43-cfef266e7d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:57.370301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ef326c7f-3656-4ad7-a030-17e46d1608fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:57.370301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:57.370301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:57.370301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:57.370301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:57.370301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:57.370301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:57.370301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:57.370301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:57.370301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:57.370301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:57.370301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:57.370301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:56:57.370301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:56:57.370301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:56:57.371505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:56:57.371505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:57.371505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:57.371505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:57.371505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:57.371505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:57.371505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:57.371505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:57.371505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:57.371505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:57.371505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:57.371505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:57.371505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:57.371505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:57.371505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:57.371505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:57.371505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:57.372532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:56:57.372532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:56:57.372532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:56:57.372532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:56:57.372532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:56:57.372532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:56:57.372532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:56:57.372532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:57.374497 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 346/712] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:56:57.375440 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef326c7f-3656-4ad7-a030-17e46d1608fd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:57.391224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3ef6325e-7fa5-4578-9e43-cfef266e7d19 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:57.392701 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3ef6325e-7fa5-4578-9e43-cfef266e7d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:57.451223 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:57.471658 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:57.499177 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef326c7f-3656-4ad7-a030-17e46d1608fd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:57.499369 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 367/713] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:57.499369 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6325e-7fa5-4578-9e43-cfef266e7d19 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:57.551490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1969d-a0bb-47aa-a1d0-f4b1d77041e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:57.552094 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1969d-a0bb-47aa-a1d0-f4b1d77041e2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:57.552365 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1969d-a0bb-47aa-a1d0-f4b1d77041e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:57.552631 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1969d-a0bb-47aa-a1d0-f4b1d77041e2 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:57.553252 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1969d-a0bb-47aa-a1d0-f4b1d77041e2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:57.553546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1969d-a0bb-47aa-a1d0-f4b1d77041e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:57.555486 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1969d-a0bb-47aa-a1d0-f4b1d77041e2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:57.564392 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 347/714] 10.222.0.40 () {56 vars in 1124 bytes} [Tue Aug 9 06:56:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:57.565491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1969d-a0bb-47aa-a1d0-f4b1d77041e2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:57.669752 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6325e-7fa5-4578-9e43-cfef266e7d19 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:57.697315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1969d-a0bb-47aa-a1d0-f4b1d77041e2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:57.739271 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e92edc-8ba2-445b-8df6-1b6cc5e25f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:57.740338 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e92edc-8ba2-445b-8df6-1b6cc5e25f1f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:57.741076 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e92edc-8ba2-445b-8df6-1b6cc5e25f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:57.742037 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e92edc-8ba2-445b-8df6-1b6cc5e25f1f None admin] PATH_INFO: `/v3/services/network` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:57.742973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e92edc-8ba2-445b-8df6-1b6cc5e25f1f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:57.744593 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e92edc-8ba2-445b-8df6-1b6cc5e25f1f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:57.757055 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f8a09-1714-41fc-8a44-f840d6a6dfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:57.757719 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f8a09-1714-41fc-8a44-f840d6a6dfcd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:57.757945 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f8a09-1714-41fc-8a44-f840d6a6dfcd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:57.758215 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f8a09-1714-41fc-8a44-f840d6a6dfcd None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:57.758913 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f8a09-1714-41fc-8a44-f840d6a6dfcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:57.759242 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f8a09-1714-41fc-8a44-f840d6a6dfcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:57.759849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-55e92edc-8ba2-445b-8df6-1b6cc5e25f1f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 06:56:57.759849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:57.759849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:56:57.759849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:56:57.759849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:56:57.759849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:56:57.759849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:56:57.759849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:56:57.759849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 06:56:57.759849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:57.759849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:56:57.759849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:57.759849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:57.759849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:57.759849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:57.759849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:57.759849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:57.760802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:57.760802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:57.760802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:57.760802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:57.760802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:57.760802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:57.760802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:56:57.760802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:56:57.760802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:56:57.760802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:56:57.760802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:57.760802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:57.760802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:57.760802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:57.760802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:57.760802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:57.761727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:57.761727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:57.761727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:57.761727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:57.761727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:57.761727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:57.761727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:57.761727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:57.761727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:57.761727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:57.761727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:56:57.761727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:56:57.761727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 06:56:57.761727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:56:57.762460 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f8a09-1714-41fc-8a44-f840d6a6dfcd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:57.765052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 348/715] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:56:57 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:57.771532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e92edc-8ba2-445b-8df6-1b6cc5e25f1f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:57.782530 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 368/716] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:56:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:57.787033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:57.788299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f8a09-1714-41fc-8a44-f840d6a6dfcd None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:57.834621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:57.903020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e92edc-8ba2-445b-8df6-1b6cc5e25f1f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:57.931813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f8a09-1714-41fc-8a44-f840d6a6dfcd None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:57.943954 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a9661-01d5-4d8b-86e5-2f858f209d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:57.944881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a9661-01d5-4d8b-86e5-2f858f209d0a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:57.945803 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a9661-01d5-4d8b-86e5-2f858f209d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:57.946291 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a9661-01d5-4d8b-86e5-2f858f209d0a None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:57.947156 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a9661-01d5-4d8b-86e5-2f858f209d0a None admin] RBAC: Adding query filter params (name=network) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:57.947655 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a9661-01d5-4d8b-86e5-2f858f209d0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:57.949457 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a9661-01d5-4d8b-86e5-2f858f209d0a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:57.955744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 349/717] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Aug 9 06:56:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:57.961437 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a9661-01d5-4d8b-86e5-2f858f209d0a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:58.008871 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fb502-47af-4c53-9436-c2cf46667363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:58.009485 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fb502-47af-4c53-9436-c2cf46667363 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:58.010092 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fb502-47af-4c53-9436-c2cf46667363 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:58.010203 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fb502-47af-4c53-9436-c2cf46667363 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:58.010887 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fb502-47af-4c53-9436-c2cf46667363 None admin] RBAC: Adding query filter params (role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.project.id=342524b45def418783374ff6733e94b9, user.id=6e949d9666be44a0b6122d510168c7ab) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:58.011221 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fb502-47af-4c53-9436-c2cf46667363 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:58.013152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fb502-47af-4c53-9436-c2cf46667363 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:58.026192 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 369/718] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:56:57 2022] GET /identity/v3/role_assignments?user.id=6e949d9666be44a0b6122d510168c7ab&scope.project.id=342524b45def418783374ff6733e94b9&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:56:58.049057 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:58.076165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a9661-01d5-4d8b-86e5-2f858f209d0a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:58.112467 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7409e-375f-4300-afe3-9615aabe9d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:58.113080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7409e-375f-4300-afe3-9615aabe9d16 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:58.113352 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7409e-375f-4300-afe3-9615aabe9d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:58.113618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7409e-375f-4300-afe3-9615aabe9d16 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:58.114242 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7409e-375f-4300-afe3-9615aabe9d16 None admin] RBAC: Adding query filter params (type=network) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:58.114538 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7409e-375f-4300-afe3-9615aabe9d16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:58.115921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7409e-375f-4300-afe3-9615aabe9d16 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:58.121578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 350/719] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Aug 9 06:56:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:56:59.426392 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cdd31-e31f-4524-b1f0-fc094a07871a None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:59.427420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cdd31-e31f-4524-b1f0-fc094a07871a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:59.427920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cdd31-e31f-4524-b1f0-fc094a07871a None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:59.429733 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 370/720] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:59.435516 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be87e9-8d48-4b42-a939-0d2e586fcd8c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:59.435955 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be87e9-8d48-4b42-a939-0d2e586fcd8c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:59.436052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be87e9-8d48-4b42-a939-0d2e586fcd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:59.464124 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-21be87e9-8d48-4b42-a939-0d2e586fcd8c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:59.465992 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-21be87e9-8d48-4b42-a939-0d2e586fcd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:59.554733 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 351/721] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:56:59.589326 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cdd31-e31f-4524-b1f0-fc094a07871a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:59.630223 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab33be-6e0f-469e-aeb3-efe19fb50dc4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:59.630579 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab33be-6e0f-469e-aeb3-efe19fb50dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:59.630786 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab33be-6e0f-469e-aeb3-efe19fb50dc4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:59.632752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 352/722] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:56:59.643575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10b982-ded6-4883-b8cb-a74c45040c02 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:59.643851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10b982-ded6-4883-b8cb-a74c45040c02 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:59.644130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10b982-ded6-4883-b8cb-a74c45040c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:59.671102 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-aa10b982-ded6-4883-b8cb-a74c45040c02 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:56:59.672283 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aa10b982-ded6-4883-b8cb-a74c45040c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:56:59.719275 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:59.724085 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cdd31-e31f-4524-b1f0-fc094a07871a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:59.762668 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5d1b2-123c-4c03-92f5-a56dcc6c4e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:59.763723 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5d1b2-123c-4c03-92f5-a56dcc6c4e73 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:59.764207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5d1b2-123c-4c03-92f5-a56dcc6c4e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:59.764681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5d1b2-123c-4c03-92f5-a56dcc6c4e73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:59.783781 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5d1b2-123c-4c03-92f5-a56dcc6c4e73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:56:59.789374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-8cb5d1b2-123c-4c03-92f5-a56dcc6c4e73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:59.789374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:56:59.789374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:56:59.789374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:56:59.789374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:56:59.789374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:56:59.789374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:56:59.789374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:56:59.789374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:56:59.789374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:56:59.789374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:56:59.789374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:56:59.789374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:56:59.789374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:56:59.789374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:56:59.789374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:56:59.790365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:56:59.790365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:56:59.790365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:56:59.790365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:56:59.790365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:56:59.790365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:56:59.790365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:56:59.790365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:56:59.790365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:56:59.790365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:56:59.790365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:56:59.790365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:56:59.790365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:56:59.790365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:56:59.790365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:56:59.790365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:56:59.791321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:56:59.791321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:56:59.791321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:56:59.791321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:56:59.791321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:56:59.791321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:56:59.791321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:56:59.791321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:56:59.791321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:56:59.791321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:56:59.791321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:56:59.791321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:56:59.794197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 371/723] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:56:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:56:59.800290 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5d1b2-123c-4c03-92f5-a56dcc6c4e73 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:59.804811 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:59.835107 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 353/724] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 06:56:59.889707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10b982-ded6-4883-b8cb-a74c45040c02 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:56:59.938476 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5d1b2-123c-4c03-92f5-a56dcc6c4e73 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:56:59.979407 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1945649-0633-420e-b78a-4c2db8a24b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:56:59.980453 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1945649-0633-420e-b78a-4c2db8a24b67 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:56:59.981028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1945649-0633-420e-b78a-4c2db8a24b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:56:59.981506 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1945649-0633-420e-b78a-4c2db8a24b67 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:56:59.982376 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1945649-0633-420e-b78a-4c2db8a24b67 None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:56:59.982881 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1945649-0633-420e-b78a-4c2db8a24b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:56:59.985594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1945649-0633-420e-b78a-4c2db8a24b67 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:56:59.996204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 372/725] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:56:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:00.002801 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1945649-0633-420e-b78a-4c2db8a24b67 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:00.046487 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:00.102346 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10b982-ded6-4883-b8cb-a74c45040c02 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:00.139927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb9263-f25a-402d-b787-beb0039f2ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:00.140944 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb9263-f25a-402d-b787-beb0039f2ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:00.141486 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb9263-f25a-402d-b787-beb0039f2ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:00.141961 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb9263-f25a-402d-b787-beb0039f2ff8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:00.153623 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb9263-f25a-402d-b787-beb0039f2ff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:57:00.158637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-69bb9263-f25a-402d-b787-beb0039f2ff8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:57:00.158637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:00.158637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:00.158637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:00.158637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:00.158637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:00.158637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:00.158637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:00.158637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:00.158637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:00.158637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:00.158637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:00.158637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:57:00.158637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:57:00.158637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:57:00.158637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:57:00.159617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:57:00.159617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:57:00.159617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:57:00.159617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:57:00.159617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:00.159617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:00.159617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:00.159617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:00.159617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:00.159617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:00.159617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:00.159617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:00.159617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:00.159617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:00.159617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:00.159617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:00.160470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:00.160470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:00.160470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:00.160470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:00.160470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:57:00.160470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:57:00.160470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:57:00.160470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:57:00.160470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:57:00.160470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:57:00.160470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:57:00.160470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:00.163461 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 354/726] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:56:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:00.174587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb9263-f25a-402d-b787-beb0039f2ff8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:00.199419 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1945649-0633-420e-b78a-4c2db8a24b67 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:00.256257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:00.283250 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339e26b-d280-41da-b1df-64ae973230a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:00.284013 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339e26b-d280-41da-b1df-64ae973230a8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:00.284701 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339e26b-d280-41da-b1df-64ae973230a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:00.285022 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339e26b-d280-41da-b1df-64ae973230a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:00.300639 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339e26b-d280-41da-b1df-64ae973230a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:00.302757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339e26b-d280-41da-b1df-64ae973230a8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:00.307817 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb9263-f25a-402d-b787-beb0039f2ff8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:00.321011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-a339e26b-d280-41da-b1df-64ae973230a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:00.321011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:00.321011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:00.321011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:00.321011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:00.321011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:00.321011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:00.321011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:00.321011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:00.321011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:00.321011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:00.321011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:00.321011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:00.321011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:00.321011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:00.321011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:00.322186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:00.322186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:00.322186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:00.322186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:00.322186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:00.322186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:00.322186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:00.322186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:00.322186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:00.322186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:00.322186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:00.322186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:00.322186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:00.322186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:00.322186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:00.322186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:00.322186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:00.323104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:00.323104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:00.323104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:00.323104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 373/727] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:00.324443 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2178677-3ace-4f67-8f1b-93ea7b26d8d4 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:00.325719 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2178677-3ace-4f67-8f1b-93ea7b26d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:00.325719 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2178677-3ace-4f67-8f1b-93ea7b26d8d4 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:00.326903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 374/728] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:00.329406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2178677-3ace-4f67-8f1b-93ea7b26d8d4 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:00.357418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0685c73-11cf-448f-a3fb-8c86fe0922ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:00.358379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0685c73-11cf-448f-a3fb-8c86fe0922ae None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:00.358663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0685c73-11cf-448f-a3fb-8c86fe0922ae None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:00.358939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0685c73-11cf-448f-a3fb-8c86fe0922ae None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:00.359652 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0685c73-11cf-448f-a3fb-8c86fe0922ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:00.359956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0685c73-11cf-448f-a3fb-8c86fe0922ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:00.361876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0685c73-11cf-448f-a3fb-8c86fe0922ae None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:00.373314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 355/729] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:57:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:00.374613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc083c-6c2e-4f22-a3fe-6b84e04e63e8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:00.374947 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc083c-6c2e-4f22-a3fe-6b84e04e63e8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:00.375248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc083c-6c2e-4f22-a3fe-6b84e04e63e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:00.402558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2bcc083c-6c2e-4f22-a3fe-6b84e04e63e8 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:00.404011 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2bcc083c-6c2e-4f22-a3fe-6b84e04e63e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:00.427164 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:00.470119 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2178677-3ace-4f67-8f1b-93ea7b26d8d4 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:00.487399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 356/730] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:57:00.488256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc083c-6c2e-4f22-a3fe-6b84e04e63e8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:00.522755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bab8dd-153d-463f-b885-8f4da6bef20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:00.523361 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bab8dd-153d-463f-b885-8f4da6bef20a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:00.523637 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bab8dd-153d-463f-b885-8f4da6bef20a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:00.523904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bab8dd-153d-463f-b885-8f4da6bef20a None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:00.524548 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bab8dd-153d-463f-b885-8f4da6bef20a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:00.524856 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bab8dd-153d-463f-b885-8f4da6bef20a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:00.526187 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bab8dd-153d-463f-b885-8f4da6bef20a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:00.541536 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 375/731] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:00.546478 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311aa8c-6f56-4add-93d1-3f57b781ff03 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:00.546478 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311aa8c-6f56-4add-93d1-3f57b781ff03 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:00.546478 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311aa8c-6f56-4add-93d1-3f57b781ff03 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:00.546478 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 376/732] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:00.546478 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311aa8c-6f56-4add-93d1-3f57b781ff03 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:00.550382 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:00.604816 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc083c-6c2e-4f22-a3fe-6b84e04e63e8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:00.643631 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d0c93-6190-4064-a536-628f798b80b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:00.644688 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d0c93-6190-4064-a536-628f798b80b1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:00.644964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d0c93-6190-4064-a536-628f798b80b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:00.645225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d0c93-6190-4064-a536-628f798b80b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:00.655632 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d0c93-6190-4064-a536-628f798b80b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:00.657052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d0c93-6190-4064-a536-628f798b80b1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:00.657157 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311aa8c-6f56-4add-93d1-3f57b781ff03 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:00.671103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-2d7d0c93-6190-4064-a536-628f798b80b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:00.671103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:00.671103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:00.671103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:00.671103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:00.671103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:00.671103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:00.671103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:00.671103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:00.671103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:00.671103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:00.671103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:00.671103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:00.671103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:00.671103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:00.671103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:00.672249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:00.672249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:00.672249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:00.672249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:00.672249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:00.672249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:00.672249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:00.672249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:00.672249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:00.672249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:00.672249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:00.672249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:00.672249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:00.672249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:00.672249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:00.672249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:00.672249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:00.673160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:00.673160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:00.673160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:00.673160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 357/733] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:00.673160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d0c93-6190-4064-a536-628f798b80b1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:00.688911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:00.695029 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed276af2-8d6a-48ba-bb5b-00bb984c3bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:00.696076 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed276af2-8d6a-48ba-bb5b-00bb984c3bf8 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:00.696355 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed276af2-8d6a-48ba-bb5b-00bb984c3bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:00.696629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed276af2-8d6a-48ba-bb5b-00bb984c3bf8 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:00.697269 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed276af2-8d6a-48ba-bb5b-00bb984c3bf8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:00.698615 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed276af2-8d6a-48ba-bb5b-00bb984c3bf8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:00.716300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 377/734] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Aug 9 06:57:00 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:57:00.717498 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caafd5-556a-4202-aa0d-f74ce07f6582 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:00.717780 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caafd5-556a-4202-aa0d-f74ce07f6582 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:00.718058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caafd5-556a-4202-aa0d-f74ce07f6582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:00.737584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-16caafd5-556a-4202-aa0d-f74ce07f6582 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:00.738819 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-16caafd5-556a-4202-aa0d-f74ce07f6582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:00.789849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d0c93-6190-4064-a536-628f798b80b1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:00.791540 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:00.836583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 378/735] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:57:00.836583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbf41d-6b72-4683-b04e-44bd83214fb6 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:00.836583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbf41d-6b72-4683-b04e-44bd83214fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:00.836583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbf41d-6b72-4683-b04e-44bd83214fb6 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:00.836583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 379/736] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:00.836583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbf41d-6b72-4683-b04e-44bd83214fb6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:00.845934 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc4c9a-5b78-4a14-8642-61197560b7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:00.845934 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc4c9a-5b78-4a14-8642-61197560b7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:00.845934 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc4c9a-5b78-4a14-8642-61197560b7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:00.845934 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc4c9a-5b78-4a14-8642-61197560b7b1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:00.853837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc4c9a-5b78-4a14-8642-61197560b7b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:00.855433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc4c9a-5b78-4a14-8642-61197560b7b1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:00.867747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1dfc4c9a-5b78-4a14-8642-61197560b7b1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 06:57:00.867747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:00.867747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:00.867747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:00.867747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:00.867747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:00.867747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:00.867747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:00.867747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:00.867747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:00.867747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:00.867747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:00.867747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:57:00.867747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:57:00.867747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:57:00.867747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:57:00.868915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:00.868915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:00.868915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:57:00.868915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:00.868915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:57:00.868915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:00.868915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:00.868915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:00.868915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:00.868915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:00.868915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:00.868915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:00.868915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:00.868915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:00.868915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:00.868915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:00.868915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:00.868915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:00.870087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:00.870087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:00.870087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:57:00.870087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:57:00.870087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:57:00.870087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:57:00.870087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:57:00.870087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:57:00.870087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 06:57:00.870087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:00.870087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 358/737] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Aug 9 06:57:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:00.870087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec505338-9b96-4c9f-816b-876812d49fc1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:00.870979 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec505338-9b96-4c9f-816b-876812d49fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:00.870979 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec505338-9b96-4c9f-816b-876812d49fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:00.890171 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ec505338-9b96-4c9f-816b-876812d49fc1 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:00.891382 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ec505338-9b96-4c9f-816b-876812d49fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:00.963371 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbf41d-6b72-4683-b04e-44bd83214fb6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:00.966067 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 359/738] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 06:57:00.972471 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec505338-9b96-4c9f-816b-876812d49fc1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:00.983865 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:01.005203 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9841ca6-d58e-443d-932f-83cf464c9153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:01.005808 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9841ca6-d58e-443d-932f-83cf464c9153 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:01.006201 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9841ca6-d58e-443d-932f-83cf464c9153 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:01.006475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9841ca6-d58e-443d-932f-83cf464c9153 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:01.007262 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9841ca6-d58e-443d-932f-83cf464c9153 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:01.007656 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9841ca6-d58e-443d-932f-83cf464c9153 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:01.009028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9841ca6-d58e-443d-932f-83cf464c9153 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:01.026299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 380/739] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:01.026299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9841ca6-d58e-443d-932f-83cf464c9153 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:01.070849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:01.085297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec505338-9b96-4c9f-816b-876812d49fc1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:01.118487 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523384d-1c00-4767-92af-1236303f7536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:01.119127 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523384d-1c00-4767-92af-1236303f7536 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:01.119405 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523384d-1c00-4767-92af-1236303f7536 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:01.119670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523384d-1c00-4767-92af-1236303f7536 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:01.130177 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523384d-1c00-4767-92af-1236303f7536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:57:01.133934 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9841ca6-d58e-443d-932f-83cf464c9153 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:01.134746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6523384d-1c00-4767-92af-1236303f7536 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:57:01.134746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:01.134746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:01.134746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:01.134746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:01.134746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:01.134746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:01.134746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:01.134746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:01.134746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:01.134746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:01.134746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:01.134746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:57:01.134746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:57:01.134746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:57:01.134746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:57:01.135706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:57:01.135706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:57:01.135706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:57:01.135706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:57:01.135706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:01.135706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:01.135706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:01.135706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:01.135706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:01.135706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:01.135706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:01.135706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:01.135706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:01.135706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:01.135706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:01.135706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:01.136678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:01.136678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:01.136678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:01.136678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:01.136678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:57:01.136678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:57:01.136678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:57:01.136678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:57:01.136678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:57:01.136678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:57:01.136678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:57:01.136678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:01.136678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 360/740] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:57:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:01.136678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523384d-1c00-4767-92af-1236303f7536 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:01.176696 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385abba5-5f95-4f50-be79-4615af0cec4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:01.177320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385abba5-5f95-4f50-be79-4615af0cec4b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:01.177600 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385abba5-5f95-4f50-be79-4615af0cec4b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:01.177873 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385abba5-5f95-4f50-be79-4615af0cec4b None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:01.178606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385abba5-5f95-4f50-be79-4615af0cec4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:01.178909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385abba5-5f95-4f50-be79-4615af0cec4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:01.180347 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385abba5-5f95-4f50-be79-4615af0cec4b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:01.206736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 381/741] 10.222.0.40 () {56 vars in 1149 bytes} [Tue Aug 9 06:57:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:01.206736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385abba5-5f95-4f50-be79-4615af0cec4b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:01.249074 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:01.250517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523384d-1c00-4767-92af-1236303f7536 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:01.286594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b01ebd-f0d1-4314-aa75-8eaf72cb4e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:01.287232 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b01ebd-f0d1-4314-aa75-8eaf72cb4e06 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:01.287514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b01ebd-f0d1-4314-aa75-8eaf72cb4e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:01.287788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b01ebd-f0d1-4314-aa75-8eaf72cb4e06 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:01.288428 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b01ebd-f0d1-4314-aa75-8eaf72cb4e06 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:01.289789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b01ebd-f0d1-4314-aa75-8eaf72cb4e06 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:01.308864 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 361/742] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Aug 9 06:57:01 2022] POST /identity/v3/services => generated 240 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:57:01.320127 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b01ebd-f0d1-4314-aa75-8eaf72cb4e06 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:01.332878 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385abba5-5f95-4f50-be79-4615af0cec4b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:01.339426 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:01.386040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfb693-df47-4c53-9b83-68f4473060f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:01.387427 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfb693-df47-4c53-9b83-68f4473060f3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:01.387720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfb693-df47-4c53-9b83-68f4473060f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:01.387998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfb693-df47-4c53-9b83-68f4473060f3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:01.396742 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfb693-df47-4c53-9b83-68f4473060f3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:01.398275 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfb693-df47-4c53-9b83-68f4473060f3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:01.412367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-80bfb693-df47-4c53-9b83-68f4473060f3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 06:57:01.412367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:01.412367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:01.412367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:01.412367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:01.412367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:01.412367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:01.412367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:01.412367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:01.412367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:01.412367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:01.412367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:01.412367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:57:01.412367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:57:01.412367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:57:01.412367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:57:01.413417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:01.413417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:01.413417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:57:01.413417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:01.413417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:57:01.413417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:01.413417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:01.413417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:01.413417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:01.413417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:01.413417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:01.413417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:01.413417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:01.413417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:01.413417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:01.413417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:01.413417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:01.413417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:01.414946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:01.414946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:01.414946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:57:01.414946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:57:01.414946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:57:01.414946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:57:01.414946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:57:01.414946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:57:01.414946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 06:57:01.414946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:01.414946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 382/743] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:57:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:01.414946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfb693-df47-4c53-9b83-68f4473060f3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:01.476043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b01ebd-f0d1-4314-aa75-8eaf72cb4e06 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:01.524517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae702d8-c12f-4f3e-aadb-1899ddaec4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:01.525189 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae702d8-c12f-4f3e-aadb-1899ddaec4ff None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:01.525391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae702d8-c12f-4f3e-aadb-1899ddaec4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:01.525662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae702d8-c12f-4f3e-aadb-1899ddaec4ff None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:01.526329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae702d8-c12f-4f3e-aadb-1899ddaec4ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:01.526634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae702d8-c12f-4f3e-aadb-1899ddaec4ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:01.529212 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae702d8-c12f-4f3e-aadb-1899ddaec4ff None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:01.537950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:01.538784 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 362/744] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:57:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:01.543772 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae702d8-c12f-4f3e-aadb-1899ddaec4ff None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:01.548572 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfb693-df47-4c53-9b83-68f4473060f3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:01.591177 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c372860-13f2-4b57-8d38-15e34b3a5348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:01.591709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c372860-13f2-4b57-8d38-15e34b3a5348 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:01.591987 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c372860-13f2-4b57-8d38-15e34b3a5348 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:01.592280 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c372860-13f2-4b57-8d38-15e34b3a5348 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:01.637573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:01.676838 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae702d8-c12f-4f3e-aadb-1899ddaec4ff None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:01.684926 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c372860-13f2-4b57-8d38-15e34b3a5348 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:01.686640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c372860-13f2-4b57-8d38-15e34b3a5348 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:01.720548 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b6fd2-3e8d-4f82-9683-58ca20baebf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:01.721528 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b6fd2-3e8d-4f82-9683-58ca20baebf9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:01.722001 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b6fd2-3e8d-4f82-9683-58ca20baebf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:01.722546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b6fd2-3e8d-4f82-9683-58ca20baebf9 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:01.723619 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b6fd2-3e8d-4f82-9683-58ca20baebf9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:01.724139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b6fd2-3e8d-4f82-9683-58ca20baebf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:01.725776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b6fd2-3e8d-4f82-9683-58ca20baebf9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:01.744396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 363/745] 10.222.0.40 () {56 vars in 1135 bytes} [Tue Aug 9 06:57:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:01.745529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b6fd2-3e8d-4f82-9683-58ca20baebf9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:01.793869 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:01.807162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 383/746] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:57:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 06:57:01.808821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c372860-13f2-4b57-8d38-15e34b3a5348 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:01.872654 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b6fd2-3e8d-4f82-9683-58ca20baebf9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:01.909770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:01.922123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c99f54-b612-454e-b683-65046cf43d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:01.922973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c99f54-b612-454e-b683-65046cf43d0e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:01.923451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c99f54-b612-454e-b683-65046cf43d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:01.923870 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c99f54-b612-454e-b683-65046cf43d0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:01.938149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c372860-13f2-4b57-8d38-15e34b3a5348 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:01.939127 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c99f54-b612-454e-b683-65046cf43d0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:01.941867 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c99f54-b612-454e-b683-65046cf43d0e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:01.961014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f6c99f54-b612-454e-b683-65046cf43d0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:01.961014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:01.961014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:01.961014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:01.961014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:01.961014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:01.961014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:01.961014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:01.961014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:01.961014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:01.961014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:01.961014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:01.961014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:01.961014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:01.961014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:01.961014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:01.962279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:01.962279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:01.962279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:01.962279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:01.962279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:01.962279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:01.962279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:01.962279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:01.962279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:01.962279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:01.962279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:01.962279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:01.962279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:01.962279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:01.962279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:01.962279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:01.962279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:01.963385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:01.963385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:01.963385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:01.969729 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 364/747] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:01.969729 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c99f54-b612-454e-b683-65046cf43d0e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:01.985509 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd1240-4459-47c4-897d-cb337dd8a3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:01.986788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd1240-4459-47c4-897d-cb337dd8a3af None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:01.987528 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd1240-4459-47c4-897d-cb337dd8a3af None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:01.988009 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd1240-4459-47c4-897d-cb337dd8a3af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:02.057954 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:02.069364 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd1240-4459-47c4-897d-cb337dd8a3af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:02.071339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd1240-4459-47c4-897d-cb337dd8a3af None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:02.095738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c99f54-b612-454e-b683-65046cf43d0e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:02.142593 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff3c5a-aef5-4dc0-aa68-270bce4ee8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:02.143832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff3c5a-aef5-4dc0-aa68-270bce4ee8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:02.144295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff3c5a-aef5-4dc0-aa68-270bce4ee8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:02.144744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff3c5a-aef5-4dc0-aa68-270bce4ee8b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:02.159744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff3c5a-aef5-4dc0-aa68-270bce4ee8b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:02.162060 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff3c5a-aef5-4dc0-aa68-270bce4ee8b4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:02.180705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-07ff3c5a-aef5-4dc0-aa68-270bce4ee8b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:02.180705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:02.180705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:02.180705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:02.180705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:02.180705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:02.180705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:02.180705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:02.180705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:02.180705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:02.180705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:02.180705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:02.180705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:02.180705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:02.180705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:02.180705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:02.181706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:02.181706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:02.181706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:02.181706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:02.181706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:02.181706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:02.181706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:02.181706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:02.181706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:02.181706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:02.181706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:02.181706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:02.181706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:02.181706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:02.181706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:02.181706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:02.181706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:02.182956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:02.182956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:02.182956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:02.183448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 384/748] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:57:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 06:57:02.184325 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd1240-4459-47c4-897d-cb337dd8a3af None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:02.189029 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 365/749] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:02.189029 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff3c5a-aef5-4dc0-aa68-270bce4ee8b4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:02.221002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:02.299742 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:02.311504 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd1240-4459-47c4-897d-cb337dd8a3af None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:02.320719 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff3c5a-aef5-4dc0-aa68-270bce4ee8b4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:02.349380 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806319a-a5b7-4b72-b837-2331d73e068d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:02.349786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806319a-a5b7-4b72-b837-2331d73e068d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:02.350063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806319a-a5b7-4b72-b837-2331d73e068d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:02.350328 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806319a-a5b7-4b72-b837-2331d73e068d None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:02.350966 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806319a-a5b7-4b72-b837-2331d73e068d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:02.351292 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806319a-a5b7-4b72-b837-2331d73e068d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:02.352698 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806319a-a5b7-4b72-b837-2331d73e068d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:02.372055 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 385/750] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:02.372055 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806319a-a5b7-4b72-b837-2331d73e068d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:02.375696 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb318f-cc9f-439b-8085-814a979520f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:02.376436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb318f-cc9f-439b-8085-814a979520f8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:02.376808 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb318f-cc9f-439b-8085-814a979520f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:02.377967 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb318f-cc9f-439b-8085-814a979520f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:02.388327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb318f-cc9f-439b-8085-814a979520f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:02.389882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb318f-cc9f-439b-8085-814a979520f8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:02.405974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-58fb318f-cc9f-439b-8085-814a979520f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:02.405974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:02.405974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:02.405974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:02.405974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:02.405974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:02.405974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:02.405974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:02.405974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:02.405974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:02.405974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:02.405974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:02.405974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:02.405974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:02.405974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:02.405974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:02.407143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:02.407143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:02.407143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:02.407143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:02.407143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:02.407143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:02.407143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:02.407143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:02.407143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:02.407143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:02.407143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:02.407143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:02.407143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:02.407143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:02.407143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:02.407143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:02.407143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:02.408264 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:02.408264 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:02.408264 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:02.415151 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 366/751] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:02.416102 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb318f-cc9f-439b-8085-814a979520f8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:02.507100 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:02.510088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806319a-a5b7-4b72-b837-2331d73e068d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:02.525621 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb318f-cc9f-439b-8085-814a979520f8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:02.556109 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06cae0-98cf-4c18-91e4-017f295473b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:02.557452 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06cae0-98cf-4c18-91e4-017f295473b1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:02.558684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06cae0-98cf-4c18-91e4-017f295473b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:02.560037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06cae0-98cf-4c18-91e4-017f295473b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:02.561041 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06cae0-98cf-4c18-91e4-017f295473b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:02.561606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06cae0-98cf-4c18-91e4-017f295473b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:02.563519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06cae0-98cf-4c18-91e4-017f295473b1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:02.564094 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9ab55-262f-4676-905b-89533a3fbce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:02.564814 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9ab55-262f-4676-905b-89533a3fbce7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:02.565184 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9ab55-262f-4676-905b-89533a3fbce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:02.565546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9ab55-262f-4676-905b-89533a3fbce7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:02.574166 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9ab55-262f-4676-905b-89533a3fbce7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:02.575842 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9ab55-262f-4676-905b-89533a3fbce7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:02.584472 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 386/752] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:02.584472 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06cae0-98cf-4c18-91e4-017f295473b1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:02.590795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ceb9ab55-262f-4676-905b-89533a3fbce7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 06:57:02.590795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:02.590795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:02.590795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:02.590795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:02.590795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:02.590795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:02.590795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:02.590795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:02.590795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:02.590795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:02.590795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:02.590795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:57:02.590795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:57:02.590795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:57:02.590795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:57:02.591787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:02.591787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:02.591787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:57:02.591787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:02.591787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:57:02.591787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:02.591787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:02.591787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:02.591787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:02.591787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:02.591787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:02.591787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:02.591787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:02.591787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:02.591787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:02.591787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:02.591787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:02.591787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:02.593287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:02.593287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:02.593287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:57:02.593287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:57:02.593287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:57:02.593287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:57:02.593287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:57:02.593287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:57:02.593287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 06:57:02.593287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:02.596677 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 367/753] 10.222.0.40 () {56 vars in 1093 bytes} [Tue Aug 9 06:57:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:02.597498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9ab55-262f-4676-905b-89533a3fbce7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:02.608383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:02.715153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06cae0-98cf-4c18-91e4-017f295473b1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:02.727234 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9ab55-262f-4676-905b-89533a3fbce7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:02.753394 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaacd40-744e-4718-b0a1-cdc617ff200d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:02.754083 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaacd40-744e-4718-b0a1-cdc617ff200d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:02.754491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaacd40-744e-4718-b0a1-cdc617ff200d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:02.754833 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaacd40-744e-4718-b0a1-cdc617ff200d None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:02.755578 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaacd40-744e-4718-b0a1-cdc617ff200d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:02.755944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaacd40-744e-4718-b0a1-cdc617ff200d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:02.757462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaacd40-744e-4718-b0a1-cdc617ff200d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:02.772032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 387/754] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:02.773211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaacd40-744e-4718-b0a1-cdc617ff200d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:02.779615 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db057243-c538-4c68-bb23-30c4b9d0474b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:02.780324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db057243-c538-4c68-bb23-30c4b9d0474b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:02.780685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db057243-c538-4c68-bb23-30c4b9d0474b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:02.781026 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db057243-c538-4c68-bb23-30c4b9d0474b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:02.788431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db057243-c538-4c68-bb23-30c4b9d0474b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:02.789860 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db057243-c538-4c68-bb23-30c4b9d0474b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:02.801462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-db057243-c538-4c68-bb23-30c4b9d0474b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:02.801462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:02.801462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:02.801462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:02.801462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:02.801462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:02.801462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:02.801462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:02.801462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:02.801462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:02.801462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:02.801462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:02.801462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:57:02.801462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:57:02.801462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:57:02.802364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:57:02.802364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:02.802364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:02.802364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:02.802364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:02.802364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:02.802364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:02.802364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:02.802364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:02.802364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:02.802364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:02.802364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:02.802364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:02.802364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:02.802364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:02.802364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:02.802364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:02.803660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:57:02.803660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:57:02.803660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:57:02.803660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:57:02.803660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:57:02.803660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:57:02.803660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:02.803660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:02.803660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 368/755] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:02.803660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db057243-c538-4c68-bb23-30c4b9d0474b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:02.809136 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:02.856257 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:02.890860 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaacd40-744e-4718-b0a1-cdc617ff200d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:02.912166 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db057243-c538-4c68-bb23-30c4b9d0474b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:02.925214 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c643559-65c1-4f0f-9887-4e0194b82358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:02.925813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c643559-65c1-4f0f-9887-4e0194b82358 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:02.926097 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c643559-65c1-4f0f-9887-4e0194b82358 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:02.926366 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c643559-65c1-4f0f-9887-4e0194b82358 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:02.927109 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c643559-65c1-4f0f-9887-4e0194b82358 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:02.927420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c643559-65c1-4f0f-9887-4e0194b82358 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:02.928821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c643559-65c1-4f0f-9887-4e0194b82358 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:02.945945 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 388/756] 10.222.0.40 () {56 vars in 1133 bytes} [Tue Aug 9 06:57:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:02.947478 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d92d24-b8f6-44aa-8172-1f5878022a43 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:02.947992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d92d24-b8f6-44aa-8172-1f5878022a43 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:02.948456 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d92d24-b8f6-44aa-8172-1f5878022a43 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:02.950820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 389/757] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:02.951801 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d92d24-b8f6-44aa-8172-1f5878022a43 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:02.956296 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bd2c3-940f-499b-9b75-e05c08dbbd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:02.956945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bd2c3-940f-499b-9b75-e05c08dbbd28 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:02.957225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bd2c3-940f-499b-9b75-e05c08dbbd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:02.957498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bd2c3-940f-499b-9b75-e05c08dbbd28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:02.964733 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bd2c3-940f-499b-9b75-e05c08dbbd28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:02.966219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bd2c3-940f-499b-9b75-e05c08dbbd28 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:02.977335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3f5bd2c3-940f-499b-9b75-e05c08dbbd28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:02.977335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:02.977335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:02.977335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:02.977335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:02.977335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:02.977335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:02.977335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:02.977335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:02.977335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:02.977335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:02.977335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:02.977335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:57:02.977335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:57:02.977335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:57:02.978248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:57:02.978248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:02.978248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:02.978248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:02.978248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:02.978248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:02.978248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:02.978248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:02.978248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:02.978248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:02.978248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:02.978248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:02.978248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:02.978248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:02.978248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:02.978248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:02.978248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:02.979197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:57:02.979197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:57:02.979197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:57:02.979197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:57:02.979197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:57:02.979197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:57:02.979197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:02.979197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:02.979197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 369/758] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:02.979687 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bd2c3-940f-499b-9b75-e05c08dbbd28 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:03.047667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:03.063920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d92d24-b8f6-44aa-8172-1f5878022a43 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:03.091641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bd2c3-940f-499b-9b75-e05c08dbbd28 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:03.095493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:03.103120 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a05a3-ff16-42ba-aa55-99e349fc20fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:03.103739 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a05a3-ff16-42ba-aa55-99e349fc20fd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:03.104018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a05a3-ff16-42ba-aa55-99e349fc20fd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:03.104384 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a05a3-ff16-42ba-aa55-99e349fc20fd None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:03.105478 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a05a3-ff16-42ba-aa55-99e349fc20fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:03.106017 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a05a3-ff16-42ba-aa55-99e349fc20fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:03.107498 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a05a3-ff16-42ba-aa55-99e349fc20fd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:03.119176 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 390/759] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:57:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:03.120400 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb574c7-f0f3-4511-880e-d6c4d925762d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:03.120735 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb574c7-f0f3-4511-880e-d6c4d925762d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:03.121038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb574c7-f0f3-4511-880e-d6c4d925762d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:03.131819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fea1a-1a72-4795-b9ca-b9b5fe465c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:03.132443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fea1a-1a72-4795-b9ca-b9b5fe465c20 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:03.132716 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fea1a-1a72-4795-b9ca-b9b5fe465c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:03.132982 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fea1a-1a72-4795-b9ca-b9b5fe465c20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:03.139176 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8fb574c7-f0f3-4511-880e-d6c4d925762d None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:03.140361 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8fb574c7-f0f3-4511-880e-d6c4d925762d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:03.144653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fea1a-1a72-4795-b9ca-b9b5fe465c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:03.146087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fea1a-1a72-4795-b9ca-b9b5fe465c20 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:03.161206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e66fea1a-1a72-4795-b9ca-b9b5fe465c20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:03.161206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:03.161206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:03.161206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:03.161206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:03.161206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:03.161206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:03.161206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:03.161206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:03.161206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:03.161206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:03.161206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:03.161206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:03.161206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:03.161206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:03.161206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:03.162329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:03.162329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:03.162329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:03.162329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:03.162329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:03.162329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:03.162329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:03.162329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:03.162329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:03.162329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:03.162329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:03.162329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:03.162329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:03.162329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:03.162329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:03.162329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:03.162329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:03.163253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:03.163253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:03.163253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:03.163253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 370/760] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:03.163253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fea1a-1a72-4795-b9ca-b9b5fe465c20 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:03.215824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 391/761] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:03.224597 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb574c7-f0f3-4511-880e-d6c4d925762d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:03.272249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fea1a-1a72-4795-b9ca-b9b5fe465c20 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:03.288584 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:03.308727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b153be-a55f-4ef1-90b4-068d89408449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:03.309484 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b153be-a55f-4ef1-90b4-068d89408449 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:03.309760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b153be-a55f-4ef1-90b4-068d89408449 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:03.310029 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b153be-a55f-4ef1-90b4-068d89408449 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:03.310711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b153be-a55f-4ef1-90b4-068d89408449 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:03.311012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b153be-a55f-4ef1-90b4-068d89408449 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:03.312444 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b153be-a55f-4ef1-90b4-068d89408449 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:03.325133 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 371/762] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:57:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:03.325936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b153be-a55f-4ef1-90b4-068d89408449 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:03.348114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb574c7-f0f3-4511-880e-d6c4d925762d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:03.373079 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:03.388385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfc6f0-322d-4bf0-8c19-c8ec24a005bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:03.388891 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfc6f0-322d-4bf0-8c19-c8ec24a005bd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:03.389162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfc6f0-322d-4bf0-8c19-c8ec24a005bd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:03.389427 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfc6f0-322d-4bf0-8c19-c8ec24a005bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:03.390140 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfc6f0-322d-4bf0-8c19-c8ec24a005bd None admin] RBAC: Adding query filter params (role.id=b93b6b2c6da44593a6b95db1309b8a58, scope.project.id=342524b45def418783374ff6733e94b9, user.id=664e4353726c42c9bfb80b1701d35aae) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:03.390444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfc6f0-322d-4bf0-8c19-c8ec24a005bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:03.391882 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfc6f0-322d-4bf0-8c19-c8ec24a005bd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:03.397914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 392/763] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:57:03 2022] GET /identity/v3/role_assignments?user.id=664e4353726c42c9bfb80b1701d35aae&scope.project.id=342524b45def418783374ff6733e94b9&role.id=b93b6b2c6da44593a6b95db1309b8a58 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:03.398681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfc6f0-322d-4bf0-8c19-c8ec24a005bd None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:03.439243 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b153be-a55f-4ef1-90b4-068d89408449 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:03.480587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a050fe-b2d3-428a-91cd-082b5f98b399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:03.481235 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a050fe-b2d3-428a-91cd-082b5f98b399 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:03.481385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a050fe-b2d3-428a-91cd-082b5f98b399 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:03.481664 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a050fe-b2d3-428a-91cd-082b5f98b399 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:03.482300 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a050fe-b2d3-428a-91cd-082b5f98b399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:03.482602 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a050fe-b2d3-428a-91cd-082b5f98b399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:03.484151 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a050fe-b2d3-428a-91cd-082b5f98b399 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:03.501626 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 372/764] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:03.501626 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a050fe-b2d3-428a-91cd-082b5f98b399 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:03.532281 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfc6f0-322d-4bf0-8c19-c8ec24a005bd None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:03.540204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:03.569799 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63471a11-39ec-42ee-b9d2-11561d7e70a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:03.570418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63471a11-39ec-42ee-b9d2-11561d7e70a7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:03.570840 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63471a11-39ec-42ee-b9d2-11561d7e70a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:03.571065 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63471a11-39ec-42ee-b9d2-11561d7e70a7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:03.571829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63471a11-39ec-42ee-b9d2-11561d7e70a7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:03.573163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63471a11-39ec-42ee-b9d2-11561d7e70a7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:03.583077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-63471a11-39ec-42ee-b9d2-11561d7e70a7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 06:57:03.583077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:03.583077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:03.583077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:03.583077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:03.583077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:03.583077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:03.583077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:03.583077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 06:57:03.583077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:03.583077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:03.583077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:03.583077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:03.583077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:03.583077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:03.583077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:03.583077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:03.584100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:03.584100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:03.584100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:03.584100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:03.584100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:03.584100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:03.584100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:03.584100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:03.584100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:03.584100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:03.584100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:03.584100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:03.584100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:03.584100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:03.584100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:03.584100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:03.584951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:03.584951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:03.584951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:03.584951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:03.584951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:03.584951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:03.584951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:03.584951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:03.584951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:03.584951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:03.584951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:03.584951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:03.584951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 06:57:03.584951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:03.584951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 393/765] 10.222.0.40 () {56 vars in 1129 bytes} [Tue Aug 9 06:57:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:03.585787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868b277-eb2e-4bb5-b514-6961cb952090 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:03.586151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868b277-eb2e-4bb5-b514-6961cb952090 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:03.586378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868b277-eb2e-4bb5-b514-6961cb952090 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:03.591194 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 394/766] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:03.591194 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868b277-eb2e-4bb5-b514-6961cb952090 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:03.615317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a050fe-b2d3-428a-91cd-082b5f98b399 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:03.653584 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0121f9-4e38-4c3c-9dbd-4ac130529d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:03.654294 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:03.654958 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0121f9-4e38-4c3c-9dbd-4ac130529d32 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:03.655412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0121f9-4e38-4c3c-9dbd-4ac130529d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:03.655586 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0121f9-4e38-4c3c-9dbd-4ac130529d32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:03.656276 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0121f9-4e38-4c3c-9dbd-4ac130529d32 None admin] RBAC: Adding query filter params (role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.project.id=342524b45def418783374ff6733e94b9, user.id=92f19a17424c44eea58efb957246cb48) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:03.656580 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0121f9-4e38-4c3c-9dbd-4ac130529d32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:03.658000 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0121f9-4e38-4c3c-9dbd-4ac130529d32 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:03.663386 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 373/767] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:57:03 2022] GET /identity/v3/role_assignments?user.id=92f19a17424c44eea58efb957246cb48&scope.project.id=342524b45def418783374ff6733e94b9&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:03.663386 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0121f9-4e38-4c3c-9dbd-4ac130529d32 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:03.731661 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868b277-eb2e-4bb5-b514-6961cb952090 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:03.768005 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ef15e-4edb-4c78-9ed2-0bafad9da43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:03.768804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ef15e-4edb-4c78-9ed2-0bafad9da43d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:03.769180 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ef15e-4edb-4c78-9ed2-0bafad9da43d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:03.769548 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ef15e-4edb-4c78-9ed2-0bafad9da43d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:03.777738 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ef15e-4edb-4c78-9ed2-0bafad9da43d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:03.779406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ef15e-4edb-4c78-9ed2-0bafad9da43d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:03.787244 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:03.791434 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0121f9-4e38-4c3c-9dbd-4ac130529d32 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:03.797166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-138ef15e-4edb-4c78-9ed2-0bafad9da43d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:03.797166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:03.797166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:03.797166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:03.797166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:03.797166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:03.797166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:03.797166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:03.797166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:03.797166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:03.797166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:03.797166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:03.797166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:57:03.797166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:57:03.797166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:57:03.798138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:57:03.798138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:03.798138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:03.798138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:03.798138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:03.798138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:03.798138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:03.798138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:03.798138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:03.798138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:03.798138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:03.798138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:03.798138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:03.798138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:03.798138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:03.798138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:03.798138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:03.799065 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:57:03.799065 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:57:03.799065 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:57:03.799065 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:57:03.799065 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:57:03.799065 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:57:03.799065 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:03.799065 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:03.801568 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 395/768] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:03.803222 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80e331-462a-4122-ba01-14452f1ad59c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:03.803710 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80e331-462a-4122-ba01-14452f1ad59c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:03.804190 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80e331-462a-4122-ba01-14452f1ad59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:03.823472 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0b80e331-462a-4122-ba01-14452f1ad59c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:03.825697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0b80e331-462a-4122-ba01-14452f1ad59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:03.842450 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6e4ac-4d8e-49cb-a7f8-9341c2d9e969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:03.842450 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6e4ac-4d8e-49cb-a7f8-9341c2d9e969 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:03.842722 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6e4ac-4d8e-49cb-a7f8-9341c2d9e969 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:03.842988 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6e4ac-4d8e-49cb-a7f8-9341c2d9e969 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:03.846903 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6e4ac-4d8e-49cb-a7f8-9341c2d9e969 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:03.846903 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6e4ac-4d8e-49cb-a7f8-9341c2d9e969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:03.846903 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6e4ac-4d8e-49cb-a7f8-9341c2d9e969 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:03.852487 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 374/769] 10.222.0.40 () {56 vars in 1124 bytes} [Tue Aug 9 06:57:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:03.854379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6e4ac-4d8e-49cb-a7f8-9341c2d9e969 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:03.906974 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 396/770] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:03.908197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80e331-462a-4122-ba01-14452f1ad59c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:03.947498 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:03.979991 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6e4ac-4d8e-49cb-a7f8-9341c2d9e969 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:04.019196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80e331-462a-4122-ba01-14452f1ad59c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:04.023791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1ff4e-3800-44ba-92d5-586bd3c40d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:04.024409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1ff4e-3800-44ba-92d5-586bd3c40d66 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:04.024688 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1ff4e-3800-44ba-92d5-586bd3c40d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:04.024962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1ff4e-3800-44ba-92d5-586bd3c40d66 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:04.025648 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1ff4e-3800-44ba-92d5-586bd3c40d66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:04.025952 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1ff4e-3800-44ba-92d5-586bd3c40d66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:04.028209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1ff4e-3800-44ba-92d5-586bd3c40d66 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:04.047170 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 375/771] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:57:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:04.048274 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1ff4e-3800-44ba-92d5-586bd3c40d66 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:04.066795 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8e1fe-28ed-403a-a6eb-d4cb2289add0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:04.068264 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8e1fe-28ed-403a-a6eb-d4cb2289add0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:04.068766 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8e1fe-28ed-403a-a6eb-d4cb2289add0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:04.069192 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8e1fe-28ed-403a-a6eb-d4cb2289add0 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:04.070119 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8e1fe-28ed-403a-a6eb-d4cb2289add0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:04.070564 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8e1fe-28ed-403a-a6eb-d4cb2289add0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:04.072698 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8e1fe-28ed-403a-a6eb-d4cb2289add0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:04.080921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 397/772] 10.222.0.40 () {56 vars in 1124 bytes} [Tue Aug 9 06:57:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:04.081910 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8e1fe-28ed-403a-a6eb-d4cb2289add0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:04.083221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:04.179837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1ff4e-3800-44ba-92d5-586bd3c40d66 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:04.200022 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8e1fe-28ed-403a-a6eb-d4cb2289add0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:04.201631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:04.220368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6a19f-4a23-4681-ab7e-e7a405c5008b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:04.221277 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6a19f-4a23-4681-ab7e-e7a405c5008b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:04.221753 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6a19f-4a23-4681-ab7e-e7a405c5008b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:04.222207 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6a19f-4a23-4681-ab7e-e7a405c5008b None admin] PATH_INFO: `/v3/services/network` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:04.222994 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6a19f-4a23-4681-ab7e-e7a405c5008b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:04.224557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6a19f-4a23-4681-ab7e-e7a405c5008b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:04.234214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-39d6a19f-4a23-4681-ab7e-e7a405c5008b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 06:57:04.234214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:04.234214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:04.234214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:04.234214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:04.234214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:04.234214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:04.234214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:04.234214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 06:57:04.234214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:04.234214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:04.234214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:04.234214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:04.234214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:04.234214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:04.234214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:04.234214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:04.235314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:04.235314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:04.235314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:04.235314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:04.235314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:04.235314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:04.235314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:04.235314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:04.235314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:04.235314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:04.235314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:04.235314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:04.235314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:04.235314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:04.235314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:04.235314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:04.236182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:04.236182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:04.236182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:04.236182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:04.236182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:04.236182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:04.236182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:04.236182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:04.236182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:04.236182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:04.236182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:04.236182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:04.236182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 06:57:04.236182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:04.237942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abaa2b-19e3-4f6b-955a-1594faef29bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:04.238602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abaa2b-19e3-4f6b-955a-1594faef29bf None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:04.238949 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abaa2b-19e3-4f6b-955a-1594faef29bf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:04.239356 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abaa2b-19e3-4f6b-955a-1594faef29bf None admin] PATH_INFO: `/v3/projects/342524b45def418783374ff6733e94b9/users/6e949d9666be44a0b6122d510168c7ab/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:04.239569 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 376/773] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:04 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:04.240521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6a19f-4a23-4681-ab7e-e7a405c5008b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:04.241457 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abaa2b-19e3-4f6b-955a-1594faef29bf None admin] RBAC: Authorizing `identity:create_grant(project_id=342524b45def418783374ff6733e94b9, user_id=6e949d9666be44a0b6122d510168c7ab, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:04.242879 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abaa2b-19e3-4f6b-955a-1594faef29bf None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:04.266493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 398/774] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:57:04 2022] PUT /identity/v3/projects/342524b45def418783374ff6733e94b9/users/6e949d9666be44a0b6122d510168c7ab/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:57:04.267067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abaa2b-19e3-4f6b-955a-1594faef29bf None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:04.344463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:04.360658 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6a19f-4a23-4681-ab7e-e7a405c5008b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:04.399718 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105a5b6-a542-4227-87cb-d750d09c77fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:04.400708 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105a5b6-a542-4227-87cb-d750d09c77fd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:04.401199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105a5b6-a542-4227-87cb-d750d09c77fd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:04.401729 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105a5b6-a542-4227-87cb-d750d09c77fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:04.402742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105a5b6-a542-4227-87cb-d750d09c77fd None admin] RBAC: Adding query filter params (interface=public, service_id=b07b137399e448e6a754a2e7958bbedd, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:04.403326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105a5b6-a542-4227-87cb-d750d09c77fd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:04.404922 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105a5b6-a542-4227-87cb-d750d09c77fd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:04.414068 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 377/775] 10.222.0.40 () {56 vars in 1251 bytes} [Tue Aug 9 06:57:04 2022] GET /identity/v3/endpoints?service_id=b07b137399e448e6a754a2e7958bbedd&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:04.430371 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105a5b6-a542-4227-87cb-d750d09c77fd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:04.443179 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abaa2b-19e3-4f6b-955a-1594faef29bf None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:04.487761 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0118e-7602-4620-93c2-2f70aa11e971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:04.488798 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0118e-7602-4620-93c2-2f70aa11e971 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:04.488798 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0118e-7602-4620-93c2-2f70aa11e971 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:04.489003 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0118e-7602-4620-93c2-2f70aa11e971 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:04.489656 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0118e-7602-4620-93c2-2f70aa11e971 None admin] RBAC: Adding query filter params (name=network) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:04.490333 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0118e-7602-4620-93c2-2f70aa11e971 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:04.491629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0118e-7602-4620-93c2-2f70aa11e971 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:04.499132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 399/776] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Aug 9 06:57:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:04.504844 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0118e-7602-4620-93c2-2f70aa11e971 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:04.554438 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:04.607051 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105a5b6-a542-4227-87cb-d750d09c77fd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:04.649509 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94178c9d-9e84-436c-9507-65f3313f550c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:04.650114 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94178c9d-9e84-436c-9507-65f3313f550c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:04.650386 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94178c9d-9e84-436c-9507-65f3313f550c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:04.650648 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94178c9d-9e84-436c-9507-65f3313f550c None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:04.651381 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94178c9d-9e84-436c-9507-65f3313f550c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:04.652795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94178c9d-9e84-436c-9507-65f3313f550c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:04.658355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 378/777] 10.222.0.40 () {56 vars in 1087 bytes} [Tue Aug 9 06:57:04 2022] GET /identity/v3/services => generated 772 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:04.668651 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0118e-7602-4620-93c2-2f70aa11e971 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:04.707044 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a58ef-9be0-48cb-bb0c-11839032c1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:04.707725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a58ef-9be0-48cb-bb0c-11839032c1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:04.708001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a58ef-9be0-48cb-bb0c-11839032c1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:04.708315 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a58ef-9be0-48cb-bb0c-11839032c1a2 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:04.708958 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a58ef-9be0-48cb-bb0c-11839032c1a2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:04.709256 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a58ef-9be0-48cb-bb0c-11839032c1a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:04.710626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a58ef-9be0-48cb-bb0c-11839032c1a2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:04.717042 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 400/778] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Aug 9 06:57:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:04.722492 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94178c9d-9e84-436c-9507-65f3313f550c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:04.759855 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:04.878282 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94178c9d-9e84-436c-9507-65f3313f550c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:04.914318 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2bc3d-8e60-4674-af67-761f9f521ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:04.915257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2bc3d-8e60-4674-af67-761f9f521ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:04.915735 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2bc3d-8e60-4674-af67-761f9f521ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:04.916194 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2bc3d-8e60-4674-af67-761f9f521ef8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:04.917072 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2bc3d-8e60-4674-af67-761f9f521ef8 None admin] RBAC: Adding query filter params (interface=public, service_id=6b938df7a4da41c2aa7fa39c567afbe5, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:04.918142 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2bc3d-8e60-4674-af67-761f9f521ef8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:04.921215 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2bc3d-8e60-4674-af67-761f9f521ef8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:04.927261 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 379/779] 10.222.0.40 () {56 vars in 1251 bytes} [Tue Aug 9 06:57:04 2022] GET /identity/v3/endpoints?service_id=6b938df7a4da41c2aa7fa39c567afbe5&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:04.932313 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a58ef-9be0-48cb-bb0c-11839032c1a2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:05.056840 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:05.068615 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a58ef-9be0-48cb-bb0c-11839032c1a2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:05.119722 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e84bab-eca2-46e6-a66a-9c3567b5b64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:05.120327 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e84bab-eca2-46e6-a66a-9c3567b5b64f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:05.120713 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e84bab-eca2-46e6-a66a-9c3567b5b64f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:05.121131 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e84bab-eca2-46e6-a66a-9c3567b5b64f None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:05.121895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e84bab-eca2-46e6-a66a-9c3567b5b64f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:05.123263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e84bab-eca2-46e6-a66a-9c3567b5b64f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:05.130193 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 401/780] 10.222.0.40 () {56 vars in 1087 bytes} [Tue Aug 9 06:57:04 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:05.688414 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570672c-52c4-4187-85d1-77bfff74bf05 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:05.689385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570672c-52c4-4187-85d1-77bfff74bf05 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:05.689854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570672c-52c4-4187-85d1-77bfff74bf05 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:05.691679 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 380/781] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:05.697096 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4e4c9-4be3-4b9a-ba29-35d74899d480 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:05.697921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4e4c9-4be3-4b9a-ba29-35d74899d480 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:05.698407 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4e4c9-4be3-4b9a-ba29-35d74899d480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:05.717830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f7f4e4c9-4be3-4b9a-ba29-35d74899d480 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:05.719353 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f7f4e4c9-4be3-4b9a-ba29-35d74899d480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:05.789123 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 402/782] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:05.811288 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570672c-52c4-4187-85d1-77bfff74bf05 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:05.886548 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3b53e-54c5-4b35-8ba0-74ef20374e11 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:05.887178 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3b53e-54c5-4b35-8ba0-74ef20374e11 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:05.887647 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3b53e-54c5-4b35-8ba0-74ef20374e11 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:05.889400 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 403/783] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:05.894424 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae7a8e-ec9d-437f-a1f0-465e20528cfd None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:05.894707 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae7a8e-ec9d-437f-a1f0-465e20528cfd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:05.894981 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae7a8e-ec9d-437f-a1f0-465e20528cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:05.922629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-16ae7a8e-ec9d-437f-a1f0-465e20528cfd None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:05.924225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-16ae7a8e-ec9d-437f-a1f0-465e20528cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:05.942717 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:05.987710 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570672c-52c4-4187-85d1-77bfff74bf05 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:06.006959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 404/784] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:06.029268 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae7a8e-ec9d-437f-a1f0-465e20528cfd None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:06.051048 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:06.053562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f682e2d-64a7-47e3-9220-7f01fd5d5a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:06.054371 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f682e2d-64a7-47e3-9220-7f01fd5d5a97 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:06.054777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f682e2d-64a7-47e3-9220-7f01fd5d5a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:06.055236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f682e2d-64a7-47e3-9220-7f01fd5d5a97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:06.073461 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f682e2d-64a7-47e3-9220-7f01fd5d5a97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:57:06.080281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-5f682e2d-64a7-47e3-9220-7f01fd5d5a97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:57:06.080281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:06.080281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:06.080281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:06.080281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:06.080281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:06.080281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:06.080281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:06.080281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:06.080281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:06.080281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:06.080281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:06.080281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:57:06.080281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:57:06.080281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:57:06.080281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:57:06.081213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:57:06.081213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:57:06.081213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:57:06.081213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:57:06.081213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:06.081213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:06.081213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:06.081213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:06.081213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:06.081213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:06.081213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:06.081213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:06.081213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:06.081213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:06.081213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:06.081213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:06.082061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:06.082061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:06.082061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:06.082061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:06.082061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:57:06.082061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:57:06.082061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:57:06.082061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:57:06.082061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:57:06.082061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:57:06.082061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:57:06.082061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:06.092774 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 381/785] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:57:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:06.098353 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f682e2d-64a7-47e3-9220-7f01fd5d5a97 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:06.205541 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f682e2d-64a7-47e3-9220-7f01fd5d5a97 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:06.241225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8b056-acfe-41a3-9274-eac01f6c50dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:06.241832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8b056-acfe-41a3-9274-eac01f6c50dd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:06.242103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8b056-acfe-41a3-9274-eac01f6c50dd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:06.242367 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8b056-acfe-41a3-9274-eac01f6c50dd None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:06.243017 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8b056-acfe-41a3-9274-eac01f6c50dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:06.243344 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8b056-acfe-41a3-9274-eac01f6c50dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:06.244817 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8b056-acfe-41a3-9274-eac01f6c50dd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:06.254278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 382/786] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:57:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:06.254747 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae7a8e-ec9d-437f-a1f0-465e20528cfd None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:06.259685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8b056-acfe-41a3-9274-eac01f6c50dd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:06.262606 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:06.357564 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd103c-6e82-41cd-8ccd-4639f19da74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:06.358207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd103c-6e82-41cd-8ccd-4639f19da74d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:06.358486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd103c-6e82-41cd-8ccd-4639f19da74d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:06.358758 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd103c-6e82-41cd-8ccd-4639f19da74d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:06.368841 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8b056-acfe-41a3-9274-eac01f6c50dd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:06.403855 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386dfaf-1c3e-46a0-8559-dd77b6aeb8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:06.404489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386dfaf-1c3e-46a0-8559-dd77b6aeb8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:06.404767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386dfaf-1c3e-46a0-8559-dd77b6aeb8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:06.405043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386dfaf-1c3e-46a0-8559-dd77b6aeb8e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:06.411676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd103c-6e82-41cd-8ccd-4639f19da74d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:57:06.415454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386dfaf-1c3e-46a0-8559-dd77b6aeb8e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:06.416408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-2cbd103c-6e82-41cd-8ccd-4639f19da74d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:57:06.416408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:06.416408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:06.416408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:06.416408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:06.416408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:06.416408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:06.416408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:06.416408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:06.416408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:06.416408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:06.416408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:06.416408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:57:06.416408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:57:06.416408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:57:06.416408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:57:06.417312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:57:06.417312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:57:06.417312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:57:06.417312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:57:06.417312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:06.417312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:06.417312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:06.417312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:06.417312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:06.417312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:06.417312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:06.417312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:06.417312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:06.417312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:06.417312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:06.417312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:06.418311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:06.418311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:06.418311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:06.418311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:06.418311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:57:06.418311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:57:06.418311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:57:06.418311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:57:06.418311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:57:06.418311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:57:06.418311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:57:06.418311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:06.418960 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386dfaf-1c3e-46a0-8559-dd77b6aeb8e0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:06.419039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 405/787] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:57:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:06.427987 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd103c-6e82-41cd-8ccd-4639f19da74d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:06.431335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8386dfaf-1c3e-46a0-8559-dd77b6aeb8e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:06.431335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:06.431335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:06.431335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:06.431335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:06.431335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:06.431335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:06.431335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:06.431335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:06.431335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:06.431335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:06.431335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:06.431335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:06.431335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:06.431335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:06.431335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:06.432256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:06.432256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:06.432256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:06.432256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:06.432256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:06.432256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:06.432256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:06.432256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:06.432256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:06.432256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:06.432256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:06.432256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:06.432256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:06.432256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:06.432256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:06.432256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:06.432256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:06.433682 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:06.433682 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:06.433682 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:06.433682 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 383/788] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:06.438747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386dfaf-1c3e-46a0-8559-dd77b6aeb8e0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:06.499502 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:06.543467 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386dfaf-1c3e-46a0-8559-dd77b6aeb8e0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:06.576209 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:06.588890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45714a8f-5c35-4a44-87b0-1dc14f973c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:06.589914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45714a8f-5c35-4a44-87b0-1dc14f973c5e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:06.590422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45714a8f-5c35-4a44-87b0-1dc14f973c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:06.590886 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45714a8f-5c35-4a44-87b0-1dc14f973c5e None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:06.591743 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45714a8f-5c35-4a44-87b0-1dc14f973c5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:06.593429 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45714a8f-5c35-4a44-87b0-1dc14f973c5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:06.594981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45714a8f-5c35-4a44-87b0-1dc14f973c5e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:06.616748 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 384/789] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:06.622821 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45714a8f-5c35-4a44-87b0-1dc14f973c5e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:06.629167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd103c-6e82-41cd-8ccd-4639f19da74d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:06.690447 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13d8bf-a894-4b2c-9552-c40e2ce85abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:06.691494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13d8bf-a894-4b2c-9552-c40e2ce85abd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:06.692072 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13d8bf-a894-4b2c-9552-c40e2ce85abd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:06.692538 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13d8bf-a894-4b2c-9552-c40e2ce85abd None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:06.693456 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13d8bf-a894-4b2c-9552-c40e2ce85abd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:06.693968 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13d8bf-a894-4b2c-9552-c40e2ce85abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:06.695602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13d8bf-a894-4b2c-9552-c40e2ce85abd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:06.705386 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 406/790] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:57:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:06.711803 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13d8bf-a894-4b2c-9552-c40e2ce85abd None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:06.818933 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45714a8f-5c35-4a44-87b0-1dc14f973c5e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:06.847926 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:06.881454 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13d8bf-a894-4b2c-9552-c40e2ce85abd None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:06.884862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740158f-bf96-4565-b648-a60a25a50eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:06.885546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740158f-bf96-4565-b648-a60a25a50eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:06.885825 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740158f-bf96-4565-b648-a60a25a50eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:06.886111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740158f-bf96-4565-b648-a60a25a50eb7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:06.900243 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740158f-bf96-4565-b648-a60a25a50eb7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:06.901679 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740158f-bf96-4565-b648-a60a25a50eb7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:06.918940 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4868d7-88e6-4f86-b68e-732baa3bdecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:06.919738 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4868d7-88e6-4f86-b68e-732baa3bdecf None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:06.920018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4868d7-88e6-4f86-b68e-732baa3bdecf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:06.920293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4868d7-88e6-4f86-b68e-732baa3bdecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:06.923229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:06.925605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f740158f-bf96-4565-b648-a60a25a50eb7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 06:57:06.925605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:06.925605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:06.925605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:06.925605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:06.925605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:06.925605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:06.925605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:06.925605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:06.925605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:06.925605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:06.925605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:06.925605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:57:06.925605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:57:06.925605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:57:06.925605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:57:06.926511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:06.926511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:06.926511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:57:06.926511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:06.926511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:57:06.926511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:06.926511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:06.926511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:06.926511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:06.926511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:06.926511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:06.926511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:06.926511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:06.926511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:06.926511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:06.926511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:06.926511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:06.926511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:06.927478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:06.927478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:06.927478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:57:06.927478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:57:06.927478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:57:06.927478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:57:06.927478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:57:06.927478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:57:06.927478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 06:57:06.927478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:06.927478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 385/791] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Aug 9 06:57:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:06.932997 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740158f-bf96-4565-b648-a60a25a50eb7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:06.943692 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4868d7-88e6-4f86-b68e-732baa3bdecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:06.947398 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4868d7-88e6-4f86-b68e-732baa3bdecf None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:06.976148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3d4868d7-88e6-4f86-b68e-732baa3bdecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:06.976148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:06.976148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:06.976148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:06.976148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:06.976148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:06.976148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:06.976148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:06.976148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:06.976148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:06.976148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:06.976148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:06.976148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:06.976148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:06.976148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:06.976148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:06.978305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:06.978305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:06.978305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:06.978305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:06.978305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:06.978305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:06.978305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:06.978305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:06.978305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:06.978305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:06.978305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:06.978305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:06.978305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:06.978305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:06.978305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:06.978305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:06.978305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:06.980196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:06.980196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:06.980196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:06.980196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 407/792] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:06.986461 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4868d7-88e6-4f86-b68e-732baa3bdecf None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:07.129397 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4868d7-88e6-4f86-b68e-732baa3bdecf None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:07.131654 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740158f-bf96-4565-b648-a60a25a50eb7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:07.165557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546972c-dea0-4117-ac02-b050431cabfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:07.166265 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546972c-dea0-4117-ac02-b050431cabfb None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:07.166605 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546972c-dea0-4117-ac02-b050431cabfb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:07.166937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546972c-dea0-4117-ac02-b050431cabfb None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:07.167698 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546972c-dea0-4117-ac02-b050431cabfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:07.168059 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546972c-dea0-4117-ac02-b050431cabfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:07.169040 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313694b-2755-4190-9d49-23da8572d45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:07.169648 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313694b-2755-4190-9d49-23da8572d45c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:07.169802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546972c-dea0-4117-ac02-b050431cabfb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:07.169946 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313694b-2755-4190-9d49-23da8572d45c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:07.170182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313694b-2755-4190-9d49-23da8572d45c None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:07.170902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313694b-2755-4190-9d49-23da8572d45c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:07.171229 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313694b-2755-4190-9d49-23da8572d45c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:07.172637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313694b-2755-4190-9d49-23da8572d45c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:07.183552 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 408/793] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:07.195108 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41681ee0-88cb-4c36-9e4e-168c9f7b8c56 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:07.195108 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41681ee0-88cb-4c36-9e4e-168c9f7b8c56 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:07.195108 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41681ee0-88cb-4c36-9e4e-168c9f7b8c56 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:07.195108 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 409/794] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:57:07.196183 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41681ee0-88cb-4c36-9e4e-168c9f7b8c56 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:07.198918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 386/795] 10.222.0.40 () {56 vars in 1149 bytes} [Tue Aug 9 06:57:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:07.201099 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd871fd8-7d38-4825-a507-c199c2f0f1b3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:07.201569 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd871fd8-7d38-4825-a507-c199c2f0f1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:07.202016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd871fd8-7d38-4825-a507-c199c2f0f1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:07.221462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fd871fd8-7d38-4825-a507-c199c2f0f1b3 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:07.223073 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fd871fd8-7d38-4825-a507-c199c2f0f1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:07.251772 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:07.257081 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:07.298234 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 387/796] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:07.298964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd871fd8-7d38-4825-a507-c199c2f0f1b3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:07.334240 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41681ee0-88cb-4c36-9e4e-168c9f7b8c56 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:07.371741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fd7ed-ab67-4ced-b267-012fcbca331e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:07.372370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fd7ed-ab67-4ced-b267-012fcbca331e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:07.372644 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fd7ed-ab67-4ced-b267-012fcbca331e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:07.372966 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fd7ed-ab67-4ced-b267-012fcbca331e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:07.380051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5fd7ed-ab67-4ced-b267-012fcbca331e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:07.381403 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5fd7ed-ab67-4ced-b267-012fcbca331e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:07.393197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-0e5fd7ed-ab67-4ced-b267-012fcbca331e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 06:57:07.393197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:07.393197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:07.393197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:07.393197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:07.393197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:07.393197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:07.393197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:07.393197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:07.393197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:07.393197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:07.393197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:07.393197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:57:07.393197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:57:07.393197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:57:07.393197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:57:07.394185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:07.394185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:07.394185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:57:07.394185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:07.394185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:57:07.394185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:07.394185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:07.394185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:07.394185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:07.394185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:07.394185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:07.394185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:07.394185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:07.394185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:07.394185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:07.394185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:07.394185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:07.394185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:07.395196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:07.395196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:07.395196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:57:07.395196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:57:07.395196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:57:07.395196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:57:07.395196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:57:07.395196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:57:07.395196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 06:57:07.395196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:07.395196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 410/797] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:57:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:07.395786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850a7f2-8814-4645-b6cd-0e4e19d730f9 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:07.395786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850a7f2-8814-4645-b6cd-0e4e19d730f9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:07.396543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850a7f2-8814-4645-b6cd-0e4e19d730f9 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:07.397633 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 411/798] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:07.399904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850a7f2-8814-4645-b6cd-0e4e19d730f9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:07.417270 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd871fd8-7d38-4825-a507-c199c2f0f1b3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:07.452045 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b4b34-aefc-4916-a19b-35775e5cbbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:07.452678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b4b34-aefc-4916-a19b-35775e5cbbeb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:07.452960 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b4b34-aefc-4916-a19b-35775e5cbbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:07.453236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b4b34-aefc-4916-a19b-35775e5cbbeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:07.463761 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b4b34-aefc-4916-a19b-35775e5cbbeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:07.466093 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b4b34-aefc-4916-a19b-35775e5cbbeb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:07.480720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-460b4b34-aefc-4916-a19b-35775e5cbbeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:07.480720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:07.480720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:07.480720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:07.480720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:07.480720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:07.480720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:07.480720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:07.480720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:07.480720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:07.480720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:07.480720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:07.480720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:07.480720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:07.480720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:07.480720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:07.481650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:07.481650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:07.481650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:07.481650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:07.481650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:07.481650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:07.481650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:07.481650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:07.481650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:07.481650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:07.481650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:07.481650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:07.481650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:07.481650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:07.481650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:07.481650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:07.481650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:07.482556 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:07.482556 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:07.482556 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:07.482556 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 388/799] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:07.482556 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b4b34-aefc-4916-a19b-35775e5cbbeb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:07.502480 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:07.531330 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850a7f2-8814-4645-b6cd-0e4e19d730f9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:07.541175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:07.567313 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50ee69-3603-45d2-a88a-89b71c26c6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:07.567941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50ee69-3603-45d2-a88a-89b71c26c6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:07.568283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50ee69-3603-45d2-a88a-89b71c26c6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:07.568558 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50ee69-3603-45d2-a88a-89b71c26c6a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:07.580773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50ee69-3603-45d2-a88a-89b71c26c6a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:57:07.586271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-5a50ee69-3603-45d2-a88a-89b71c26c6a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:57:07.586271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:07.586271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:07.586271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:07.586271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:07.586271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:07.586271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:07.586271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:07.586271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:07.586271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:07.586271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:07.586271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:07.586271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:57:07.586271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:57:07.586271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:57:07.586271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:57:07.587246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:57:07.587246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:57:07.587246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:57:07.587246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:57:07.587246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:07.587246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:07.587246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:07.587246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:07.587246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:07.587246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:07.587246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:07.587246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:07.587246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:07.587246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:07.587246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:07.587246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:07.588115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:07.588115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:07.588115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:07.588115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:07.588115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:57:07.588115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:57:07.588115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:57:07.588115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:57:07.588115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:57:07.588115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:57:07.588115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:57:07.588115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:07.592442 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 412/800] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:57:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:07.593655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331ac85-08ec-4748-b373-60d1deceeca6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:07.594042 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331ac85-08ec-4748-b373-60d1deceeca6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:07.594284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331ac85-08ec-4748-b373-60d1deceeca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:07.599013 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b4b34-aefc-4916-a19b-35775e5cbbeb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:07.613818 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d331ac85-08ec-4748-b373-60d1deceeca6 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:07.615005 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d331ac85-08ec-4748-b373-60d1deceeca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:07.642381 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92149f4-df6a-4d1b-a47d-1f0921db1500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:07.642990 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92149f4-df6a-4d1b-a47d-1f0921db1500 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:07.643296 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92149f4-df6a-4d1b-a47d-1f0921db1500 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:07.643787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92149f4-df6a-4d1b-a47d-1f0921db1500 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:07.644281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92149f4-df6a-4d1b-a47d-1f0921db1500 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:07.644583 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92149f4-df6a-4d1b-a47d-1f0921db1500 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:07.646003 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92149f4-df6a-4d1b-a47d-1f0921db1500 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:07.663672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 389/801] 10.222.0.40 () {56 vars in 1135 bytes} [Tue Aug 9 06:57:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:07.668049 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92149f4-df6a-4d1b-a47d-1f0921db1500 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:07.692385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 413/802] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:07.693385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331ac85-08ec-4748-b373-60d1deceeca6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:07.749693 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:07.782118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92149f4-df6a-4d1b-a47d-1f0921db1500 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:07.803403 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:07.808010 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331ac85-08ec-4748-b373-60d1deceeca6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:07.815938 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efff56-53d0-4da7-95cd-217e67ee753e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:07.816533 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efff56-53d0-4da7-95cd-217e67ee753e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:07.816805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efff56-53d0-4da7-95cd-217e67ee753e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:07.817071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efff56-53d0-4da7-95cd-217e67ee753e None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:07.817699 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efff56-53d0-4da7-95cd-217e67ee753e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:07.818018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efff56-53d0-4da7-95cd-217e67ee753e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:07.819360 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efff56-53d0-4da7-95cd-217e67ee753e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:07.831023 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 390/803] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:07.831841 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efff56-53d0-4da7-95cd-217e67ee753e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:07.843005 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3b37a-f66f-4147-bf8e-2cb560a5821c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:07.843632 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3b37a-f66f-4147-bf8e-2cb560a5821c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:07.843911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3b37a-f66f-4147-bf8e-2cb560a5821c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:07.844179 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3b37a-f66f-4147-bf8e-2cb560a5821c None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:07.844835 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3b37a-f66f-4147-bf8e-2cb560a5821c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:07.845131 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3b37a-f66f-4147-bf8e-2cb560a5821c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:07.846479 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3b37a-f66f-4147-bf8e-2cb560a5821c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:07.854352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 414/804] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:57:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:07.855728 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3b37a-f66f-4147-bf8e-2cb560a5821c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:07.929601 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efff56-53d0-4da7-95cd-217e67ee753e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:07.953190 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3b37a-f66f-4147-bf8e-2cb560a5821c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:07.958889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:07.964715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63056454-ccec-4d9e-940b-73a2972f1cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:07.965334 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63056454-ccec-4d9e-940b-73a2972f1cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:07.965603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63056454-ccec-4d9e-940b-73a2972f1cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:07.965865 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63056454-ccec-4d9e-940b-73a2972f1cb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:07.975492 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63056454-ccec-4d9e-940b-73a2972f1cb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:07.976909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63056454-ccec-4d9e-940b-73a2972f1cb2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:07.990282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c920700-15ba-446d-ad63-c84d4402c1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:07.990896 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c920700-15ba-446d-ad63-c84d4402c1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:07.991205 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c920700-15ba-446d-ad63-c84d4402c1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:07.991478 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c920700-15ba-446d-ad63-c84d4402c1e3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:07.991973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-63056454-ccec-4d9e-940b-73a2972f1cb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:07.991973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:07.991973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:07.991973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:07.991973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:07.991973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:07.991973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:07.991973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:07.991973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:07.991973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:07.991973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:07.991973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:07.991973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:07.991973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:07.991973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:07.991973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:07.993014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:07.993014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:07.993014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:07.993014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:07.993014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:07.993014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:07.993014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:07.993014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:07.993014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:07.993014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:07.993014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:07.993014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:07.993014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:07.993014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:07.993014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:07.993014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:07.993014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:07.993910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:07.993910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:07.993910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:07.994085 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c920700-15ba-446d-ad63-c84d4402c1e3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:07.994164 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 391/805] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:07.994232 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c920700-15ba-446d-ad63-c84d4402c1e3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:07.994300 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab2e1-cd9f-457c-8e6c-89d58b5e609d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:07.994828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab2e1-cd9f-457c-8e6c-89d58b5e609d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:07.994828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab2e1-cd9f-457c-8e6c-89d58b5e609d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:07.996651 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 392/806] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:07.997181 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ab2e1-cd9f-457c-8e6c-89d58b5e609d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:08.006358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-7c920700-15ba-446d-ad63-c84d4402c1e3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 06:57:08.006358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:08.006358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:08.006358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:08.006358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:08.006358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:08.006358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:08.006358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:08.006358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 06:57:08.006358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:08.006358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:08.006358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:08.006358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:08.006358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:08.006358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:08.006358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:08.006358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:08.007466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:08.007466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:08.007466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:08.007466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:08.007466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:08.007466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:08.007466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:08.007466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:08.007466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:08.007466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:08.007466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:08.007466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:08.007466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:08.007466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:08.007466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:08.007466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:08.008301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:08.008301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:08.008301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:08.008301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:08.008301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:08.008301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:08.008301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:08.008301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:08.008301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:08.008301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:08.008301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:08.008301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:08.008301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 06:57:08.008301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:08.008301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 415/807] 10.222.0.40 () {56 vars in 1129 bytes} [Tue Aug 9 06:57:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:08.009106 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c920700-15ba-446d-ad63-c84d4402c1e3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:08.033611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:08.102793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ab2e1-cd9f-457c-8e6c-89d58b5e609d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:08.108010 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c920700-15ba-446d-ad63-c84d4402c1e3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:08.135348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf19a64-d965-4943-a799-3bcf3a980c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:08.135965 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf19a64-d965-4943-a799-3bcf3a980c4f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:08.136802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf19a64-d965-4943-a799-3bcf3a980c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:08.137369 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf19a64-d965-4943-a799-3bcf3a980c4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:08.140491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722a875-f17b-4803-8e58-eeade9e7a4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:08.141108 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722a875-f17b-4803-8e58-eeade9e7a4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:08.141387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722a875-f17b-4803-8e58-eeade9e7a4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:08.141661 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722a875-f17b-4803-8e58-eeade9e7a4a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:08.143505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf19a64-d965-4943-a799-3bcf3a980c4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:08.144937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf19a64-d965-4943-a799-3bcf3a980c4f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:08.151855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722a875-f17b-4803-8e58-eeade9e7a4a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:08.153335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722a875-f17b-4803-8e58-eeade9e7a4a8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:08.155812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-baf19a64-d965-4943-a799-3bcf3a980c4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:08.155812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:08.155812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:08.155812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:08.155812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:08.155812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:08.155812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:08.155812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:08.155812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:08.155812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:08.155812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:08.155812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:08.155812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:57:08.155812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:57:08.155812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:57:08.156694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:57:08.156694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:08.156694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:08.156694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:08.156694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:08.156694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:08.156694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:08.156694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:08.156694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:08.156694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:08.156694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:08.156694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:08.156694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:08.156694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:08.156694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:08.156694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:08.156694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:08.157663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:57:08.157663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:57:08.157663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:57:08.157663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:57:08.157663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:57:08.157663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:57:08.157663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:08.157663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:08.157663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 393/808] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:08.157663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf19a64-d965-4943-a799-3bcf3a980c4f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:08.169950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-d722a875-f17b-4803-8e58-eeade9e7a4a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:08.169950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:08.169950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:08.169950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:08.169950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:08.169950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:08.169950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:08.169950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:08.169950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:08.169950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:08.169950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:08.169950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:08.169950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:08.169950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:08.169950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:08.169950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:08.175978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:08.175978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:08.175978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:08.175978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:08.175978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:08.175978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:08.175978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:08.175978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:08.175978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:08.175978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:08.175978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:08.175978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:08.175978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:08.175978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:08.175978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:08.175978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:08.175978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:08.177090 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:08.177090 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:08.177090 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:08.177090 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 416/809] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:08.177090 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b94b97-0bce-45e3-9e4f-10f02aa8dce0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:08.177090 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b94b97-0bce-45e3-9e4f-10f02aa8dce0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:08.177090 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b94b97-0bce-45e3-9e4f-10f02aa8dce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:08.189879 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-24b94b97-0bce-45e3-9e4f-10f02aa8dce0 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:08.190997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-24b94b97-0bce-45e3-9e4f-10f02aa8dce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:08.203603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:08.256796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 417/810] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:08.257578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf19a64-d965-4943-a799-3bcf3a980c4f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:08.257688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b94b97-0bce-45e3-9e4f-10f02aa8dce0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:08.280598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:08.292247 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d80ba9-1716-4f97-8f82-e467a2599b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:08.293394 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d80ba9-1716-4f97-8f82-e467a2599b48 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:08.293630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d80ba9-1716-4f97-8f82-e467a2599b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:08.293902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d80ba9-1716-4f97-8f82-e467a2599b48 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:08.294528 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d80ba9-1716-4f97-8f82-e467a2599b48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:08.294826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d80ba9-1716-4f97-8f82-e467a2599b48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:08.296197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d80ba9-1716-4f97-8f82-e467a2599b48 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:08.307434 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 394/811] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:08.308371 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d80ba9-1716-4f97-8f82-e467a2599b48 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:08.362649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b94b97-0bce-45e3-9e4f-10f02aa8dce0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:08.396902 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ee683-5967-4fa7-9a02-44282f86cace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:08.397665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ee683-5967-4fa7-9a02-44282f86cace None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:08.397944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ee683-5967-4fa7-9a02-44282f86cace None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:08.398217 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ee683-5967-4fa7-9a02-44282f86cace None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:08.398850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ee683-5967-4fa7-9a02-44282f86cace None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:08.399188 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ee683-5967-4fa7-9a02-44282f86cace None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:08.400536 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ee683-5967-4fa7-9a02-44282f86cace None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:08.410067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 418/812] 10.222.0.40 () {56 vars in 1124 bytes} [Tue Aug 9 06:57:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:08.410067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ee683-5967-4fa7-9a02-44282f86cace None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:08.410291 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d80ba9-1716-4f97-8f82-e467a2599b48 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:08.411206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:08.443106 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044947c9-ad67-4d48-91d1-1364a7a9c8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:08.443636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044947c9-ad67-4d48-91d1-1364a7a9c8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:08.443908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044947c9-ad67-4d48-91d1-1364a7a9c8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:08.444172 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044947c9-ad67-4d48-91d1-1364a7a9c8f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:08.444843 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044947c9-ad67-4d48-91d1-1364a7a9c8f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:08.445141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044947c9-ad67-4d48-91d1-1364a7a9c8f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:08.446572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044947c9-ad67-4d48-91d1-1364a7a9c8f4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:08.459201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 395/813] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:57:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:08.460007 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044947c9-ad67-4d48-91d1-1364a7a9c8f4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:08.481204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:08.512682 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ee683-5967-4fa7-9a02-44282f86cace None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:08.547181 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c34ac-cde8-4358-b87f-da3e7895e9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:08.547780 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c34ac-cde8-4358-b87f-da3e7895e9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:08.548058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c34ac-cde8-4358-b87f-da3e7895e9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:08.548326 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c34ac-cde8-4358-b87f-da3e7895e9c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:08.548956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c34ac-cde8-4358-b87f-da3e7895e9c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:08.549274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c34ac-cde8-4358-b87f-da3e7895e9c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:08.550621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c34ac-cde8-4358-b87f-da3e7895e9c0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:08.555808 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044947c9-ad67-4d48-91d1-1364a7a9c8f4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:08.562164 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 419/814] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:08.562946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c34ac-cde8-4358-b87f-da3e7895e9c0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:08.593335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187162c-b586-4ff6-837f-407f8187f0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:08.593951 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187162c-b586-4ff6-837f-407f8187f0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:08.594228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187162c-b586-4ff6-837f-407f8187f0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:08.594493 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187162c-b586-4ff6-837f-407f8187f0c3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:08.595060 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187162c-b586-4ff6-837f-407f8187f0c3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:08.596438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187162c-b586-4ff6-837f-407f8187f0c3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:08.604675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f187162c-b586-4ff6-837f-407f8187f0c3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 06:57:08.604675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:08.604675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:08.604675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:08.604675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:08.604675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:08.604675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:08.604675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:08.604675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 06:57:08.604675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:08.604675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:08.604675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:08.604675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:08.604675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:08.604675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:08.604675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:08.604675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:08.605819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:08.605819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:08.605819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:08.605819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:08.605819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:08.605819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:08.605819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:08.605819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:08.605819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:08.605819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:08.605819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:08.605819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:08.605819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:08.605819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:08.605819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:08.605819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:08.606662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:08.606662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:08.606662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:08.606662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:08.606662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:08.606662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:08.606662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:08.606662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:08.606662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:08.606662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:08.606662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:08.606662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:08.606662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 06:57:08.606662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:08.606662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 396/815] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:08 2022] GET /identity/v3/services/network => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:08.607520 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187162c-b586-4ff6-837f-407f8187f0c3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:08.637951 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:08.666981 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c34ac-cde8-4358-b87f-da3e7895e9c0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:08.694389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:08.701000 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb86e5-1ae5-4e21-a4b3-a3c4a95fb042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:08.701616 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb86e5-1ae5-4e21-a4b3-a3c4a95fb042 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:08.701887 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb86e5-1ae5-4e21-a4b3-a3c4a95fb042 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:08.702157 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb86e5-1ae5-4e21-a4b3-a3c4a95fb042 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:08.707787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187162c-b586-4ff6-837f-407f8187f0c3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:08.708837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb86e5-1ae5-4e21-a4b3-a3c4a95fb042 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:08.710243 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb86e5-1ae5-4e21-a4b3-a3c4a95fb042 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:08.720976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f9fb86e5-1ae5-4e21-a4b3-a3c4a95fb042 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:08.720976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:08.720976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:08.720976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:08.720976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:08.720976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:08.720976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:08.720976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:08.720976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:08.720976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:08.720976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:08.720976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:08.720976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:57:08.720976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:57:08.720976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:57:08.721884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:57:08.721884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:08.721884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:08.721884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:08.721884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:08.721884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:08.721884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:08.721884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:08.721884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:08.721884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:08.721884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:08.721884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:08.721884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:08.721884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:08.721884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:08.721884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:08.721884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:08.722814 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:57:08.722814 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:57:08.722814 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:57:08.722814 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:57:08.722814 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:57:08.722814 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:57:08.722814 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:08.722814 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:08.722814 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 420/816] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:08.722814 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb86e5-1ae5-4e21-a4b3-a3c4a95fb042 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:08.747064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe5b00-7105-4b67-a63a-3e8d66b16198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:08.747696 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe5b00-7105-4b67-a63a-3e8d66b16198 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:08.747973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe5b00-7105-4b67-a63a-3e8d66b16198 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:08.748243 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe5b00-7105-4b67-a63a-3e8d66b16198 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:08.748866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe5b00-7105-4b67-a63a-3e8d66b16198 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:08.749166 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe5b00-7105-4b67-a63a-3e8d66b16198 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:08.750520 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe5b00-7105-4b67-a63a-3e8d66b16198 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:08.755193 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 397/817] 10.222.0.40 () {56 vars in 1124 bytes} [Tue Aug 9 06:57:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:08.755966 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe5b00-7105-4b67-a63a-3e8d66b16198 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:08.826055 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb86e5-1ae5-4e21-a4b3-a3c4a95fb042 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:08.844192 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:08.853004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe5b00-7105-4b67-a63a-3e8d66b16198 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:08.860864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85c2e2-989f-426b-9133-ab2d114df574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:08.861512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85c2e2-989f-426b-9133-ab2d114df574 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:08.861787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85c2e2-989f-426b-9133-ab2d114df574 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:08.862058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85c2e2-989f-426b-9133-ab2d114df574 None admin] PATH_INFO: `/v3/projects/342524b45def418783374ff6733e94b9/users/664e4353726c42c9bfb80b1701d35aae/roles/b93b6b2c6da44593a6b95db1309b8a58` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:08.876828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85c2e2-989f-426b-9133-ab2d114df574 None admin] RBAC: Authorizing `identity:create_grant(project_id=342524b45def418783374ff6733e94b9, user_id=664e4353726c42c9bfb80b1701d35aae, role_id=b93b6b2c6da44593a6b95db1309b8a58)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:08.878261 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85c2e2-989f-426b-9133-ab2d114df574 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:08.886920 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3338e-8f78-42d7-9f52-4f5b15444973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:08.887576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3338e-8f78-42d7-9f52-4f5b15444973 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:08.888032 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3338e-8f78-42d7-9f52-4f5b15444973 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:08.888175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3338e-8f78-42d7-9f52-4f5b15444973 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:08.891675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 421/818] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:57:08 2022] PUT /identity/v3/projects/342524b45def418783374ff6733e94b9/users/664e4353726c42c9bfb80b1701d35aae/roles/b93b6b2c6da44593a6b95db1309b8a58 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:57:08.892457 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85c2e2-989f-426b-9133-ab2d114df574 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:08.896523 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3338e-8f78-42d7-9f52-4f5b15444973 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:08.898004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3338e-8f78-42d7-9f52-4f5b15444973 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:08.910241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d2c3338e-8f78-42d7-9f52-4f5b15444973 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 06:57:08.910241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:08.910241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:08.910241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:08.910241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:08.910241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:08.910241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:08.910241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:08.910241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:08.910241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:08.910241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:08.910241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:08.910241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:57:08.910241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:57:08.910241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:57:08.910241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:57:08.911463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:08.911463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:08.911463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:57:08.911463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:08.911463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:57:08.911463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:08.911463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:08.911463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:08.911463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:08.911463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:08.911463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:08.911463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:08.911463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:08.911463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:08.911463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:08.911463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:08.911463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:08.911463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:08.912448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:08.912448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:08.912448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:57:08.912448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:57:08.912448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:57:08.912448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:57:08.912448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:57:08.912448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:57:08.912448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 06:57:08.912448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:08.915268 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 398/819] 10.222.0.40 () {56 vars in 1093 bytes} [Tue Aug 9 06:57:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:08.916468 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3338e-8f78-42d7-9f52-4f5b15444973 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:08.949607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:09.020057 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85c2e2-989f-426b-9133-ab2d114df574 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:09.035385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3338e-8f78-42d7-9f52-4f5b15444973 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:09.064107 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74d178-2416-4772-a49d-78fa86dc2f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:09.064747 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74d178-2416-4772-a49d-78fa86dc2f11 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:09.065034 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74d178-2416-4772-a49d-78fa86dc2f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:09.065309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74d178-2416-4772-a49d-78fa86dc2f11 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:09.065938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74d178-2416-4772-a49d-78fa86dc2f11 None admin] RBAC: Adding query filter params (name=network) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:09.066324 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74d178-2416-4772-a49d-78fa86dc2f11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:09.067782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74d178-2416-4772-a49d-78fa86dc2f11 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:09.072472 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 422/820] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Aug 9 06:57:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:09.073183 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74d178-2416-4772-a49d-78fa86dc2f11 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:09.079026 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5eec4-61bf-4b48-a2ef-fd7353fea28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:09.079932 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5eec4-61bf-4b48-a2ef-fd7353fea28a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:09.080202 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5eec4-61bf-4b48-a2ef-fd7353fea28a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:09.080467 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5eec4-61bf-4b48-a2ef-fd7353fea28a None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:09.081145 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5eec4-61bf-4b48-a2ef-fd7353fea28a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:09.081442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5eec4-61bf-4b48-a2ef-fd7353fea28a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:09.082849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5eec4-61bf-4b48-a2ef-fd7353fea28a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:09.099943 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 399/821] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:57:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:09.099943 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5eec4-61bf-4b48-a2ef-fd7353fea28a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:09.113734 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:09.180483 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74d178-2416-4772-a49d-78fa86dc2f11 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:09.183732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:09.215782 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5eec4-61bf-4b48-a2ef-fd7353fea28a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:09.219630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29495ced-0dc7-43fa-9910-1df79bc9eafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:09.220242 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29495ced-0dc7-43fa-9910-1df79bc9eafe None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:09.220519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29495ced-0dc7-43fa-9910-1df79bc9eafe None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:09.220790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29495ced-0dc7-43fa-9910-1df79bc9eafe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:09.221447 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29495ced-0dc7-43fa-9910-1df79bc9eafe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:09.222790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29495ced-0dc7-43fa-9910-1df79bc9eafe None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:09.259120 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 423/822] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 06:57:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:57:09.259120 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29495ced-0dc7-43fa-9910-1df79bc9eafe None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:09.270472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19df52f-e0b3-4a11-b682-5b62fef6d5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:09.271330 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19df52f-e0b3-4a11-b682-5b62fef6d5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:09.271760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19df52f-e0b3-4a11-b682-5b62fef6d5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:09.272093 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19df52f-e0b3-4a11-b682-5b62fef6d5b0 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:09.272931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19df52f-e0b3-4a11-b682-5b62fef6d5b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:09.273296 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19df52f-e0b3-4a11-b682-5b62fef6d5b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:09.274830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19df52f-e0b3-4a11-b682-5b62fef6d5b0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:09.295296 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 400/823] 10.222.0.40 () {56 vars in 1133 bytes} [Tue Aug 9 06:57:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:09.296228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19df52f-e0b3-4a11-b682-5b62fef6d5b0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:09.368067 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:09.389166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29495ced-0dc7-43fa-9910-1df79bc9eafe None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:09.408900 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19df52f-e0b3-4a11-b682-5b62fef6d5b0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:09.436139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b4f0e-718f-4dca-85d8-49698b6b54d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:09.437352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b4f0e-718f-4dca-85d8-49698b6b54d1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:09.437839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b4f0e-718f-4dca-85d8-49698b6b54d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:09.438277 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b4f0e-718f-4dca-85d8-49698b6b54d1 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:09.439177 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b4f0e-718f-4dca-85d8-49698b6b54d1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:09.439564 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b4f0e-718f-4dca-85d8-49698b6b54d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:09.441697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b4f0e-718f-4dca-85d8-49698b6b54d1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:09.448343 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b140474-7454-4a74-8ff7-90d912379662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:09.448981 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 424/824] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Aug 9 06:57:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:09.449509 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b140474-7454-4a74-8ff7-90d912379662 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:09.449885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b140474-7454-4a74-8ff7-90d912379662 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:09.449992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b4f0e-718f-4dca-85d8-49698b6b54d1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:09.450338 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b140474-7454-4a74-8ff7-90d912379662 None admin] PATH_INFO: `/v3/projects/342524b45def418783374ff6733e94b9/users/92f19a17424c44eea58efb957246cb48/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:09.452595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b140474-7454-4a74-8ff7-90d912379662 None admin] RBAC: Authorizing `identity:create_grant(project_id=342524b45def418783374ff6733e94b9, user_id=92f19a17424c44eea58efb957246cb48, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:09.454405 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b140474-7454-4a74-8ff7-90d912379662 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:09.472875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 401/825] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:57:09 2022] PUT /identity/v3/projects/342524b45def418783374ff6733e94b9/users/92f19a17424c44eea58efb957246cb48/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:57:09.473720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b140474-7454-4a74-8ff7-90d912379662 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:09.483798 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:09.611611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b4f0e-718f-4dca-85d8-49698b6b54d1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:09.644097 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b140474-7454-4a74-8ff7-90d912379662 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:09.673379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99242196-f990-4015-a9be-f557fc7bd044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:09.674625 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99242196-f990-4015-a9be-f557fc7bd044 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:09.675402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99242196-f990-4015-a9be-f557fc7bd044 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:09.675859 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99242196-f990-4015-a9be-f557fc7bd044 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:09.676608 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:09.692050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbae95-8399-4500-b856-fe9fa57fd248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:09.693207 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbae95-8399-4500-b856-fe9fa57fd248 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:09.693571 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbae95-8399-4500-b856-fe9fa57fd248 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:09.693911 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbae95-8399-4500-b856-fe9fa57fd248 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:09.694634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecbae95-8399-4500-b856-fe9fa57fd248 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:09.696794 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecbae95-8399-4500-b856-fe9fa57fd248 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:09.730925 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 402/826] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 06:57:09 2022] POST /identity/v3/endpoints => generated 337 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:57:09.774114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99242196-f990-4015-a9be-f557fc7bd044 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:09.775574 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99242196-f990-4015-a9be-f557fc7bd044 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:09.806851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:09.896899 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 425/827] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:57:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 06:57:09.898920 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbae95-8399-4500-b856-fe9fa57fd248 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:10.060262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbae95-8399-4500-b856-fe9fa57fd248 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:10.098619 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdb906-4b9e-4137-9b80-8b35e192a0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:10.099527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdb906-4b9e-4137-9b80-8b35e192a0fc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:10.099951 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdb906-4b9e-4137-9b80-8b35e192a0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:10.100364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdb906-4b9e-4137-9b80-8b35e192a0fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:10.112686 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdb906-4b9e-4137-9b80-8b35e192a0fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:10.114127 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdb906-4b9e-4137-9b80-8b35e192a0fc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:10.132789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-35bdb906-4b9e-4137-9b80-8b35e192a0fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:10.132789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:10.132789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:10.132789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:10.132789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:10.132789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:10.132789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:10.132789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:10.132789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:10.132789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:10.132789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:10.132789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:10.132789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:10.132789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:10.132789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:10.132789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:10.133820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:10.133820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:10.133820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:10.133820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:10.133820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:10.133820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:10.133820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:10.133820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:10.133820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:10.133820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:10.133820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:10.133820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:10.133820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:10.133820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:10.133820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:10.133820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:10.133820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:10.135213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:10.135213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:10.135213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:10.135213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 403/828] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:10.140827 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99242196-f990-4015-a9be-f557fc7bd044 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:10.255532 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99242196-f990-4015-a9be-f557fc7bd044 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:10.281965 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:10.294086 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bba1a3-f12a-4b8c-9658-b3a5d02fb1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:10.295155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bba1a3-f12a-4b8c-9658-b3a5d02fb1ce None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:10.295673 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bba1a3-f12a-4b8c-9658-b3a5d02fb1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:10.296149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bba1a3-f12a-4b8c-9658-b3a5d02fb1ce None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:10.296999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bba1a3-f12a-4b8c-9658-b3a5d02fb1ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:10.297505 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bba1a3-f12a-4b8c-9658-b3a5d02fb1ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:10.299056 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bba1a3-f12a-4b8c-9658-b3a5d02fb1ce None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:10.311486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 426/829] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:10.319157 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdb906-4b9e-4137-9b80-8b35e192a0fc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:10.366755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:10.443920 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdb906-4b9e-4137-9b80-8b35e192a0fc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:10.479438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a48f4-1d4d-4d13-87ce-6ce8c167aa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:10.481012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a48f4-1d4d-4d13-87ce-6ce8c167aa79 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:10.481516 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a48f4-1d4d-4d13-87ce-6ce8c167aa79 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:10.481925 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a48f4-1d4d-4d13-87ce-6ce8c167aa79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:10.488791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a48f4-1d4d-4d13-87ce-6ce8c167aa79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:10.490363 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a48f4-1d4d-4d13-87ce-6ce8c167aa79 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:10.502436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-fa5a48f4-1d4d-4d13-87ce-6ce8c167aa79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:10.502436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:10.502436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:10.502436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:10.502436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:10.502436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:10.502436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:10.502436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:10.502436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:10.502436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:10.502436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:10.502436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:10.502436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:57:10.502436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:57:10.502436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:57:10.503622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:57:10.503622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:10.503622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:10.503622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:10.503622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:10.503622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:10.503622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:10.503622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:10.503622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:10.503622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:10.503622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:10.503622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:10.503622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:10.503622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:10.503622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:10.503622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:10.503622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:10.504726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:57:10.504726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:57:10.504726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:57:10.504726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:57:10.504726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:57:10.504726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:57:10.504726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:10.504726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:10.506705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 404/830] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:10.512626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bba1a3-f12a-4b8c-9658-b3a5d02fb1ce None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:10.618490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bba1a3-f12a-4b8c-9658-b3a5d02fb1ce None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:10.664330 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10d82d-822b-4f26-b39c-0305aae7545b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:10.665360 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10d82d-822b-4f26-b39c-0305aae7545b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:10.665867 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10d82d-822b-4f26-b39c-0305aae7545b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:10.666332 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10d82d-822b-4f26-b39c-0305aae7545b None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:10.667457 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10d82d-822b-4f26-b39c-0305aae7545b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:10.667980 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10d82d-822b-4f26-b39c-0305aae7545b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:10.669625 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10d82d-822b-4f26-b39c-0305aae7545b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:10.685113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 427/831] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:57:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:10.691410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a48f4-1d4d-4d13-87ce-6ce8c167aa79 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:10.787693 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:10.798605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a48f4-1d4d-4d13-87ce-6ce8c167aa79 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:10.841307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85a270-db4f-49ce-930f-ab7211f130f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:10.842342 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85a270-db4f-49ce-930f-ab7211f130f9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:10.842816 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85a270-db4f-49ce-930f-ab7211f130f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:10.843362 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85a270-db4f-49ce-930f-ab7211f130f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:10.844278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85a270-db4f-49ce-930f-ab7211f130f9 None admin] RBAC: Adding query filter params (role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.project.id=342524b45def418783374ff6733e94b9, user.id=6e949d9666be44a0b6122d510168c7ab) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:10.844778 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85a270-db4f-49ce-930f-ab7211f130f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:10.846399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85a270-db4f-49ce-930f-ab7211f130f9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:10.853022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 405/832] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:57:10 2022] GET /identity/v3/role_assignments?user.id=6e949d9666be44a0b6122d510168c7ab&scope.project.id=342524b45def418783374ff6733e94b9&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:11.059804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d7998-3ce7-4f7d-a6c1-041959e0ec08 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:11.060795 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d7998-3ce7-4f7d-a6c1-041959e0ec08 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:11.061269 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d7998-3ce7-4f7d-a6c1-041959e0ec08 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:11.062885 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 428/833] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:11.068301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ab5ec-043e-481d-9831-0744d3645d0a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:11.069087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ab5ec-043e-481d-9831-0744d3645d0a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:11.069570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ab5ec-043e-481d-9831-0744d3645d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:11.088858 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-911ab5ec-043e-481d-9831-0744d3645d0a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:11.090406 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-911ab5ec-043e-481d-9831-0744d3645d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:11.162225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 406/834] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:11.185522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d7998-3ce7-4f7d-a6c1-041959e0ec08 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:11.234936 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:11.292934 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d7998-3ce7-4f7d-a6c1-041959e0ec08 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:11.328907 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0597c4-d1fb-4445-af48-03217c138478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:11.329720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0597c4-d1fb-4445-af48-03217c138478 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:11.330023 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0597c4-d1fb-4445-af48-03217c138478 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:11.330301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0597c4-d1fb-4445-af48-03217c138478 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:11.341059 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0597c4-d1fb-4445-af48-03217c138478 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:57:11.345817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-7e0597c4-d1fb-4445-af48-03217c138478 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:57:11.345817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:11.345817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:11.345817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:11.345817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:11.345817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:11.345817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:11.345817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:11.345817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:11.345817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:11.345817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:11.345817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:11.345817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:57:11.345817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:57:11.345817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:57:11.345817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:57:11.346749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:57:11.346749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:57:11.346749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:57:11.346749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:57:11.346749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:11.346749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:11.346749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:11.346749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:11.346749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:11.346749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:11.346749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:11.346749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:11.346749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:11.346749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:11.346749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:11.346749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:11.347634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:11.347634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:11.347634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:11.347634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:11.347634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:57:11.347634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:57:11.347634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:57:11.347634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:57:11.347634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:57:11.347634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:57:11.347634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:57:11.347634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:11.347634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 429/835] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:57:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:11.353629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ab5ec-043e-481d-9831-0744d3645d0a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:11.446400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:11.465907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ab5ec-043e-481d-9831-0744d3645d0a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:11.502644 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65dc12f-f123-427f-bf0a-a711ee4a6d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:11.503559 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dc12f-f123-427f-bf0a-a711ee4a6d3e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:11.503978 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dc12f-f123-427f-bf0a-a711ee4a6d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:11.504385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dc12f-f123-427f-bf0a-a711ee4a6d3e None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:11.505176 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65dc12f-f123-427f-bf0a-a711ee4a6d3e None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:11.505791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65dc12f-f123-427f-bf0a-a711ee4a6d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:11.507307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65dc12f-f123-427f-bf0a-a711ee4a6d3e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:11.516355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 407/836] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:57:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:11.523132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0597c4-d1fb-4445-af48-03217c138478 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:11.612618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8aa9c-2f2c-4c58-82dc-19e16bf58be9 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:11.612938 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8aa9c-2f2c-4c58-82dc-19e16bf58be9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:11.613134 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8aa9c-2f2c-4c58-82dc-19e16bf58be9 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:11.614643 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 408/837] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:57:11.620151 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38187d9b-3383-49c6-8bbf-46cd29e7d5a3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:11.621888 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38187d9b-3383-49c6-8bbf-46cd29e7d5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:11.622723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38187d9b-3383-49c6-8bbf-46cd29e7d5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:11.644341 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-38187d9b-3383-49c6-8bbf-46cd29e7d5a3 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:11.645829 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-38187d9b-3383-49c6-8bbf-46cd29e7d5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:11.650714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0597c4-d1fb-4445-af48-03217c138478 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:11.653812 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:11.695640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8dfc9-2c7b-4081-99a6-f4671f288399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:11.696275 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8dfc9-2c7b-4081-99a6-f4671f288399 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:11.696553 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8dfc9-2c7b-4081-99a6-f4671f288399 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:11.696822 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8dfc9-2c7b-4081-99a6-f4671f288399 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:11.711282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8dfc9-2c7b-4081-99a6-f4671f288399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:11.713130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8dfc9-2c7b-4081-99a6-f4671f288399 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:11.738383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-e7b8dfc9-2c7b-4081-99a6-f4671f288399 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:11.738383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:11.738383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:11.738383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:11.738383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:11.738383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:11.738383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:11.738383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:11.738383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:11.738383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:11.738383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:11.738383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:11.738383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:11.738383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:11.738383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:11.738383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:11.739387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:11.739387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:11.739387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:11.739387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:11.739387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:11.739387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:11.739387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:11.739387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:11.739387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:11.739387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:11.739387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:11.739387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:11.739387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:11.739387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:11.739387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:11.739387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:11.739387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:11.740287 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:11.740287 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:11.740287 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:11.740287 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 430/838] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:11.740518 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 409/839] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:11.742239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8dfc9-2c7b-4081-99a6-f4671f288399 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:11.761933 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38187d9b-3383-49c6-8bbf-46cd29e7d5a3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:11.843498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:11.857380 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8dfc9-2c7b-4081-99a6-f4671f288399 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:11.868541 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38187d9b-3383-49c6-8bbf-46cd29e7d5a3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:11.891590 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a282f-2025-4bee-be72-0e514b385217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:11.892195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a282f-2025-4bee-be72-0e514b385217 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:11.892474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a282f-2025-4bee-be72-0e514b385217 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:11.892747 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a282f-2025-4bee-be72-0e514b385217 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:11.893387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a282f-2025-4bee-be72-0e514b385217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:11.893695 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a282f-2025-4bee-be72-0e514b385217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:11.895047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a282f-2025-4bee-be72-0e514b385217 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:11.906720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 431/840] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:11.907968 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de8f94-7692-4b9d-9202-efdfa163de2a None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:11.908251 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de8f94-7692-4b9d-9202-efdfa163de2a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:11.908519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de8f94-7692-4b9d-9202-efdfa163de2a None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:11.909875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 432/841] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:11.912099 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de8f94-7692-4b9d-9202-efdfa163de2a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:11.913460 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad9d6c-3473-4581-85e8-4f4619a5caf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:11.914503 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad9d6c-3473-4581-85e8-4f4619a5caf7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:11.914779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad9d6c-3473-4581-85e8-4f4619a5caf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:11.915045 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad9d6c-3473-4581-85e8-4f4619a5caf7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:11.915653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad9d6c-3473-4581-85e8-4f4619a5caf7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:11.918660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad9d6c-3473-4581-85e8-4f4619a5caf7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:11.928770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-eaad9d6c-3473-4581-85e8-4f4619a5caf7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 06:57:11.928770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:11.928770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:11.928770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:11.928770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:11.928770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:11.928770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:11.928770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:11.928770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 06:57:11.928770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:11.928770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:11.928770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:11.928770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:11.928770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:11.928770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:11.928770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:11.928770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:11.929866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:11.929866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:11.929866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:11.929866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:11.929866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:11.929866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:11.929866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:11.929866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:11.929866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:11.929866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:11.929866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:11.929866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:11.929866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:11.929866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:11.929866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:11.929866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:11.930752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:11.930752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:11.930752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:11.930752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:11.930752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:11.930752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:11.930752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:11.930752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:11.930752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:11.930752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:11.930752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:11.930752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:11.930752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 06:57:11.930752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:11.930752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 410/842] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:57:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:11.932248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee39b7-ff2e-497c-a152-8ba6e49b204a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:11.932498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee39b7-ff2e-497c-a152-8ba6e49b204a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:11.933020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee39b7-ff2e-497c-a152-8ba6e49b204a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:11.938966 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:11.952211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-12ee39b7-ff2e-497c-a152-8ba6e49b204a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:11.953482 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-12ee39b7-ff2e-497c-a152-8ba6e49b204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:12.027166 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 411/843] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:12.027166 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee39b7-ff2e-497c-a152-8ba6e49b204a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:12.036750 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de8f94-7692-4b9d-9202-efdfa163de2a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:12.075863 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f452e26-3f6c-4107-a9f6-c2c21f5d14bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:12.076502 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f452e26-3f6c-4107-a9f6-c2c21f5d14bc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:12.076763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f452e26-3f6c-4107-a9f6-c2c21f5d14bc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:12.077031 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f452e26-3f6c-4107-a9f6-c2c21f5d14bc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:12.085810 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f452e26-3f6c-4107-a9f6-c2c21f5d14bc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:12.087306 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f452e26-3f6c-4107-a9f6-c2c21f5d14bc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:12.101121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-4f452e26-3f6c-4107-a9f6-c2c21f5d14bc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 06:57:12.101121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:12.101121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:12.101121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:12.101121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:12.101121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:12.101121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:12.101121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:12.101121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:12.101121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:12.101121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:12.101121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:12.101121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:57:12.101121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:57:12.101121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:57:12.101121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:57:12.102189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:12.102189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:12.102189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:57:12.102189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:12.102189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:57:12.102189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:12.102189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:12.102189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:12.102189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:12.102189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:12.102189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:12.102189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:12.102189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:12.102189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:12.102189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:12.102189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:12.102189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:12.102189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:12.103224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:12.103224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:12.103224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:57:12.103224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:57:12.103224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:57:12.103224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:57:12.103224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:57:12.103224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:57:12.103224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 06:57:12.103224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:12.107280 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 433/844] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Aug 9 06:57:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:12.108218 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f452e26-3f6c-4107-a9f6-c2c21f5d14bc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:12.115843 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:12.155034 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee39b7-ff2e-497c-a152-8ba6e49b204a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:12.189812 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:12.193326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb87bd-766f-4f29-ab23-f8895d56be2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:12.193938 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb87bd-766f-4f29-ab23-f8895d56be2c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:12.194219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb87bd-766f-4f29-ab23-f8895d56be2c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:12.194488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb87bd-766f-4f29-ab23-f8895d56be2c None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:12.195213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb87bd-766f-4f29-ab23-f8895d56be2c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:12.195522 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb87bd-766f-4f29-ab23-f8895d56be2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:12.196914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb87bd-766f-4f29-ab23-f8895d56be2c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:12.202423 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 412/845] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:57:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:12.203247 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb87bd-766f-4f29-ab23-f8895d56be2c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:12.222866 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f452e26-3f6c-4107-a9f6-c2c21f5d14bc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:12.259223 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd3173-65ac-4945-8805-79d865eee591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:12.259960 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd3173-65ac-4945-8805-79d865eee591 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:12.260236 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd3173-65ac-4945-8805-79d865eee591 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:12.260504 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd3173-65ac-4945-8805-79d865eee591 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:12.272208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd3173-65ac-4945-8805-79d865eee591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:57:12.278343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-42fd3173-65ac-4945-8805-79d865eee591 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:57:12.278343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:12.278343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:12.278343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:12.278343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:12.278343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:12.278343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:12.278343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:12.278343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:12.278343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:12.278343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:12.278343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:12.278343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:57:12.278343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:57:12.278343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:57:12.278343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:57:12.279339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:57:12.279339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:57:12.279339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:57:12.279339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:57:12.279339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:12.279339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:12.279339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:12.279339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:12.279339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:12.279339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:12.279339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:12.279339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:12.279339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:12.279339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:12.279339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:12.279339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:12.284493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:12.284493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:12.284493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:12.284493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:12.284493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:57:12.284493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:57:12.284493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:57:12.284493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:57:12.284493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:57:12.284493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:57:12.284493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:57:12.284493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:12.284493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 434/846] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:57:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:12.284493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd3173-65ac-4945-8805-79d865eee591 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:12.312319 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb87bd-766f-4f29-ab23-f8895d56be2c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:12.348184 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24df956-4604-4637-8647-d191787c9666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:12.348781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24df956-4604-4637-8647-d191787c9666 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:12.349058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24df956-4604-4637-8647-d191787c9666 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:12.349320 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24df956-4604-4637-8647-d191787c9666 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:12.350032 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24df956-4604-4637-8647-d191787c9666 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:12.350355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24df956-4604-4637-8647-d191787c9666 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:12.351983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24df956-4604-4637-8647-d191787c9666 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:12.353686 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:12.377834 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 413/847] 10.222.0.40 () {56 vars in 1149 bytes} [Tue Aug 9 06:57:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:12.377834 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24df956-4604-4637-8647-d191787c9666 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:12.388124 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd3173-65ac-4945-8805-79d865eee591 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:12.425966 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd684d-1938-48eb-9197-d59f990073c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:12.426490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd684d-1938-48eb-9197-d59f990073c3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:12.426769 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd684d-1938-48eb-9197-d59f990073c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:12.427039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd684d-1938-48eb-9197-d59f990073c3 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:12.427707 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd684d-1938-48eb-9197-d59f990073c3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:12.428008 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd684d-1938-48eb-9197-d59f990073c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:12.429354 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd684d-1938-48eb-9197-d59f990073c3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:12.431467 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:12.434949 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 435/848] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:57:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:12.435855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd684d-1938-48eb-9197-d59f990073c3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:12.492166 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24df956-4604-4637-8647-d191787c9666 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:12.535899 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98189c97-832d-4c37-8e79-30070c3beaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:12.536934 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98189c97-832d-4c37-8e79-30070c3beaff None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:12.537448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98189c97-832d-4c37-8e79-30070c3beaff None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:12.537850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98189c97-832d-4c37-8e79-30070c3beaff None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:12.538676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98189c97-832d-4c37-8e79-30070c3beaff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:12.539142 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98189c97-832d-4c37-8e79-30070c3beaff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:12.540673 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98189c97-832d-4c37-8e79-30070c3beaff None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:12.556086 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd684d-1938-48eb-9197-d59f990073c3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:12.556647 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 414/849] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:57:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:12.558509 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98189c97-832d-4c37-8e79-30070c3beaff None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:12.592057 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7c4ac-a6e8-4984-a2e9-143cae987fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:12.592683 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7c4ac-a6e8-4984-a2e9-143cae987fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:12.592965 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7c4ac-a6e8-4984-a2e9-143cae987fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:12.593237 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7c4ac-a6e8-4984-a2e9-143cae987fd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:12.625757 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:12.671853 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:12.674161 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7c4ac-a6e8-4984-a2e9-143cae987fd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:12.675875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7c4ac-a6e8-4984-a2e9-143cae987fd7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:12.699565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98189c97-832d-4c37-8e79-30070c3beaff None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:12.737650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e6c8a-0c35-490f-9fc9-8648196c1224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:12.738511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e6c8a-0c35-490f-9fc9-8648196c1224 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:12.738650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e6c8a-0c35-490f-9fc9-8648196c1224 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:12.738964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e6c8a-0c35-490f-9fc9-8648196c1224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:12.752442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e6c8a-0c35-490f-9fc9-8648196c1224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:12.753999 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e6c8a-0c35-490f-9fc9-8648196c1224 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:12.770536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8d6e6c8a-0c35-490f-9fc9-8648196c1224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:12.770536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:12.770536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:12.770536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:12.770536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:12.770536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:12.770536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:12.770536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:12.770536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:12.770536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:12.770536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:12.770536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:12.770536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:12.770536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:12.770536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:12.770536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:12.771730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:12.771730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:12.771730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:12.771730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:12.771730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:12.771730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:12.771730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:12.771730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:12.771730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:12.771730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:12.771730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:12.771730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:12.771730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:12.771730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:12.771730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:12.771730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:12.771730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:12.772898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:12.772898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:12.772898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:12.775466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 415/850] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:12.777664 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e6c8a-0c35-490f-9fc9-8648196c1224 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:12.803701 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 436/851] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:57:12 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 06:57:12.810876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7c4ac-a6e8-4984-a2e9-143cae987fd7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:12.889391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e6c8a-0c35-490f-9fc9-8648196c1224 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:12.896516 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:12.921900 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:12.926502 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7c4ac-a6e8-4984-a2e9-143cae987fd7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:12.927391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72a801-88d0-4d7f-95d5-fef4cd867394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:12.928094 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72a801-88d0-4d7f-95d5-fef4cd867394 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:12.928437 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72a801-88d0-4d7f-95d5-fef4cd867394 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:12.928772 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72a801-88d0-4d7f-95d5-fef4cd867394 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:12.929489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72a801-88d0-4d7f-95d5-fef4cd867394 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:12.929868 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72a801-88d0-4d7f-95d5-fef4cd867394 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:12.935267 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72a801-88d0-4d7f-95d5-fef4cd867394 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:12.946327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 416/852] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:12.955098 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72a801-88d0-4d7f-95d5-fef4cd867394 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:12.963786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72346d5c-6715-45af-a317-cf48e2fb0018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:12.965069 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72346d5c-6715-45af-a317-cf48e2fb0018 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:12.965460 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72346d5c-6715-45af-a317-cf48e2fb0018 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:12.965818 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72346d5c-6715-45af-a317-cf48e2fb0018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:12.977028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72346d5c-6715-45af-a317-cf48e2fb0018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:12.978672 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72346d5c-6715-45af-a317-cf48e2fb0018 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:12.995569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-72346d5c-6715-45af-a317-cf48e2fb0018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:12.995569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:12.995569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:12.995569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:12.995569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:12.995569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:12.995569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:12.995569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:12.995569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:12.995569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:12.995569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:12.995569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:12.995569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:12.995569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:12.995569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:12.995569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:12.996830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:12.996830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:12.996830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:12.996830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:12.996830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:12.996830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:12.996830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:12.996830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:12.996830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:12.996830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:12.996830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:12.996830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:12.996830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:12.996830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:12.996830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:12.996830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:12.996830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:12.997918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:12.997918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:12.997918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:12.999023 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 437/853] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:13.009107 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72346d5c-6715-45af-a317-cf48e2fb0018 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:13.070138 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72a801-88d0-4d7f-95d5-fef4cd867394 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:13.107373 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab703c5e-41df-429e-81c1-8bb53d618a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:13.108463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab703c5e-41df-429e-81c1-8bb53d618a2d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:13.109014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab703c5e-41df-429e-81c1-8bb53d618a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:13.109525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab703c5e-41df-429e-81c1-8bb53d618a2d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:13.114104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72346d5c-6715-45af-a317-cf48e2fb0018 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:13.118537 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab703c5e-41df-429e-81c1-8bb53d618a2d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:13.121083 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab703c5e-41df-429e-81c1-8bb53d618a2d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:13.133294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ab703c5e-41df-429e-81c1-8bb53d618a2d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 06:57:13.133294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:13.133294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:13.133294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:13.133294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:13.133294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:13.133294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:13.133294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:13.133294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:13.133294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:13.133294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:13.133294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:13.133294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:57:13.133294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:57:13.133294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:57:13.133294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:57:13.134462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:13.134462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:13.134462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:57:13.134462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:13.134462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:57:13.134462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:13.134462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:13.134462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:13.134462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:13.134462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:13.134462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:13.134462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:13.134462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:13.134462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:13.134462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:13.134462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:13.134462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:13.134462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:13.135660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:13.135660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:13.135660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:57:13.135660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:57:13.135660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:57:13.135660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:57:13.135660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:57:13.135660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:57:13.135660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 06:57:13.135660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:13.138668 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 417/854] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:57:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:13.139944 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727b848-aaf5-4a53-a2ab-8c52b0668cf1 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:13.140228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727b848-aaf5-4a53-a2ab-8c52b0668cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:13.140502 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727b848-aaf5-4a53-a2ab-8c52b0668cf1 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:13.141869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 418/855] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:13.146637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727b848-aaf5-4a53-a2ab-8c52b0668cf1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:13.153703 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3a34b-c6b3-45de-807b-c03ea479a461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:13.154306 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3a34b-c6b3-45de-807b-c03ea479a461 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:13.154579 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3a34b-c6b3-45de-807b-c03ea479a461 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:13.154844 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3a34b-c6b3-45de-807b-c03ea479a461 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:13.155509 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3a34b-c6b3-45de-807b-c03ea479a461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:13.155803 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3a34b-c6b3-45de-807b-c03ea479a461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:13.157186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3a34b-c6b3-45de-807b-c03ea479a461 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:13.169489 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 438/856] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:13.170726 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc71da-c2c1-455e-a76a-30b0a25308be None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:13.171006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc71da-c2c1-455e-a76a-30b0a25308be None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:13.171333 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc71da-c2c1-455e-a76a-30b0a25308be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:13.180005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:13.189521 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b8cc71da-c2c1-455e-a76a-30b0a25308be None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:13.190710 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b8cc71da-c2c1-455e-a76a-30b0a25308be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:13.198058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:13.258212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 439/857] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:13.258928 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc71da-c2c1-455e-a76a-30b0a25308be None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:13.280786 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727b848-aaf5-4a53-a2ab-8c52b0668cf1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:13.318570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813fbe8-25a1-45fd-8e81-e2098d21b1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:13.319298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813fbe8-25a1-45fd-8e81-e2098d21b1dc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:13.319570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813fbe8-25a1-45fd-8e81-e2098d21b1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:13.319833 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813fbe8-25a1-45fd-8e81-e2098d21b1dc None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:13.320539 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813fbe8-25a1-45fd-8e81-e2098d21b1dc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:13.320837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813fbe8-25a1-45fd-8e81-e2098d21b1dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:13.322232 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813fbe8-25a1-45fd-8e81-e2098d21b1dc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:13.341187 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 419/858] 10.222.0.40 () {56 vars in 1135 bytes} [Tue Aug 9 06:57:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:13.341983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813fbe8-25a1-45fd-8e81-e2098d21b1dc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:13.370423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc71da-c2c1-455e-a76a-30b0a25308be None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:13.409767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e751a2c-58e3-4e26-b00b-267c4fcf0132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:13.410557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e751a2c-58e3-4e26-b00b-267c4fcf0132 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:13.410830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e751a2c-58e3-4e26-b00b-267c4fcf0132 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:13.411563 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e751a2c-58e3-4e26-b00b-267c4fcf0132 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:13.419308 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e751a2c-58e3-4e26-b00b-267c4fcf0132 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:13.420731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e751a2c-58e3-4e26-b00b-267c4fcf0132 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:13.429259 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:13.432284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-6e751a2c-58e3-4e26-b00b-267c4fcf0132 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:13.432284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:13.432284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:13.432284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:13.432284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:13.432284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:13.432284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:13.432284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:13.432284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:13.432284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:13.432284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:13.432284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:13.432284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:57:13.432284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:57:13.432284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:57:13.433872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:57:13.433872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:13.433872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:13.433872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:13.433872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:13.433872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:13.433872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:13.433872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:13.433872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:13.433872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:13.433872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:13.433872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:13.433872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:13.433872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:13.433872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:13.433872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:13.433872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:13.434792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:57:13.434792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:57:13.434792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:57:13.434792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:57:13.434792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:57:13.434792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:57:13.434792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:13.434792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:13.434792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 440/859] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:13.434792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e751a2c-58e3-4e26-b00b-267c4fcf0132 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:13.437989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:13.452617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813fbe8-25a1-45fd-8e81-e2098d21b1dc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:13.488015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ffaf9-45ba-4b99-92f2-2bebb4909bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:13.488644 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ffaf9-45ba-4b99-92f2-2bebb4909bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:13.488926 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ffaf9-45ba-4b99-92f2-2bebb4909bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:13.489195 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ffaf9-45ba-4b99-92f2-2bebb4909bc7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:13.489774 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ffaf9-45ba-4b99-92f2-2bebb4909bc7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:13.491146 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ffaf9-45ba-4b99-92f2-2bebb4909bc7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:13.499945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-739ffaf9-45ba-4b99-92f2-2bebb4909bc7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 06:57:13.499945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:13.499945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:13.499945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:13.499945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:13.499945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:13.499945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:13.499945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:13.499945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 06:57:13.499945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:13.499945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:13.499945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:13.499945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:13.499945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:13.499945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:13.499945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:13.500885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:13.500885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:13.500885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:13.500885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:13.500885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:13.500885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:13.500885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:13.500885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:13.500885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:13.500885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:13.500885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:13.500885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:13.500885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:13.500885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:13.500885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:13.500885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:13.500885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:13.501902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:13.501902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:13.501902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:13.501902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:13.501902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:13.501902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:13.501902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:13.501902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:13.501902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:13.501902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:13.501902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:13.501902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:13.501902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 06:57:13.501902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:13.501902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 420/860] 10.222.0.40 () {56 vars in 1132 bytes} [Tue Aug 9 06:57:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:13.502712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ffaf9-45ba-4b99-92f2-2bebb4909bc7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:13.551036 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e751a2c-58e3-4e26-b00b-267c4fcf0132 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:13.590600 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1eedf-4202-42c4-873b-878334b48ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:13.591286 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1eedf-4202-42c4-873b-878334b48ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:13.591558 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1eedf-4202-42c4-873b-878334b48ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:13.591827 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1eedf-4202-42c4-873b-878334b48ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:13.612527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ffaf9-45ba-4b99-92f2-2bebb4909bc7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:13.655952 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90c912-af96-4e81-b42d-b3912416705a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:13.656618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90c912-af96-4e81-b42d-b3912416705a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:13.656898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90c912-af96-4e81-b42d-b3912416705a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:13.657168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90c912-af96-4e81-b42d-b3912416705a None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:13.657899 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90c912-af96-4e81-b42d-b3912416705a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:13.658205 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90c912-af96-4e81-b42d-b3912416705a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:13.659687 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90c912-af96-4e81-b42d-b3912416705a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:13.670402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1eedf-4202-42c4-873b-878334b48ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:13.671924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1eedf-4202-42c4-873b-878334b48ae2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:13.672569 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 421/861] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:57:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:13.673171 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90c912-af96-4e81-b42d-b3912416705a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:13.678773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:13.685328 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:13.780607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 441/862] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:57:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 06:57:13.781447 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1eedf-4202-42c4-873b-878334b48ae2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:13.781969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90c912-af96-4e81-b42d-b3912416705a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:13.819048 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2aa65-c371-4a0d-b400-15f4d62d98d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:13.819655 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2aa65-c371-4a0d-b400-15f4d62d98d0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:13.819935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2aa65-c371-4a0d-b400-15f4d62d98d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:13.820208 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2aa65-c371-4a0d-b400-15f4d62d98d0 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:13.820827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2aa65-c371-4a0d-b400-15f4d62d98d0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:13.821130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2aa65-c371-4a0d-b400-15f4d62d98d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:13.822489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2aa65-c371-4a0d-b400-15f4d62d98d0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:13.832476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 422/863] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Aug 9 06:57:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:13.832476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2aa65-c371-4a0d-b400-15f4d62d98d0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:13.893454 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1eedf-4202-42c4-873b-878334b48ae2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:13.894956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:13.900701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:13.931557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a62e49-6c24-47e6-9584-5f68489ac848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:13.931792 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2aa65-c371-4a0d-b400-15f4d62d98d0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:13.932152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a62e49-6c24-47e6-9584-5f68489ac848 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:13.932422 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a62e49-6c24-47e6-9584-5f68489ac848 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:13.933315 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a62e49-6c24-47e6-9584-5f68489ac848 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:13.934139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a62e49-6c24-47e6-9584-5f68489ac848 None admin] RBAC: Adding query filter params (role.id=b93b6b2c6da44593a6b95db1309b8a58, scope.project.id=342524b45def418783374ff6733e94b9, user.id=664e4353726c42c9bfb80b1701d35aae) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:13.934553 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a62e49-6c24-47e6-9584-5f68489ac848 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:13.935972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a62e49-6c24-47e6-9584-5f68489ac848 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:13.951125 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 442/864] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:57:13 2022] GET /identity/v3/role_assignments?user.id=664e4353726c42c9bfb80b1701d35aae&scope.project.id=342524b45def418783374ff6733e94b9&role.id=b93b6b2c6da44593a6b95db1309b8a58 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:13.951125 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a62e49-6c24-47e6-9584-5f68489ac848 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:13.981450 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a0eea-9acc-48ba-bdc0-3c43bea245e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:13.982249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a0eea-9acc-48ba-bdc0-3c43bea245e6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:13.982605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a0eea-9acc-48ba-bdc0-3c43bea245e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:13.982946 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a0eea-9acc-48ba-bdc0-3c43bea245e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:13.994982 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a0eea-9acc-48ba-bdc0-3c43bea245e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:13.997249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a0eea-9acc-48ba-bdc0-3c43bea245e6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:14.013505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b65a0eea-9acc-48ba-bdc0-3c43bea245e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:14.013505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:14.013505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:14.013505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:14.013505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:14.013505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:14.013505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:14.013505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:14.013505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:14.013505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:14.013505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:14.013505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:14.013505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:14.013505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:14.013505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:14.013505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:14.014562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:14.014562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:14.014562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:14.014562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:14.014562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:14.014562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:14.014562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:14.014562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:14.014562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:14.014562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:14.014562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:14.014562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:14.014562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:14.014562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:14.014562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:14.014562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:14.014562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:14.015536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:14.015536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:14.015536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:14.015536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 423/865] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:14.020847 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a0eea-9acc-48ba-bdc0-3c43bea245e6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:14.081597 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a62e49-6c24-47e6-9584-5f68489ac848 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:14.121121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b0f23-7940-48f6-8c93-96cf70a7d105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:14.122423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b0f23-7940-48f6-8c93-96cf70a7d105 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:14.122959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b0f23-7940-48f6-8c93-96cf70a7d105 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:14.123422 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b0f23-7940-48f6-8c93-96cf70a7d105 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:14.124212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b0f23-7940-48f6-8c93-96cf70a7d105 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:14.124736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b0f23-7940-48f6-8c93-96cf70a7d105 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:14.126097 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b0f23-7940-48f6-8c93-96cf70a7d105 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:14.132400 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 443/866] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Aug 9 06:57:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:14.146897 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a0eea-9acc-48ba-bdc0-3c43bea245e6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:14.176669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:14.190692 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8afd5-e65c-42c8-b37f-24118e0f6531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:14.191401 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8afd5-e65c-42c8-b37f-24118e0f6531 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:14.191680 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8afd5-e65c-42c8-b37f-24118e0f6531 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:14.191950 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8afd5-e65c-42c8-b37f-24118e0f6531 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:14.192624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8afd5-e65c-42c8-b37f-24118e0f6531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:14.192937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8afd5-e65c-42c8-b37f-24118e0f6531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:14.194351 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8afd5-e65c-42c8-b37f-24118e0f6531 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:14.209114 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 424/867] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:14.215001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b0f23-7940-48f6-8c93-96cf70a7d105 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:14.250299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:14.328182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b0f23-7940-48f6-8c93-96cf70a7d105 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:14.367395 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefa256-7808-4d8a-aedb-26b6e9a1bd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:14.367942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefa256-7808-4d8a-aedb-26b6e9a1bd87 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:14.368219 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefa256-7808-4d8a-aedb-26b6e9a1bd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:14.368486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefa256-7808-4d8a-aedb-26b6e9a1bd87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:14.376279 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefa256-7808-4d8a-aedb-26b6e9a1bd87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:14.377704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefa256-7808-4d8a-aedb-26b6e9a1bd87 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:14.389917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-4cefa256-7808-4d8a-aedb-26b6e9a1bd87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:14.389917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:14.389917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:14.389917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:14.389917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:14.389917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:14.389917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:14.389917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:14.389917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:14.389917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:14.389917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:14.389917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:14.389917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:57:14.389917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:57:14.389917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:57:14.390855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:57:14.390855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:14.390855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:14.390855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:14.390855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:14.390855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:14.390855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:14.390855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:14.390855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:14.390855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:14.390855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:14.390855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:14.390855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:14.390855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:14.390855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:14.390855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:14.390855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:14.391788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:57:14.391788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:57:14.391788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:57:14.391788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:57:14.391788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:57:14.391788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:57:14.391788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:14.391788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:14.391788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 444/868] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:14.397250 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8afd5-e65c-42c8-b37f-24118e0f6531 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:14.501091 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40375cf6-a170-4e93-91a7-86af5ba1483b None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:14.501452 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40375cf6-a170-4e93-91a7-86af5ba1483b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:14.501704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40375cf6-a170-4e93-91a7-86af5ba1483b None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:14.503252 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 445/869] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:57:14.508456 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546446b-8ad9-4ae6-b4bd-3610fbedc38c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:14.508972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546446b-8ad9-4ae6-b4bd-3610fbedc38c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:14.509445 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546446b-8ad9-4ae6-b4bd-3610fbedc38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:14.515287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8afd5-e65c-42c8-b37f-24118e0f6531 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:14.534766 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3546446b-8ad9-4ae6-b4bd-3610fbedc38c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:14.536687 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3546446b-8ad9-4ae6-b4bd-3610fbedc38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:14.552499 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ceaa2-82cd-4acc-96d6-63773a66533f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:14.553112 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ceaa2-82cd-4acc-96d6-63773a66533f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:14.553446 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ceaa2-82cd-4acc-96d6-63773a66533f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:14.553843 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ceaa2-82cd-4acc-96d6-63773a66533f None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:14.554565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ceaa2-82cd-4acc-96d6-63773a66533f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:14.554869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ceaa2-82cd-4acc-96d6-63773a66533f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:14.556315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ceaa2-82cd-4acc-96d6-63773a66533f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:14.569433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 425/870] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:57:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:14.576070 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ceaa2-82cd-4acc-96d6-63773a66533f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:14.623474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 446/871] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Aug 09 06:57:14.633332 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:14.646912 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546446b-8ad9-4ae6-b4bd-3610fbedc38c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:14.672438 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:14.708211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ceaa2-82cd-4acc-96d6-63773a66533f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:14.745369 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85745684-60c2-4c0f-89cc-54a99ce20ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:14.746083 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85745684-60c2-4c0f-89cc-54a99ce20ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:14.746357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85745684-60c2-4c0f-89cc-54a99ce20ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:14.746634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85745684-60c2-4c0f-89cc-54a99ce20ac9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:14.747441 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85745684-60c2-4c0f-89cc-54a99ce20ac9 None admin] RBAC: Adding query filter params (role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.project.id=342524b45def418783374ff6733e94b9, user.id=92f19a17424c44eea58efb957246cb48) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:14.747755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85745684-60c2-4c0f-89cc-54a99ce20ac9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:14.749319 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85745684-60c2-4c0f-89cc-54a99ce20ac9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:14.763551 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 426/872] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:57:14 2022] GET /identity/v3/role_assignments?user.id=92f19a17424c44eea58efb957246cb48&scope.project.id=342524b45def418783374ff6733e94b9&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:14.773050 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546446b-8ad9-4ae6-b4bd-3610fbedc38c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:14.813448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c0c34-451e-4860-98cd-ceef1bf7e244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:14.814453 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c0c34-451e-4860-98cd-ceef1bf7e244 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:14.814975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c0c34-451e-4860-98cd-ceef1bf7e244 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:14.815481 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c0c34-451e-4860-98cd-ceef1bf7e244 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:14.816384 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c0c34-451e-4860-98cd-ceef1bf7e244 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:14.817994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c0c34-451e-4860-98cd-ceef1bf7e244 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:14.843308 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 447/873] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Aug 9 06:57:14 2022] POST /identity/v3/services => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 06:57:16.226920 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01761436-ccca-4b92-973a-bbc502b3bd6c None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:16.227977 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01761436-ccca-4b92-973a-bbc502b3bd6c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:16.228454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01761436-ccca-4b92-973a-bbc502b3bd6c None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:16.230843 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 427/874] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:16.236281 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175eed6-2f41-4207-a42f-644b6baad1e9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:16.237089 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175eed6-2f41-4207-a42f-644b6baad1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:16.237559 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175eed6-2f41-4207-a42f-644b6baad1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:16.251271 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae33d35-63fc-42bd-896c-83db595863e2 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:16.251857 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae33d35-63fc-42bd-896c-83db595863e2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:16.252323 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae33d35-63fc-42bd-896c-83db595863e2 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:16.254097 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 428/875] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:57:16.258194 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7175eed6-2f41-4207-a42f-644b6baad1e9 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:16.259186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54b3a6-57dd-4a44-92b7-233e00bc51f6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:16.259474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54b3a6-57dd-4a44-92b7-233e00bc51f6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:16.259745 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54b3a6-57dd-4a44-92b7-233e00bc51f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:16.260266 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7175eed6-2f41-4207-a42f-644b6baad1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:16.280992 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3d54b3a6-57dd-4a44-92b7-233e00bc51f6 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:16.282170 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3d54b3a6-57dd-4a44-92b7-233e00bc51f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:16.351329 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 448/876] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:16 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 06:57:16.360723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 429/877] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:16 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 06:57:16.375767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175eed6-2f41-4207-a42f-644b6baad1e9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:16.384340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:16.385232 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54b3a6-57dd-4a44-92b7-233e00bc51f6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:16.437125 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:16.497260 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175eed6-2f41-4207-a42f-644b6baad1e9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:16.520073 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54b3a6-57dd-4a44-92b7-233e00bc51f6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:16.547632 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193584d0-eb82-414a-9227-a0b90d26cf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:16.549139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193584d0-eb82-414a-9227-a0b90d26cf9d None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:16.549883 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193584d0-eb82-414a-9227-a0b90d26cf9d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:16.550335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193584d0-eb82-414a-9227-a0b90d26cf9d None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:16.551459 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193584d0-eb82-414a-9227-a0b90d26cf9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:16.553694 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193584d0-eb82-414a-9227-a0b90d26cf9d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:16.565233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84d3d7-0467-4838-807e-2496bb7a7ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:16.565973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84d3d7-0467-4838-807e-2496bb7a7ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:16.566315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84d3d7-0467-4838-807e-2496bb7a7ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:16.566715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84d3d7-0467-4838-807e-2496bb7a7ba9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:16.583528 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 449/878] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Aug 9 06:57:16 2022] POST /identity/v3/services => generated 269 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:57:16.586932 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84d3d7-0467-4838-807e-2496bb7a7ba9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:57:16.591970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-eb84d3d7-0467-4838-807e-2496bb7a7ba9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 06:57:16.591970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:16.591970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:16.591970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:16.591970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:16.591970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:16.591970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:16.591970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:16.591970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:16.591970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:16.591970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:16.591970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:16.591970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:57:16.591970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:57:16.591970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:57:16.591970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:57:16.592964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:57:16.592964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:57:16.592964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:57:16.592964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:57:16.592964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:16.592964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:16.592964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:16.592964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:16.592964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:16.592964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:16.592964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:16.592964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:16.592964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:16.592964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:16.592964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:16.592964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:16.593809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:16.593809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:16.593809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:16.593809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:16.593809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:57:16.593809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:57:16.593809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:57:16.593809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:57:16.593809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:57:16.593809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:57:16.593809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 06:57:16.593809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:16.593809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 430/879] 10.222.0.40 () {56 vars in 1120 bytes} [Tue Aug 9 06:57:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:16.601451 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193584d0-eb82-414a-9227-a0b90d26cf9d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:16.685633 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:16.735243 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193584d0-eb82-414a-9227-a0b90d26cf9d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:16.772130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce20d4b-a022-436e-ae55-847f7de6f167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:16.772659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce20d4b-a022-436e-ae55-847f7de6f167 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:16.772937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce20d4b-a022-436e-ae55-847f7de6f167 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:16.773209 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce20d4b-a022-436e-ae55-847f7de6f167 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:16.773871 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce20d4b-a022-436e-ae55-847f7de6f167 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:16.774174 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce20d4b-a022-436e-ae55-847f7de6f167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:16.775586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce20d4b-a022-436e-ae55-847f7de6f167 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:16.786442 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 450/880] 10.222.0.40 () {56 vars in 1115 bytes} [Tue Aug 9 06:57:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:16.792244 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84d3d7-0467-4838-807e-2496bb7a7ba9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:16.884644 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3de08d-89f3-4c7b-b2dd-52d9d08cae1a None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:16.884920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3de08d-89f3-4c7b-b2dd-52d9d08cae1a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:16.885190 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3de08d-89f3-4c7b-b2dd-52d9d08cae1a None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:16.888034 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 451/881] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:57:16.893442 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0687b-9100-4620-9f34-365de2b87b17 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:16.893732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0687b-9100-4620-9f34-365de2b87b17 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:16.894067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0687b-9100-4620-9f34-365de2b87b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:16.904571 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:16.908398 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84d3d7-0467-4838-807e-2496bb7a7ba9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:16.914818 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-63c0687b-9100-4620-9f34-365de2b87b17 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:16.916421 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-63c0687b-9100-4620-9f34-365de2b87b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:16.949140 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ef226-e066-489c-93ff-5ea5beb226da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:16.949775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ef226-e066-489c-93ff-5ea5beb226da None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:16.950049 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ef226-e066-489c-93ff-5ea5beb226da None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:16.950310 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ef226-e066-489c-93ff-5ea5beb226da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:16.961589 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ef226-e066-489c-93ff-5ea5beb226da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:16.963454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ef226-e066-489c-93ff-5ea5beb226da None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:16.978542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-064ef226-e066-489c-93ff-5ea5beb226da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:16.978542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:16.978542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:16.978542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:16.978542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:16.978542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:16.978542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:16.978542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:16.978542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:16.978542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:16.978542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:16.978542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:16.978542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:16.978542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:16.978542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:16.978542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:16.979828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:16.979828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:16.979828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:16.979828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:16.979828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:16.979828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:16.979828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:16.979828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:16.979828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:16.979828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:16.979828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:16.979828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:16.979828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:16.979828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:16.979828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:16.979828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:16.979828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:16.980949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:16.980949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:16.980949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:16.980949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 431/882] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:16.981364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f65e4-4761-48f4-b57d-80cba3d9ff32 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:16.981645 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f65e4-4761-48f4-b57d-80cba3d9ff32 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:16.981912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f65e4-4761-48f4-b57d-80cba3d9ff32 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:16.987247 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 432/883] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:16.987247 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f65e4-4761-48f4-b57d-80cba3d9ff32 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:16.993419 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 452/884] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:16.997053 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf17a8f-59cc-43e8-b10e-bd0317f16247 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:16.998193 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf17a8f-59cc-43e8-b10e-bd0317f16247 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:16.998700 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf17a8f-59cc-43e8-b10e-bd0317f16247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:17.021883 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-abf17a8f-59cc-43e8-b10e-bd0317f16247 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:17.023156 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-abf17a8f-59cc-43e8-b10e-bd0317f16247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:17.074636 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:17.103235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 453/885] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:17.104096 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf17a8f-59cc-43e8-b10e-bd0317f16247 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:17.112940 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f65e4-4761-48f4-b57d-80cba3d9ff32 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:17.151789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cad8d7-5a99-4be9-b4bc-704d5512d97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:17.152390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cad8d7-5a99-4be9-b4bc-704d5512d97b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:17.152664 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cad8d7-5a99-4be9-b4bc-704d5512d97b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:17.152936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cad8d7-5a99-4be9-b4bc-704d5512d97b None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:17.153568 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cad8d7-5a99-4be9-b4bc-704d5512d97b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:17.153866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cad8d7-5a99-4be9-b4bc-704d5512d97b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:17.155265 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cad8d7-5a99-4be9-b4bc-704d5512d97b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:17.172339 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 433/886] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:17.173225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cad8d7-5a99-4be9-b4bc-704d5512d97b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:17.186041 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:17.214203 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf17a8f-59cc-43e8-b10e-bd0317f16247 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:17.251626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e20ba3-b265-451c-ae22-0c9e77674783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:17.252258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e20ba3-b265-451c-ae22-0c9e77674783 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:17.252627 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e20ba3-b265-451c-ae22-0c9e77674783 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:17.252902 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e20ba3-b265-451c-ae22-0c9e77674783 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:17.253477 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e20ba3-b265-451c-ae22-0c9e77674783 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:17.254817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e20ba3-b265-451c-ae22-0c9e77674783 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:17.263732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-61e20ba3-b265-451c-ae22-0c9e77674783 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 06:57:17.263732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:17.263732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:17.263732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:17.263732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:17.263732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:17.263732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:17.263732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:17.263732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 06:57:17.263732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:17.263732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:17.263732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:17.263732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:17.263732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:17.263732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:17.263732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:17.263732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:17.264851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:17.264851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:17.264851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:17.264851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:17.264851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:17.264851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:17.264851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:17.264851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:17.264851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:17.264851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:17.264851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:17.264851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:17.264851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:17.264851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:17.264851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:17.264851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:17.266018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:17.266018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:17.266018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:17.266018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:17.266018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:17.266018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:17.266018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:17.266018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:17.266018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:17.266018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:17.266018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:17.266018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:17.266018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 06:57:17.266018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:17.269992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 454/887] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Aug 9 06:57:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:17.270865 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e20ba3-b265-451c-ae22-0c9e77674783 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:17.280255 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cad8d7-5a99-4be9-b4bc-704d5512d97b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:17.315347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17dc47-5c47-41cc-9def-7b86715d8510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:17.315969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17dc47-5c47-41cc-9def-7b86715d8510 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:17.316240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17dc47-5c47-41cc-9def-7b86715d8510 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:17.316513 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17dc47-5c47-41cc-9def-7b86715d8510 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:17.317080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17dc47-5c47-41cc-9def-7b86715d8510 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:17.318450 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17dc47-5c47-41cc-9def-7b86715d8510 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:17.322713 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:17.328517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-9b17dc47-5c47-41cc-9def-7b86715d8510 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 06:57:17.328517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:17.328517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:17.328517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:17.328517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:17.328517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:17.328517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:17.328517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:17.328517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 06:57:17.328517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:17.328517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:17.328517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:17.328517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:17.328517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:17.328517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:17.328517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:17.328517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:17.329805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:17.329805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:17.329805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:17.329805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:17.329805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:17.329805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:17.329805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:17.329805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:17.329805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:17.329805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:17.329805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:17.329805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:17.329805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:17.329805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:17.329805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:17.329805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:17.332113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:17.332113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:17.332113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:17.332113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:17.332113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:17.332113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:17.332113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:17.332113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:17.332113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:17.332113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:17.332113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:17.332113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:17.332113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 06:57:17.332113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:17.332113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 434/888] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:57:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:17.332920 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17dc47-5c47-41cc-9def-7b86715d8510 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:17.386652 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e20ba3-b265-451c-ae22-0c9e77674783 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:17.412004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:17.424511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181845a4-bc6f-45e0-9892-6eed84f096ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:17.425253 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181845a4-bc6f-45e0-9892-6eed84f096ca None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:17.425541 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181845a4-bc6f-45e0-9892-6eed84f096ca None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:17.425796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181845a4-bc6f-45e0-9892-6eed84f096ca None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:17.434836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181845a4-bc6f-45e0-9892-6eed84f096ca None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:17.436291 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181845a4-bc6f-45e0-9892-6eed84f096ca None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:17.437326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17dc47-5c47-41cc-9def-7b86715d8510 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:17.447947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-181845a4-bc6f-45e0-9892-6eed84f096ca None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 06:57:17.447947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:17.447947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:17.447947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:17.447947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:17.447947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:17.447947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:17.447947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:17.447947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:17.447947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:17.447947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:17.447947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:17.447947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:57:17.447947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:57:17.447947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:57:17.447947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:57:17.449613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:17.449613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:17.449613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:57:17.449613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:17.449613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:57:17.449613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:17.449613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:17.449613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:17.449613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:17.449613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:17.449613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:17.449613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:17.449613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:17.449613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:17.449613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:17.449613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:17.449613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:17.449613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:17.450604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:17.450604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:17.450604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:57:17.450604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:57:17.450604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:57:17.450604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:57:17.450604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:57:17.450604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:57:17.450604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 06:57:17.450604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:17.450604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 455/889] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Aug 9 06:57:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:17.450604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181845a4-bc6f-45e0-9892-6eed84f096ca None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:17.477599 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd4a84-6df8-4a34-81f9-11e4040180d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:17.478202 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd4a84-6df8-4a34-81f9-11e4040180d6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:17.478475 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd4a84-6df8-4a34-81f9-11e4040180d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:17.478741 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd4a84-6df8-4a34-81f9-11e4040180d6 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:17.479390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd4a84-6df8-4a34-81f9-11e4040180d6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:17.479717 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd4a84-6df8-4a34-81f9-11e4040180d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:17.481164 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd4a84-6df8-4a34-81f9-11e4040180d6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:17.485825 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 435/890] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Aug 9 06:57:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:17.486581 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd4a84-6df8-4a34-81f9-11e4040180d6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:17.557274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181845a4-bc6f-45e0-9892-6eed84f096ca None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:17.566920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:17.594685 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e5c4d-2742-49eb-9d3a-a7d77574d3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:17.595324 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5c4d-2742-49eb-9d3a-a7d77574d3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:17.595582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5c4d-2742-49eb-9d3a-a7d77574d3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:17.595847 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5c4d-2742-49eb-9d3a-a7d77574d3d9 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:17.595946 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd4a84-6df8-4a34-81f9-11e4040180d6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:17.596464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e5c4d-2742-49eb-9d3a-a7d77574d3d9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:17.596758 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e5c4d-2742-49eb-9d3a-a7d77574d3d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:17.598627 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e5c4d-2742-49eb-9d3a-a7d77574d3d9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:17.607180 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 456/891] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:57:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:17.607180 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e5c4d-2742-49eb-9d3a-a7d77574d3d9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:17.642839 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5d2e4-f60e-4b87-9ee7-9097259a679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:17.643482 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5d2e4-f60e-4b87-9ee7-9097259a679c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:17.643745 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5d2e4-f60e-4b87-9ee7-9097259a679c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:17.644011 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5d2e4-f60e-4b87-9ee7-9097259a679c None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:17.644713 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5d2e4-f60e-4b87-9ee7-9097259a679c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:17.645016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5d2e4-f60e-4b87-9ee7-9097259a679c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:17.646425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5d2e4-f60e-4b87-9ee7-9097259a679c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:17.655365 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:17.666479 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 436/892] 10.222.0.40 () {56 vars in 1149 bytes} [Tue Aug 9 06:57:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:17.667922 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5d2e4-f60e-4b87-9ee7-9097259a679c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:17.723935 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e5c4d-2742-49eb-9d3a-a7d77574d3d9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:17.758020 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508bb1a-f5c0-4b40-912f-3f0cdc691646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:17.758996 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508bb1a-f5c0-4b40-912f-3f0cdc691646 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:17.759706 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508bb1a-f5c0-4b40-912f-3f0cdc691646 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:17.759985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508bb1a-f5c0-4b40-912f-3f0cdc691646 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:17.760800 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508bb1a-f5c0-4b40-912f-3f0cdc691646 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:17.761107 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508bb1a-f5c0-4b40-912f-3f0cdc691646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:17.762593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508bb1a-f5c0-4b40-912f-3f0cdc691646 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:17.767007 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 457/893] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Aug 9 06:57:17 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:17.767793 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508bb1a-f5c0-4b40-912f-3f0cdc691646 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:17.790488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5d2e4-f60e-4b87-9ee7-9097259a679c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:17.823944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:17.848409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823ded1-0f79-46be-ae74-55053d658c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:17.849315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823ded1-0f79-46be-ae74-55053d658c2e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:17.849659 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823ded1-0f79-46be-ae74-55053d658c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:17.849935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823ded1-0f79-46be-ae74-55053d658c2e None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:17.851168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823ded1-0f79-46be-ae74-55053d658c2e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:17.851488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823ded1-0f79-46be-ae74-55053d658c2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:17.853243 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823ded1-0f79-46be-ae74-55053d658c2e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:17.865278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 437/894] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:57:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:17.869449 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823ded1-0f79-46be-ae74-55053d658c2e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:17.908200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508bb1a-f5c0-4b40-912f-3f0cdc691646 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:17.946944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5dba4-7b9c-4e79-8b53-8d50e8273f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:17.947752 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5dba4-7b9c-4e79-8b53-8d50e8273f30 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:17.948030 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5dba4-7b9c-4e79-8b53-8d50e8273f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:17.950660 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5dba4-7b9c-4e79-8b53-8d50e8273f30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:17.961952 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:18.007738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823ded1-0f79-46be-ae74-55053d658c2e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:18.030057 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5dba4-7b9c-4e79-8b53-8d50e8273f30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:18.031922 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5dba4-7b9c-4e79-8b53-8d50e8273f30 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:18.045452 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36740974-6d83-432b-aa2a-337079619d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:18.046059 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36740974-6d83-432b-aa2a-337079619d24 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:18.046332 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36740974-6d83-432b-aa2a-337079619d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:18.046733 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36740974-6d83-432b-aa2a-337079619d24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:18.047423 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36740974-6d83-432b-aa2a-337079619d24 None admin] RBAC: Adding query filter params (interface=public, service_id=6b745bec9e81482983a4982b72da848f, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:18.047730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36740974-6d83-432b-aa2a-337079619d24 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:18.049189 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36740974-6d83-432b-aa2a-337079619d24 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:18.054847 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 438/895] 10.222.0.40 () {56 vars in 1251 bytes} [Tue Aug 9 06:57:17 2022] GET /identity/v3/endpoints?service_id=6b745bec9e81482983a4982b72da848f&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:18.059903 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36740974-6d83-432b-aa2a-337079619d24 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:18.068926 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:18.156884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 458/896] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:57:17 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 06:57:18.159729 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5dba4-7b9c-4e79-8b53-8d50e8273f30 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:18.197761 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36740974-6d83-432b-aa2a-337079619d24 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:18.227448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:18.241946 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baa761-e5cf-495c-9655-f7e9b40a48ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:18.243061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baa761-e5cf-495c-9655-f7e9b40a48ba None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:18.243584 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baa761-e5cf-495c-9655-f7e9b40a48ba None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:18.244778 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baa761-e5cf-495c-9655-f7e9b40a48ba None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:18.246188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92baa761-e5cf-495c-9655-f7e9b40a48ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:18.247874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92baa761-e5cf-495c-9655-f7e9b40a48ba None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:18.256251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 439/897] 10.222.0.40 () {56 vars in 1087 bytes} [Tue Aug 9 06:57:18 2022] GET /identity/v3/services => generated 1268 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 06:57:18.286630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5dba4-7b9c-4e79-8b53-8d50e8273f30 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:18.331712 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74534e54-aa25-4c17-bb88-9c8b30d24371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:18.332406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74534e54-aa25-4c17-bb88-9c8b30d24371 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:18.332683 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74534e54-aa25-4c17-bb88-9c8b30d24371 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:18.332952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74534e54-aa25-4c17-bb88-9c8b30d24371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:18.336548 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:18.345678 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74534e54-aa25-4c17-bb88-9c8b30d24371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:18.347173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74534e54-aa25-4c17-bb88-9c8b30d24371 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:18.368569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-74534e54-aa25-4c17-bb88-9c8b30d24371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:18.368569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:18.368569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:18.368569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:18.368569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:18.368569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:18.368569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:18.368569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:18.368569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:18.368569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:18.368569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:18.368569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:18.368569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:18.368569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:18.368569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:18.368569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:18.369607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:18.369607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:18.369607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:18.369607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:18.369607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:18.369607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:18.369607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:18.369607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:18.369607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:18.369607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:18.369607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:18.369607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:18.369607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:18.369607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:18.369607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:18.369607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:18.369607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:18.370980 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:18.370980 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:18.370980 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:18.370980 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 459/898] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:18.377297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baa761-e5cf-495c-9655-f7e9b40a48ba None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:18.484502 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baa761-e5cf-495c-9655-f7e9b40a48ba None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:18.518573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62493d36-676c-4c3d-acb1-e37af4034437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:18.519219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62493d36-676c-4c3d-acb1-e37af4034437 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:18.519498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62493d36-676c-4c3d-acb1-e37af4034437 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:18.519773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62493d36-676c-4c3d-acb1-e37af4034437 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:18.520414 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62493d36-676c-4c3d-acb1-e37af4034437 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:18.520715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62493d36-676c-4c3d-acb1-e37af4034437 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:18.522073 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62493d36-676c-4c3d-acb1-e37af4034437 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:18.535206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 440/899] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:18.540986 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74534e54-aa25-4c17-bb88-9c8b30d24371 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:18.644095 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74534e54-aa25-4c17-bb88-9c8b30d24371 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:18.678909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb22ed-bfde-45db-86a7-5fe37f6ed073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:18.679567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb22ed-bfde-45db-86a7-5fe37f6ed073 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:18.679843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb22ed-bfde-45db-86a7-5fe37f6ed073 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:18.680110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb22ed-bfde-45db-86a7-5fe37f6ed073 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:18.686960 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb22ed-bfde-45db-86a7-5fe37f6ed073 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:18.688400 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb22ed-bfde-45db-86a7-5fe37f6ed073 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:18.699999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f2cb22ed-bfde-45db-86a7-5fe37f6ed073 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:18.699999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:18.699999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:18.699999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:18.699999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:18.699999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:18.699999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:18.699999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:18.699999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:18.699999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:18.699999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:18.699999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:18.699999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:57:18.699999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:57:18.699999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:57:18.700868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:57:18.700868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:18.700868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:18.700868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:18.700868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:18.700868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:18.700868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:18.700868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:18.700868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:18.700868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:18.700868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:18.700868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:18.700868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:18.700868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:18.700868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:18.700868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:18.700868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:18.702151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:57:18.702151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:57:18.702151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:57:18.702151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:57:18.702151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:57:18.702151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:57:18.702151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:18.702151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:18.702151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 460/900] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:18.708911 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62493d36-676c-4c3d-acb1-e37af4034437 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:18.757809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3f25c-59e3-4341-9783-b86ffcc41652 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:18.757996 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3f25c-59e3-4341-9783-b86ffcc41652 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:18.758272 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3f25c-59e3-4341-9783-b86ffcc41652 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:18.759894 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 461/901] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:57:18.763326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:18.765849 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30fcc4-aec1-4438-91d8-ac4d1a288de9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:18.766180 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30fcc4-aec1-4438-91d8-ac4d1a288de9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:18.766460 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30fcc4-aec1-4438-91d8-ac4d1a288de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:18.788663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8e30fcc4-aec1-4438-91d8-ac4d1a288de9 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:18.790720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8e30fcc4-aec1-4438-91d8-ac4d1a288de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:18.826182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62493d36-676c-4c3d-acb1-e37af4034437 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:18.838377 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:18.865941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5be66-f679-4c68-807c-14e862d53146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:18.866503 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5be66-f679-4c68-807c-14e862d53146 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:18.866780 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5be66-f679-4c68-807c-14e862d53146 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:18.867050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5be66-f679-4c68-807c-14e862d53146 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:18.867769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5be66-f679-4c68-807c-14e862d53146 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:18.867983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 462/902] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:18.868098 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5be66-f679-4c68-807c-14e862d53146 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:18.869484 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5be66-f679-4c68-807c-14e862d53146 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:18.890837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 441/903] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:57:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:18.893976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30fcc4-aec1-4438-91d8-ac4d1a288de9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:18.902109 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5be66-f679-4c68-807c-14e862d53146 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:19.007100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30fcc4-aec1-4438-91d8-ac4d1a288de9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:19.007911 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5be66-f679-4c68-807c-14e862d53146 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:19.017361 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:19.044354 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190196de-d2ab-49cb-ac3c-7599ffe331ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:19.044765 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02400418-ac18-48d8-bf43-9e41e2f4070a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:19.045015 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190196de-d2ab-49cb-ac3c-7599ffe331ac None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:19.045289 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190196de-d2ab-49cb-ac3c-7599ffe331ac None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:19.045555 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190196de-d2ab-49cb-ac3c-7599ffe331ac None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:19.046005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02400418-ac18-48d8-bf43-9e41e2f4070a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:19.046136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190196de-d2ab-49cb-ac3c-7599ffe331ac None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:19.046545 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02400418-ac18-48d8-bf43-9e41e2f4070a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:19.046957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02400418-ac18-48d8-bf43-9e41e2f4070a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:19.047577 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190196de-d2ab-49cb-ac3c-7599ffe331ac None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:19.047992 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02400418-ac18-48d8-bf43-9e41e2f4070a None admin] RBAC: Adding query filter params (role.id=03e6aa0df3364e0f8f7179debccb832b, scope.project.id=342524b45def418783374ff6733e94b9, user.id=664e4353726c42c9bfb80b1701d35aae) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:19.048456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02400418-ac18-48d8-bf43-9e41e2f4070a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:19.050017 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02400418-ac18-48d8-bf43-9e41e2f4070a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:19.056346 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 442/904] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:57:18 2022] GET /identity/v3/role_assignments?user.id=664e4353726c42c9bfb80b1701d35aae&scope.project.id=342524b45def418783374ff6733e94b9&role.id=03e6aa0df3364e0f8f7179debccb832b => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:19.058629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-190196de-d2ab-49cb-ac3c-7599ffe331ac None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 06:57:19.058629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:19.058629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:19.058629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:19.058629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:19.058629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:19.058629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:19.058629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:19.058629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 06:57:19.058629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:19.058629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:19.058629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:19.058629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:19.058629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:19.058629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:19.058629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:19.059788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:19.059788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:19.059788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:19.059788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:19.059788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:19.059788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:19.059788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:19.059788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:19.059788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:19.059788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:19.059788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:19.059788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:19.059788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:19.059788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:19.059788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:19.059788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:19.059788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:19.060681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:19.060681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:19.060681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:19.060681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:19.060681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:19.060681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:19.060681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:19.060681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:19.060681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:19.060681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:19.060681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:19.060681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:19.060681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 06:57:19.060681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:19.063046 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 463/905] 10.222.0.40 () {56 vars in 1132 bytes} [Tue Aug 9 06:57:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:19.069315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02400418-ac18-48d8-bf43-9e41e2f4070a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:19.183769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02400418-ac18-48d8-bf43-9e41e2f4070a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:19.221539 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc86ed-5f3d-4b91-8da0-7bbacfaa12fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:19.222152 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc86ed-5f3d-4b91-8da0-7bbacfaa12fe None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:19.222427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc86ed-5f3d-4b91-8da0-7bbacfaa12fe None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:19.222696 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc86ed-5f3d-4b91-8da0-7bbacfaa12fe None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:19.223344 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc86ed-5f3d-4b91-8da0-7bbacfaa12fe None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:19.223676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc86ed-5f3d-4b91-8da0-7bbacfaa12fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:19.224998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc86ed-5f3d-4b91-8da0-7bbacfaa12fe None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:19.230359 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 443/906] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Aug 9 06:57:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:19.235977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190196de-d2ab-49cb-ac3c-7599ffe331ac None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:19.282283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:19.339769 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190196de-d2ab-49cb-ac3c-7599ffe331ac None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:19.373802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ecc6f-4439-429b-8a7a-b006707e68f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:19.374404 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ecc6f-4439-429b-8a7a-b006707e68f1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:19.374682 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ecc6f-4439-429b-8a7a-b006707e68f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:19.374954 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ecc6f-4439-429b-8a7a-b006707e68f1 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:19.375688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ecc6f-4439-429b-8a7a-b006707e68f1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:19.375990 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ecc6f-4439-429b-8a7a-b006707e68f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:19.377389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ecc6f-4439-429b-8a7a-b006707e68f1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:19.382673 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 464/907] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Aug 9 06:57:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:19.389283 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc86ed-5f3d-4b91-8da0-7bbacfaa12fe None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:19.427044 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:19.497589 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc86ed-5f3d-4b91-8da0-7bbacfaa12fe None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:19.534374 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb98af3-61a3-41f8-acd2-1f9d196859b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:19.534904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb98af3-61a3-41f8-acd2-1f9d196859b7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:19.535208 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb98af3-61a3-41f8-acd2-1f9d196859b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:19.535478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb98af3-61a3-41f8-acd2-1f9d196859b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:19.536168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb98af3-61a3-41f8-acd2-1f9d196859b7 None admin] RBAC: Adding query filter params (interface=public, service_id=8e40c8a7d34b484da5375e6afb9211c4, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:19.536472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb98af3-61a3-41f8-acd2-1f9d196859b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:19.537828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb98af3-61a3-41f8-acd2-1f9d196859b7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:19.544296 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 444/908] 10.222.0.40 () {56 vars in 1251 bytes} [Tue Aug 9 06:57:19 2022] GET /identity/v3/endpoints?service_id=8e40c8a7d34b484da5375e6afb9211c4&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:19.549837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ecc6f-4439-429b-8a7a-b006707e68f1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:19.652630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ecc6f-4439-429b-8a7a-b006707e68f1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:19.659805 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:19.691613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b94b5-3c74-41c6-a2de-a007a6edca4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:19.692207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b94b5-3c74-41c6-a2de-a007a6edca4d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:19.692479 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b94b5-3c74-41c6-a2de-a007a6edca4d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:19.692746 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b94b5-3c74-41c6-a2de-a007a6edca4d None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:19.693343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b94b5-3c74-41c6-a2de-a007a6edca4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:19.694670 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b94b5-3c74-41c6-a2de-a007a6edca4d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:19.700853 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 465/909] 10.222.0.40 () {56 vars in 1087 bytes} [Tue Aug 9 06:57:19 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 06:57:19.908475 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341a792-88be-440d-910d-efe12a1b3d44 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:19.909153 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341a792-88be-440d-910d-efe12a1b3d44 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:19.909655 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341a792-88be-440d-910d-efe12a1b3d44 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:19.911457 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 445/910] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:19.916793 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833507d-3b65-47d6-b697-a9419f59e747 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:19.917373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833507d-3b65-47d6-b697-a9419f59e747 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:19.917854 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833507d-3b65-47d6-b697-a9419f59e747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:19.936726 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b833507d-3b65-47d6-b697-a9419f59e747 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:19.938244 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b833507d-3b65-47d6-b697-a9419f59e747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:20.012743 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 466/911] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:20.035502 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341a792-88be-440d-910d-efe12a1b3d44 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:20.137231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:20.141927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341a792-88be-440d-910d-efe12a1b3d44 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:20.177552 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9c043-2a56-44ec-bf8a-0f6ea20d7a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:20.178081 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9c043-2a56-44ec-bf8a-0f6ea20d7a22 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:20.178354 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9c043-2a56-44ec-bf8a-0f6ea20d7a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:20.178620 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9c043-2a56-44ec-bf8a-0f6ea20d7a22 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:20.179289 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9c043-2a56-44ec-bf8a-0f6ea20d7a22 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:20.180649 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9c043-2a56-44ec-bf8a-0f6ea20d7a22 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:20.200105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 446/912] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Aug 9 06:57:20 2022] POST /identity/v3/services => generated 241 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:57:20.465631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1da21-385c-4137-910b-680045cc9cc8 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:20.466143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1da21-385c-4137-910b-680045cc9cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:20.466143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1da21-385c-4137-910b-680045cc9cc8 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:20.467775 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 467/913] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:20.473115 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190c5be-351e-43dc-a72f-041504692428 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:20.473531 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190c5be-351e-43dc-a72f-041504692428 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:20.473673 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190c5be-351e-43dc-a72f-041504692428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:20.492049 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8190c5be-351e-43dc-a72f-041504692428 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:20.493216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8190c5be-351e-43dc-a72f-041504692428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:20.571449 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 447/914] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:20.594589 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1da21-385c-4137-910b-680045cc9cc8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:20.696586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:20.701821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1da21-385c-4137-910b-680045cc9cc8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:20.737510 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7c35b-88c2-47e8-9f2c-66ceb14e063f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:20.738058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7c35b-88c2-47e8-9f2c-66ceb14e063f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:20.738333 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7c35b-88c2-47e8-9f2c-66ceb14e063f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:20.738649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7c35b-88c2-47e8-9f2c-66ceb14e063f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:20.739258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7c35b-88c2-47e8-9f2c-66ceb14e063f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:20.740602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7c35b-88c2-47e8-9f2c-66ceb14e063f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:20.750039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-a4f7c35b-88c2-47e8-9f2c-66ceb14e063f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 06:57:20.750039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:20.750039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:20.750039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:20.750039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:20.750039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:20.750039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:20.750039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:20.750039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 06:57:20.750039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:20.750039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:20.750039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:20.750039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:20.750039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:20.750039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:20.750039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:20.750039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:20.751052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:20.751052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:20.751052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:20.751052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:20.751052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:20.751052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:20.751052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:20.751052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:20.751052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:20.751052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:20.751052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:20.751052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:20.751052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:20.751052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:20.751052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:20.751052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:20.751943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:20.751943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:20.751943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:20.751943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:20.751943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:20.751943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:20.751943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:20.751943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:20.751943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:20.751943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:20.751943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:20.751943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:20.751943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 06:57:20.751943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:20.755204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 468/915] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:57:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:20.757493 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190c5be-351e-43dc-a72f-041504692428 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:20.847492 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:20.858561 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190c5be-351e-43dc-a72f-041504692428 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:20.897936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d46eca-0959-4f64-89d6-707da21daa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:20.898800 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d46eca-0959-4f64-89d6-707da21daa40 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:20.899311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d46eca-0959-4f64-89d6-707da21daa40 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:20.899730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d46eca-0959-4f64-89d6-707da21daa40 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:20.900504 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d46eca-0959-4f64-89d6-707da21daa40 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:20.900954 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d46eca-0959-4f64-89d6-707da21daa40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:20.902953 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d46eca-0959-4f64-89d6-707da21daa40 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:20.908473 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 448/916] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:57:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:20.916504 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7c35b-88c2-47e8-9f2c-66ceb14e063f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:21.016819 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7c35b-88c2-47e8-9f2c-66ceb14e063f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:21.050092 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78025661-c011-47c0-a6d5-e40d4bd67d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:21.050691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78025661-c011-47c0-a6d5-e40d4bd67d4b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:21.050963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78025661-c011-47c0-a6d5-e40d4bd67d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:21.051273 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78025661-c011-47c0-a6d5-e40d4bd67d4b None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:21.051890 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78025661-c011-47c0-a6d5-e40d4bd67d4b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:21.052186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78025661-c011-47c0-a6d5-e40d4bd67d4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:21.053523 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78025661-c011-47c0-a6d5-e40d4bd67d4b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:21.063284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 469/917] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Aug 9 06:57:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:21.064617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d46eca-0959-4f64-89d6-707da21daa40 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:21.166600 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d46eca-0959-4f64-89d6-707da21daa40 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:21.201637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5dcab7-1b75-4cd6-bbe8-a3589cb39b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:21.202236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5dcab7-1b75-4cd6-bbe8-a3589cb39b93 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:21.202511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5dcab7-1b75-4cd6-bbe8-a3589cb39b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:21.202822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5dcab7-1b75-4cd6-bbe8-a3589cb39b93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:21.203522 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5dcab7-1b75-4cd6-bbe8-a3589cb39b93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:21.205132 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5dcab7-1b75-4cd6-bbe8-a3589cb39b93 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:21.230298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 449/918] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 06:57:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 06:57:21.278425 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6db5be-890d-432a-bfe8-9621f11fdde4 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:21.278625 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6db5be-890d-432a-bfe8-9621f11fdde4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:21.279059 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6db5be-890d-432a-bfe8-9621f11fdde4 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:21.280949 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 470/919] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:21.286477 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83c10d-99dc-46e6-840f-c340efa59e98 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:21.286764 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83c10d-99dc-46e6-840f-c340efa59e98 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:21.287242 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83c10d-99dc-46e6-840f-c340efa59e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:21.301671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:21.311108 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3f83c10d-99dc-46e6-840f-c340efa59e98 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:21.312672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3f83c10d-99dc-46e6-840f-c340efa59e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:21.399239 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 450/920] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:21.422350 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6db5be-890d-432a-bfe8-9621f11fdde4 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:21.453031 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:21.534117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6db5be-890d-432a-bfe8-9621f11fdde4 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:21.568433 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bc192-48e6-439b-b225-9a84e198fa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:21.569104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bc192-48e6-439b-b225-9a84e198fa34 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:21.569385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bc192-48e6-439b-b225-9a84e198fa34 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:21.569651 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bc192-48e6-439b-b225-9a84e198fa34 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:21.581244 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bc192-48e6-439b-b225-9a84e198fa34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:57:21.585953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-b19bc192-48e6-439b-b225-9a84e198fa34 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 06:57:21.585953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:21.585953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:21.585953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:21.585953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:21.585953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:21.585953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:21.585953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:21.585953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:21.585953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:21.585953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:21.585953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:21.585953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:57:21.585953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:57:21.585953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:57:21.585953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:57:21.586983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:57:21.586983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:57:21.586983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:57:21.586983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:57:21.586983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:21.586983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:21.586983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:21.586983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:21.586983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:21.586983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:21.586983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:21.586983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:21.586983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:21.586983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:21.586983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:21.586983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:21.587952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:21.587952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:21.587952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:21.587952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:21.587952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:57:21.587952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:57:21.587952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:57:21.587952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:57:21.587952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:57:21.587952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:57:21.587952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 06:57:21.587952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:21.587952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 471/921] 10.222.0.40 () {56 vars in 1120 bytes} [Tue Aug 9 06:57:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:21.593775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83c10d-99dc-46e6-840f-c340efa59e98 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:21.700584 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83c10d-99dc-46e6-840f-c340efa59e98 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:21.735050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:21.742392 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a7a4e-ba6c-407e-8388-5248405d1ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:21.743320 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a7a4e-ba6c-407e-8388-5248405d1ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:21.743817 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a7a4e-ba6c-407e-8388-5248405d1ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:21.744319 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a7a4e-ba6c-407e-8388-5248405d1ba9 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:21.745959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a7a4e-ba6c-407e-8388-5248405d1ba9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:21.746510 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a7a4e-ba6c-407e-8388-5248405d1ba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:21.748179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a7a4e-ba6c-407e-8388-5248405d1ba9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:21.757432 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 451/922] 10.222.0.40 () {56 vars in 1115 bytes} [Tue Aug 9 06:57:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:21.765272 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bc192-48e6-439b-b225-9a84e198fa34 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:21.787571 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8ff2a-fc6d-4d39-8611-80ae15584492 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:21.787767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8ff2a-fc6d-4d39-8611-80ae15584492 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:21.788073 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8ff2a-fc6d-4d39-8611-80ae15584492 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:21.789598 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 452/923] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:21.795109 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b693dd0-4628-4fd0-a6d0-05349cf14112 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:21.795409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b693dd0-4628-4fd0-a6d0-05349cf14112 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:21.795682 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b693dd0-4628-4fd0-a6d0-05349cf14112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:21.820636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2b693dd0-4628-4fd0-a6d0-05349cf14112 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:21.821823 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2b693dd0-4628-4fd0-a6d0-05349cf14112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:21.859311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:21.873852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bc192-48e6-439b-b225-9a84e198fa34 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:21.909742 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98437cbe-6c06-424f-b1ab-0da0bcd79335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:21.910366 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98437cbe-6c06-424f-b1ab-0da0bcd79335 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:21.910644 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98437cbe-6c06-424f-b1ab-0da0bcd79335 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:21.910955 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98437cbe-6c06-424f-b1ab-0da0bcd79335 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:21.918128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 453/924] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 06:57:21.928565 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98437cbe-6c06-424f-b1ab-0da0bcd79335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:21.930315 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98437cbe-6c06-424f-b1ab-0da0bcd79335 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:21.938749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b693dd0-4628-4fd0-a6d0-05349cf14112 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:21.952130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-98437cbe-6c06-424f-b1ab-0da0bcd79335 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:21.952130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:21.952130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:21.952130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:21.952130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:21.952130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:21.952130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:21.952130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:21.952130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:21.952130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:21.952130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:21.952130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:21.952130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:21.952130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:21.952130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:21.952130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:21.953153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:21.953153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:21.953153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:21.953153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:21.953153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:21.953153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:21.953153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:21.953153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:21.953153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:21.953153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:21.953153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:21.953153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:21.953153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:21.953153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:21.953153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:21.953153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:21.953153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:21.954068 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:21.954068 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:21.954068 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:21.954068 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 472/925] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:21.958886 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98437cbe-6c06-424f-b1ab-0da0bcd79335 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:22.048151 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b693dd0-4628-4fd0-a6d0-05349cf14112 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:22.069038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98437cbe-6c06-424f-b1ab-0da0bcd79335 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:22.074729 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:22.086240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a09d3-0c30-4e08-8691-31bb63d87e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:22.087123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a09d3-0c30-4e08-8691-31bb63d87e74 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:22.087625 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a09d3-0c30-4e08-8691-31bb63d87e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:22.088142 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a09d3-0c30-4e08-8691-31bb63d87e74 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:22.089478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a09d3-0c30-4e08-8691-31bb63d87e74 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:22.091240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a09d3-0c30-4e08-8691-31bb63d87e74 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:22.100705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-eb9a09d3-0c30-4e08-8691-31bb63d87e74 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 06:57:22.100705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:22.100705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:22.100705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:22.100705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:22.100705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:22.100705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:22.100705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:22.100705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 06:57:22.100705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:22.100705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:22.100705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:22.100705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:22.100705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:22.100705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:22.100705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:22.101671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:22.101671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:22.101671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:22.101671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:22.101671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:22.101671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:22.101671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:22.101671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:22.101671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:22.101671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:22.101671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:22.101671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:22.101671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:22.101671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:22.101671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:22.101671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:22.101671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:22.102585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:22.102585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:22.102585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:22.102585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:22.102585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:22.102585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:22.102585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:22.102585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:22.102585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:22.102585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:22.102585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:22.102585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:22.102585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 06:57:22.102585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:22.105406 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 454/926] 10.222.0.40 () {56 vars in 1132 bytes} [Tue Aug 9 06:57:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:22.108713 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c9b06-1421-493a-9fb7-8df79b573584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:22.109585 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c9b06-1421-493a-9fb7-8df79b573584 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:22.110141 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c9b06-1421-493a-9fb7-8df79b573584 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:22.110416 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c9b06-1421-493a-9fb7-8df79b573584 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:22.111060 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c9b06-1421-493a-9fb7-8df79b573584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:22.111406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c9b06-1421-493a-9fb7-8df79b573584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:22.112755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c9b06-1421-493a-9fb7-8df79b573584 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:22.116040 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a09d3-0c30-4e08-8691-31bb63d87e74 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:22.122589 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:22.130905 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 473/927] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:22.131815 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c9b06-1421-493a-9fb7-8df79b573584 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:22.239239 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a09d3-0c30-4e08-8691-31bb63d87e74 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:22.251509 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c9b06-1421-493a-9fb7-8df79b573584 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:22.285843 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2f110-1853-4209-bd6f-5f5072148553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:22.286816 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2f110-1853-4209-bd6f-5f5072148553 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:22.287361 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2f110-1853-4209-bd6f-5f5072148553 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:22.287821 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2f110-1853-4209-bd6f-5f5072148553 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:22.288654 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2f110-1853-4209-bd6f-5f5072148553 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:22.288769 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b22297-f930-4471-8c20-210749f55fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:22.289275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2f110-1853-4209-bd6f-5f5072148553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:22.289390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b22297-f930-4471-8c20-210749f55fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:22.289598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b22297-f930-4471-8c20-210749f55fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:22.289872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b22297-f930-4471-8c20-210749f55fd1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:22.291381 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2f110-1853-4209-bd6f-5f5072148553 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:22.297871 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b22297-f930-4471-8c20-210749f55fd1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:22.303040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b22297-f930-4471-8c20-210749f55fd1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:22.303753 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 455/928] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Aug 9 06:57:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:22.305347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2f110-1853-4209-bd6f-5f5072148553 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:22.313924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-d5b22297-f930-4471-8c20-210749f55fd1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 06:57:22.313924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:22.313924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:22.313924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:22.313924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:22.313924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:22.313924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:22.313924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:22.313924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:22.313924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:22.313924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:22.313924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:22.313924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:57:22.313924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:57:22.313924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:57:22.313924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:57:22.314927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:22.314927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:22.314927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:57:22.314927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:22.314927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:57:22.314927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:22.314927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:22.314927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:22.314927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:22.314927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:22.314927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:22.314927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:22.314927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:22.314927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:22.314927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:22.314927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:22.314927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:22.314927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:22.316211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:22.316211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:22.316211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:57:22.316211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:57:22.316211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:57:22.316211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:57:22.316211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:57:22.316211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:57:22.316211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 06:57:22.316211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:22.316211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 474/929] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Aug 9 06:57:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:22.321093 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca0bc1-7de6-4542-849a-7462709e10b0 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:22.321374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca0bc1-7de6-4542-849a-7462709e10b0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:22.321645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca0bc1-7de6-4542-849a-7462709e10b0 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:22.324565 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 475/930] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:22.324565 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca0bc1-7de6-4542-849a-7462709e10b0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:22.365224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:22.390849 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:22.419378 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2f110-1853-4209-bd6f-5f5072148553 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:22.435453 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca0bc1-7de6-4542-849a-7462709e10b0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:22.455677 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdb93f-778a-4e1c-87b7-f6f4108df660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:22.456286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdb93f-778a-4e1c-87b7-f6f4108df660 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:22.456559 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdb93f-778a-4e1c-87b7-f6f4108df660 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:22.456831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdb93f-778a-4e1c-87b7-f6f4108df660 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:22.457450 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdb93f-778a-4e1c-87b7-f6f4108df660 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:22.457747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdb93f-778a-4e1c-87b7-f6f4108df660 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:22.459116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdb93f-778a-4e1c-87b7-f6f4108df660 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:22.464166 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 456/931] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Aug 9 06:57:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:22.465681 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89df31-1e95-4dc9-b62a-6d5d0d82837f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:22.465681 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89df31-1e95-4dc9-b62a-6d5d0d82837f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:22.465861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89df31-1e95-4dc9-b62a-6d5d0d82837f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:22.477416 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b03d05-da88-4eaf-87c9-66b0182afc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:22.478025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b03d05-da88-4eaf-87c9-66b0182afc72 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:22.478301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b03d05-da88-4eaf-87c9-66b0182afc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:22.478568 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b03d05-da88-4eaf-87c9-66b0182afc72 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:22.480153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b03d05-da88-4eaf-87c9-66b0182afc72 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:22.480890 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b03d05-da88-4eaf-87c9-66b0182afc72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:22.481928 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b03d05-da88-4eaf-87c9-66b0182afc72 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:22.485207 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7e89df31-1e95-4dc9-b62a-6d5d0d82837f None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:22.486430 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7e89df31-1e95-4dc9-b62a-6d5d0d82837f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:22.510937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 476/932] 10.222.0.40 () {56 vars in 1149 bytes} [Tue Aug 9 06:57:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:22.512099 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b03d05-da88-4eaf-87c9-66b0182afc72 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:22.564320 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 457/933] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:22.565081 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89df31-1e95-4dc9-b62a-6d5d0d82837f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:22.620978 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:22.630048 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b03d05-da88-4eaf-87c9-66b0182afc72 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:22.649724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:22.669821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8ba93-04bf-4b60-b09e-3339c80ebd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:22.670420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8ba93-04bf-4b60-b09e-3339c80ebd67 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:22.670701 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8ba93-04bf-4b60-b09e-3339c80ebd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:22.670969 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8ba93-04bf-4b60-b09e-3339c80ebd67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:22.671652 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8ba93-04bf-4b60-b09e-3339c80ebd67 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:22.673001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8ba93-04bf-4b60-b09e-3339c80ebd67 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:22.675832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89df31-1e95-4dc9-b62a-6d5d0d82837f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:22.694789 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 477/934] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 06:57:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:57:22.695733 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8ba93-04bf-4b60-b09e-3339c80ebd67 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:22.734642 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8558e38-f452-4c3a-af9b-34a81e6d3aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:22.735315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8558e38-f452-4c3a-af9b-34a81e6d3aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:22.735587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8558e38-f452-4c3a-af9b-34a81e6d3aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:22.735852 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8558e38-f452-4c3a-af9b-34a81e6d3aa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:22.753355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8558e38-f452-4c3a-af9b-34a81e6d3aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:22.755543 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8558e38-f452-4c3a-af9b-34a81e6d3aa2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:22.778669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b8558e38-f452-4c3a-af9b-34a81e6d3aa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:22.778669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:22.778669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:22.778669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:22.778669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:22.778669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:22.778669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:22.778669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:22.778669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:22.778669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:22.778669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:22.778669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:22.778669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:22.778669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:22.778669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:22.778669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:22.779749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:22.779749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:22.779749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:22.779749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:22.779749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:22.779749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:22.779749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:22.779749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:22.779749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:22.779749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:22.779749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:22.779749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:22.779749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:22.779749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:22.779749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:22.779749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:22.779749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:22.780644 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:22.780644 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:22.780644 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:22.782603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 458/935] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:22.792378 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8558e38-f452-4c3a-af9b-34a81e6d3aa2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:22.830645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8ba93-04bf-4b60-b09e-3339c80ebd67 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:22.875777 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc6fe2-73cf-46e4-93b4-1dc975f012e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:22.877131 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc6fe2-73cf-46e4-93b4-1dc975f012e4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:22.877809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc6fe2-73cf-46e4-93b4-1dc975f012e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:22.878246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc6fe2-73cf-46e4-93b4-1dc975f012e4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:22.879284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc6fe2-73cf-46e4-93b4-1dc975f012e4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:22.881533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc6fe2-73cf-46e4-93b4-1dc975f012e4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:22.893606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-54dc6fe2-73cf-46e4-93b4-1dc975f012e4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 06:57:22.893606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:22.893606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:22.893606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:22.893606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:22.893606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:22.893606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:22.893606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:22.893606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 06:57:22.893606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:22.893606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:22.893606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:22.893606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:22.893606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:22.893606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:22.893606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:22.893606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:22.894646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:22.894646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:22.894646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:22.894646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:22.894646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:22.894646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:22.894646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:22.894646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:22.894646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:22.894646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:22.894646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:22.894646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:22.894646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:22.894646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:22.894646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:22.894646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:22.895544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:22.895544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:22.895544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:22.895544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:22.895544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:22.895544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:22.895544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:22.895544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:22.895544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:22.895544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:22.895544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:22.895544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:22.895544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 06:57:22.895544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:22.895544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 478/936] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Aug 9 06:57:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:22.900826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc6fe2-73cf-46e4-93b4-1dc975f012e4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:22.928286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:22.937308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8558e38-f452-4c3a-af9b-34a81e6d3aa2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:22.954133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:22.982918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e0eac-a93d-42cd-bf28-9ee1a39695cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:22.983558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e0eac-a93d-42cd-bf28-9ee1a39695cd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:22.983838 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e0eac-a93d-42cd-bf28-9ee1a39695cd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:22.984109 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e0eac-a93d-42cd-bf28-9ee1a39695cd None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:22.984753 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e0eac-a93d-42cd-bf28-9ee1a39695cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:22.985055 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e0eac-a93d-42cd-bf28-9ee1a39695cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:22.986421 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e0eac-a93d-42cd-bf28-9ee1a39695cd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:23.000743 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 459/937] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:23.006226 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e0eac-a93d-42cd-bf28-9ee1a39695cd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:23.035640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc6fe2-73cf-46e4-93b4-1dc975f012e4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:23.073081 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20253d9e-f7a3-425a-a16e-c9e42b16a224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:23.074254 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20253d9e-f7a3-425a-a16e-c9e42b16a224 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:23.074536 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20253d9e-f7a3-425a-a16e-c9e42b16a224 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:23.074809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20253d9e-f7a3-425a-a16e-c9e42b16a224 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:23.078581 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20253d9e-f7a3-425a-a16e-c9e42b16a224 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:23.078581 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20253d9e-f7a3-425a-a16e-c9e42b16a224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:23.078581 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20253d9e-f7a3-425a-a16e-c9e42b16a224 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:23.087434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 479/938] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Aug 9 06:57:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:23.088613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20253d9e-f7a3-425a-a16e-c9e42b16a224 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:23.131844 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e0eac-a93d-42cd-bf28-9ee1a39695cd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:23.171286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf180eb8-3e09-41ea-bab4-47af145a643a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:23.171978 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf180eb8-3e09-41ea-bab4-47af145a643a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:23.172252 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf180eb8-3e09-41ea-bab4-47af145a643a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:23.172521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf180eb8-3e09-41ea-bab4-47af145a643a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:23.179903 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf180eb8-3e09-41ea-bab4-47af145a643a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:23.181452 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf180eb8-3e09-41ea-bab4-47af145a643a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:23.195058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-bf180eb8-3e09-41ea-bab4-47af145a643a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:23.195058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:23.195058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:23.195058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:23.195058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:23.195058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:23.195058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:23.195058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:23.195058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:23.195058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:23.195058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:23.195058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:23.195058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:57:23.195058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:57:23.195058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:57:23.197139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:57:23.197139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:23.197139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:23.197139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:23.197139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:23.197139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:23.197139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:23.197139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:23.197139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:23.197139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:23.197139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:23.197139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:23.197139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:23.197139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:23.197139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:23.197139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:23.197139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:23.199514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:57:23.199514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:57:23.199514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:57:23.199514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:57:23.199514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:57:23.199514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:57:23.199514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:23.199514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:23.207188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 460/939] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:23.207188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf180eb8-3e09-41ea-bab4-47af145a643a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:23.207660 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20253d9e-f7a3-425a-a16e-c9e42b16a224 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:23.207660 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:23.222571 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:23.256785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b9158-d4a7-4c11-a5e7-f5a6fa7a63de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:23.257449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b9158-d4a7-4c11-a5e7-f5a6fa7a63de None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:23.257970 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b9158-d4a7-4c11-a5e7-f5a6fa7a63de None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:23.258245 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b9158-d4a7-4c11-a5e7-f5a6fa7a63de None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:23.259410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b9158-d4a7-4c11-a5e7-f5a6fa7a63de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:23.259839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b9158-d4a7-4c11-a5e7-f5a6fa7a63de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:23.262052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b9158-d4a7-4c11-a5e7-f5a6fa7a63de None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:23.269158 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 480/940] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Aug 9 06:57:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:23.276743 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b9158-d4a7-4c11-a5e7-f5a6fa7a63de None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:23.326506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf180eb8-3e09-41ea-bab4-47af145a643a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:23.365244 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1442094-780c-4bc8-8a58-3eed00a83d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:23.365906 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1442094-780c-4bc8-8a58-3eed00a83d6c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:23.366191 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1442094-780c-4bc8-8a58-3eed00a83d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:23.366463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1442094-780c-4bc8-8a58-3eed00a83d6c None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:23.367317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1442094-780c-4bc8-8a58-3eed00a83d6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:23.367628 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1442094-780c-4bc8-8a58-3eed00a83d6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:23.369046 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1442094-780c-4bc8-8a58-3eed00a83d6c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:23.382828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 461/941] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:57:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:23.388801 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1442094-780c-4bc8-8a58-3eed00a83d6c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:23.390274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b9158-d4a7-4c11-a5e7-f5a6fa7a63de None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:23.425580 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd28c8-5065-4dc3-8d76-b84ec09600b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:23.426279 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd28c8-5065-4dc3-8d76-b84ec09600b1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:23.426621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd28c8-5065-4dc3-8d76-b84ec09600b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:23.426950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd28c8-5065-4dc3-8d76-b84ec09600b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:23.427801 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd28c8-5065-4dc3-8d76-b84ec09600b1 None admin] RBAC: Adding query filter params (interface=public, service_id=eb3dc11734b04eaba7c4ae7471fc1501, region_id=RegionOne) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:23.428124 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd28c8-5065-4dc3-8d76-b84ec09600b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:23.429442 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd28c8-5065-4dc3-8d76-b84ec09600b1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:23.437603 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 481/942] 10.222.0.40 () {56 vars in 1251 bytes} [Tue Aug 9 06:57:23 2022] GET /identity/v3/endpoints?service_id=eb3dc11734b04eaba7c4ae7471fc1501&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:23.438683 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586353e-bc1d-463e-9c00-c0ad48fb71ae None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:23.439689 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586353e-bc1d-463e-9c00-c0ad48fb71ae None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:23.439689 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586353e-bc1d-463e-9c00-c0ad48fb71ae None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:23.440735 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 482/943] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:23.444226 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586353e-bc1d-463e-9c00-c0ad48fb71ae None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:23.471647 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:23.476871 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:23.501800 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1442094-780c-4bc8-8a58-3eed00a83d6c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:23.541073 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83258416-c91c-4a2c-a47c-0913a33e3811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:23.541805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83258416-c91c-4a2c-a47c-0913a33e3811 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:23.542676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83258416-c91c-4a2c-a47c-0913a33e3811 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:23.542954 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83258416-c91c-4a2c-a47c-0913a33e3811 None admin] PATH_INFO: `/v3/projects/342524b45def418783374ff6733e94b9/users/664e4353726c42c9bfb80b1701d35aae/roles/03e6aa0df3364e0f8f7179debccb832b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:23.545249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83258416-c91c-4a2c-a47c-0913a33e3811 None admin] RBAC: Authorizing `identity:create_grant(project_id=342524b45def418783374ff6733e94b9, user_id=664e4353726c42c9bfb80b1701d35aae, role_id=03e6aa0df3364e0f8f7179debccb832b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:23.546676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83258416-c91c-4a2c-a47c-0913a33e3811 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:23.553814 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586353e-bc1d-463e-9c00-c0ad48fb71ae None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:23.571182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 462/944] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:57:23 2022] PUT /identity/v3/projects/342524b45def418783374ff6733e94b9/users/664e4353726c42c9bfb80b1701d35aae/roles/03e6aa0df3364e0f8f7179debccb832b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 06:57:23.572677 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f343e-4636-45aa-846d-980ba290fb85 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:23.572997 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f343e-4636-45aa-846d-980ba290fb85 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:23.573279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f343e-4636-45aa-846d-980ba290fb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:23.593795 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961c697-d986-447e-b751-2d149e6ec47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:23.594419 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961c697-d986-447e-b751-2d149e6ec47e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:23.594694 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961c697-d986-447e-b751-2d149e6ec47e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:23.594962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961c697-d986-447e-b751-2d149e6ec47e None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:23.595610 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961c697-d986-447e-b751-2d149e6ec47e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:23.596990 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961c697-d986-447e-b751-2d149e6ec47e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:23.610447 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 483/945] 10.222.0.40 () {56 vars in 1087 bytes} [Tue Aug 9 06:57:23 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 06:57:23.614530 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-462f343e-4636-45aa-846d-980ba290fb85 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:23.619327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-462f343e-4636-45aa-846d-980ba290fb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:23.705634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 463/946] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:23.731194 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961c697-d986-447e-b751-2d149e6ec47e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:23.846254 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:23.854136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961c697-d986-447e-b751-2d149e6ec47e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:23.890997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e3f16-c855-4fb6-9221-21e2fd791129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:23.891564 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e3f16-c855-4fb6-9221-21e2fd791129 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:23.891838 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e3f16-c855-4fb6-9221-21e2fd791129 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:23.892102 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e3f16-c855-4fb6-9221-21e2fd791129 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:23.892741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e3f16-c855-4fb6-9221-21e2fd791129 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:23.894140 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e3f16-c855-4fb6-9221-21e2fd791129 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:23.896753 dv-cinder-852514-1-smb devstack@keystone.service[80233]: WARNING keystone.server.flask.common [None req-920e3f16-c855-4fb6-9221-21e2fd791129 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 09 06:57:23.919423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.sql.core [None req-920e3f16-c855-4fb6-9221-21e2fd791129 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 06:57:23.919423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 09 06:57:23.919423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [parameters: {'id': '6029f0b945ed418fba9b4b88f9edd4c0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 09 06:57:23.919423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80233) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 06:57:23.936399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-920e3f16-c855-4fb6-9221-21e2fd791129 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6029f0b945ed418fba9b4b88f9edd4c0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6029f0b945ed418fba9b4b88f9edd4c0. Aug 09 06:57:23.936399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:23.936399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 06:57:23.936399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 06:57:23.936399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 06:57:23.936399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 06:57:23.936399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 06:57:23.936399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 06:57:23.936399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 06:57:23.936399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application conn.query(q) Aug 09 06:57:23.936399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 06:57:23.936399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 06:57:23.936399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 06:57:23.937288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result.read() Aug 09 06:57:23.937288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 06:57:23.937288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 06:57:23.937288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 06:57:23.937288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 06:57:23.937288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 06:57:23.937288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 06:57:23.937288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 06:57:23.937288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 06:57:23.937288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 06:57:23.937288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:23.937288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 06:57:23.937288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:23.937288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:23.937288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 06:57:23.937288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 06:57:23.937288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 09 06:57:23.937288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 09 06:57:23.938274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 06:57:23.938274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application next(self.gen) Aug 09 06:57:23.938274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 06:57:23.938274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application yield resource Aug 09 06:57:23.938274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 06:57:23.938274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application next(self.gen) Aug 09 06:57:23.938274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 06:57:23.938274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 06:57:23.938274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 06:57:23.938274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 06:57:23.938274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 06:57:23.938274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise self.value Aug 09 06:57:23.938274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 06:57:23.938274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 06:57:23.938274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 06:57:23.938274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application session.commit() Aug 09 06:57:23.938274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 06:57:23.939206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 06:57:23.939206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 06:57:23.939206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 06:57:23.939206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 06:57:23.939206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.session.flush() Aug 09 06:57:23.939206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 06:57:23.939206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 06:57:23.939206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 06:57:23.939206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 06:57:23.939206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 06:57:23.939206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application compat.raise_( Aug 09 06:57:23.939206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 06:57:23.939206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception Aug 09 06:57:23.939206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 06:57:23.939206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 06:57:23.939206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 06:57:23.939206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 06:57:23.940137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 06:57:23.940137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 06:57:23.940137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 06:57:23.940137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 06:57:23.940137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 09 06:57:23.940137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 09 06:57:23.940137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 06:57:23.940137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 06:57:23.940137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 06:57:23.940137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 06:57:23.940137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 06:57:23.940137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 06:57:23.940137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 06:57:23.940137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 06:57:23.940137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 06:57:23.940967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 06:57:23.940967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 06:57:23.940967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception Aug 09 06:57:23.940967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 06:57:23.940967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 06:57:23.940967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 06:57:23.940967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 06:57:23.940967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 06:57:23.940967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 06:57:23.940967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 06:57:23.940967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application conn.query(q) Aug 09 06:57:23.940967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 06:57:23.940967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 06:57:23.940967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 06:57:23.940967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result.read() Aug 09 06:57:23.940967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 06:57:23.940967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 06:57:23.941852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 06:57:23.941852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 06:57:23.941852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 06:57:23.941852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 06:57:23.941852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 06:57:23.941852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 06:57:23.941852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 06:57:23.941852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 09 06:57:23.941852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [parameters: {'id': '6029f0b945ed418fba9b4b88f9edd4c0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 09 06:57:23.941852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 06:57:23.941852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:23.941852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:23.941852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:23.941852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:23.941852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 09 06:57:23.942645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 09 06:57:23.942645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 06:57:23.942645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 06:57:23.942645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 09 06:57:23.942645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:23.942645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:23.942645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:23.942645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:23.942645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:23.942645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:23.942645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:23.942645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:23.942645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:23.942645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:23.942645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:23.942645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:23.942645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:23.949670 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:23.949670 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 09 06:57:23.949670 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 09 06:57:23.949670 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:23.949670 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:23.949670 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 09 06:57:23.949670 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 09 06:57:23.949670 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6029f0b945ed418fba9b4b88f9edd4c0. Aug 09 06:57:23.949670 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:23.949670 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 484/947] 10.222.0.40 () {60 vars in 1140 bytes} [Tue Aug 9 06:57:23 2022] POST /identity/v3/projects => generated 262 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:23.959223 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f343e-4636-45aa-846d-980ba290fb85 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:24.022085 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:24.065632 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f343e-4636-45aa-846d-980ba290fb85 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:24.102474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b17a6a-f169-4a28-a205-d06c6526a825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:24.103132 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b17a6a-f169-4a28-a205-d06c6526a825 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:24.103415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b17a6a-f169-4a28-a205-d06c6526a825 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:24.103687 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b17a6a-f169-4a28-a205-d06c6526a825 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:24.111107 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b17a6a-f169-4a28-a205-d06c6526a825 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:24.112555 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b17a6a-f169-4a28-a205-d06c6526a825 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:24.123963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-50b17a6a-f169-4a28-a205-d06c6526a825 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:24.123963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:24.123963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:24.123963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:24.123963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:24.123963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:24.123963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:24.123963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:24.123963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:24.123963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:24.123963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:24.123963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:24.123963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:57:24.123963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:57:24.123963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:57:24.124882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:57:24.124882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:24.124882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:24.124882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:24.124882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:24.124882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:24.124882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:24.124882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:24.124882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:24.124882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:24.124882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:24.124882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:24.124882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:24.124882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:24.124882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:24.124882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:24.124882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:24.125777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:57:24.125777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:57:24.125777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:57:24.125777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:57:24.125777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:57:24.125777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:57:24.125777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:24.125777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:24.125777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 464/948] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:24.132971 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e3f16-c855-4fb6-9221-21e2fd791129 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:24.239989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e3f16-c855-4fb6-9221-21e2fd791129 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:24.276663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba99c1c-6d88-4a1a-8fbd-34d976506479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:24.277439 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba99c1c-6d88-4a1a-8fbd-34d976506479 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:24.277715 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba99c1c-6d88-4a1a-8fbd-34d976506479 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:24.277983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba99c1c-6d88-4a1a-8fbd-34d976506479 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:24.278649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba99c1c-6d88-4a1a-8fbd-34d976506479 None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:24.278952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba99c1c-6d88-4a1a-8fbd-34d976506479 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:24.280611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba99c1c-6d88-4a1a-8fbd-34d976506479 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:24.301282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 485/949] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Aug 9 06:57:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:24.834762 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608406d-23da-46bc-9e9c-13748b5a12bb None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:24.835321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608406d-23da-46bc-9e9c-13748b5a12bb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:24.835321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608406d-23da-46bc-9e9c-13748b5a12bb None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:24.836889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 465/950] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:24.842162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92fec9-4caa-4632-83cd-61775ed13ba2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:24.842618 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92fec9-4caa-4632-83cd-61775ed13ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:24.842699 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92fec9-4caa-4632-83cd-61775ed13ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:24.862818 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9a92fec9-4caa-4632-83cd-61775ed13ba2 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:24.864431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9a92fec9-4caa-4632-83cd-61775ed13ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:24.867665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:24.936670 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 486/951] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:24.958488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608406d-23da-46bc-9e9c-13748b5a12bb None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:25.061842 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608406d-23da-46bc-9e9c-13748b5a12bb None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:25.086474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:25.097710 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7383d22-174e-4f54-9e99-5b9ebaf2bc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:25.098341 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7383d22-174e-4f54-9e99-5b9ebaf2bc0e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:25.098618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7383d22-174e-4f54-9e99-5b9ebaf2bc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:25.098890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7383d22-174e-4f54-9e99-5b9ebaf2bc0e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:25.099507 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7383d22-174e-4f54-9e99-5b9ebaf2bc0e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:25.100863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7383d22-174e-4f54-9e99-5b9ebaf2bc0e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:25.109872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b7383d22-174e-4f54-9e99-5b9ebaf2bc0e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 06:57:25.109872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:25.109872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:25.109872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:25.109872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:25.109872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:25.109872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:25.109872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:25.109872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 06:57:25.109872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:25.109872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:25.109872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:25.109872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:25.109872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:25.109872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:25.109872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:25.109872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:25.110880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:25.110880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:25.110880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:25.110880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:25.110880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:25.110880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:25.110880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:25.110880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:25.110880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:25.110880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:25.110880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:25.110880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:25.110880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:25.110880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:25.110880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:25.110880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:25.111785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:25.111785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:25.111785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:25.111785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:25.111785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:25.111785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:25.111785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:25.111785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:25.111785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:25.111785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:25.111785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:25.111785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:25.111785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 06:57:25.111785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:25.111785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 466/952] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:25.116821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92fec9-4caa-4632-83cd-61775ed13ba2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:25.223789 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92fec9-4caa-4632-83cd-61775ed13ba2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:25.258424 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f4cb0-af46-4ea3-870d-8b25ffc90db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:25.259031 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f4cb0-af46-4ea3-870d-8b25ffc90db9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:25.259339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f4cb0-af46-4ea3-870d-8b25ffc90db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:25.259612 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f4cb0-af46-4ea3-870d-8b25ffc90db9 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:25.260242 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f4cb0-af46-4ea3-870d-8b25ffc90db9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:25.260602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f4cb0-af46-4ea3-870d-8b25ffc90db9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:25.262051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f4cb0-af46-4ea3-870d-8b25ffc90db9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:25.267370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 487/953] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Aug 9 06:57:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:25.272979 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7383d22-174e-4f54-9e99-5b9ebaf2bc0e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:25.382272 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7383d22-174e-4f54-9e99-5b9ebaf2bc0e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:25.417622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30c4d8-cba7-434f-9701-b4a83be79db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:25.418354 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30c4d8-cba7-434f-9701-b4a83be79db4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:25.418517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30c4d8-cba7-434f-9701-b4a83be79db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:25.418689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30c4d8-cba7-434f-9701-b4a83be79db4 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:25.419376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30c4d8-cba7-434f-9701-b4a83be79db4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:25.419681 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30c4d8-cba7-434f-9701-b4a83be79db4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:25.421111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30c4d8-cba7-434f-9701-b4a83be79db4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:25.426595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 467/954] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Aug 9 06:57:25 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:25.751274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c41808-189e-47e1-a261-52f1b63030ba None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:25.751653 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c41808-189e-47e1-a261-52f1b63030ba None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:25.751829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c41808-189e-47e1-a261-52f1b63030ba None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:25.753450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 488/955] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:25.758701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ae6bf-6332-4246-8682-ef2c0e85f84b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:25.758992 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ae6bf-6332-4246-8682-ef2c0e85f84b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:25.759301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ae6bf-6332-4246-8682-ef2c0e85f84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:25.778131 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8c7ae6bf-6332-4246-8682-ef2c0e85f84b None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:25.779369 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8c7ae6bf-6332-4246-8682-ef2c0e85f84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:25.829989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:25.845167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b39c34-4c77-44f9-b124-2357cc46e163 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:25.845167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b39c34-4c77-44f9-b124-2357cc46e163 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:25.845167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b39c34-4c77-44f9-b124-2357cc46e163 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:25.846341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 489/956] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:57:25.851581 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b1dd-1061-4ce2-ba17-36e2d0bd9e83 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:25.852169 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b1dd-1061-4ce2-ba17-36e2d0bd9e83 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:25.852662 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b1dd-1061-4ce2-ba17-36e2d0bd9e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:25.856221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 468/957] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:25.871445 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:25.875811 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8824b1dd-1061-4ce2-ba17-36e2d0bd9e83 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:25.876917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8824b1dd-1061-4ce2-ba17-36e2d0bd9e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:25.877390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ae6bf-6332-4246-8682-ef2c0e85f84b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:25.949985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 490/958] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 06:57:25.974009 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824b1dd-1061-4ce2-ba17-36e2d0bd9e83 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:25.999547 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ae6bf-6332-4246-8682-ef2c0e85f84b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:26.044577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322d36b-22a1-4011-8246-eca144bdb20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:26.045222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322d36b-22a1-4011-8246-eca144bdb20b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:26.045502 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322d36b-22a1-4011-8246-eca144bdb20b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:26.045775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322d36b-22a1-4011-8246-eca144bdb20b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:26.065383 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322d36b-22a1-4011-8246-eca144bdb20b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:57:26.071830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f322d36b-22a1-4011-8246-eca144bdb20b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 06:57:26.071830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:26.071830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:26.071830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:26.071830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:26.071830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:26.071830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:26.071830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:26.071830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:26.071830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:26.071830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:26.071830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:26.071830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:57:26.071830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:57:26.071830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:57:26.071830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:57:26.073666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:57:26.073666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:57:26.073666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:57:26.073666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:57:26.073666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:26.073666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:26.073666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:26.073666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:26.073666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:26.073666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:26.073666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:26.073666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:26.073666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:26.073666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:26.073666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:26.073666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:26.074614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:26.074614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:26.074614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:26.074614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:26.074614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:57:26.074614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:57:26.074614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:57:26.074614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:57:26.074614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:57:26.074614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:57:26.074614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 06:57:26.074614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:26.079178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 469/959] 10.222.0.40 () {56 vars in 1120 bytes} [Tue Aug 9 06:57:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:26.081216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322d36b-22a1-4011-8246-eca144bdb20b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:26.090786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824b1dd-1061-4ce2-ba17-36e2d0bd9e83 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:26.131460 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78bafb-2610-4701-b0cd-f84bd1274b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:26.132282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78bafb-2610-4701-b0cd-f84bd1274b9b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:26.132657 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78bafb-2610-4701-b0cd-f84bd1274b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:26.133023 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78bafb-2610-4701-b0cd-f84bd1274b9b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:26.133704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78bafb-2610-4701-b0cd-f84bd1274b9b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:26.135233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78bafb-2610-4701-b0cd-f84bd1274b9b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:26.138406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:26.138866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:26.147283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-7e78bafb-2610-4701-b0cd-f84bd1274b9b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 06:57:26.147283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:26.147283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:26.147283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:26.147283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:26.147283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:26.147283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:26.147283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:26.147283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 06:57:26.147283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:26.147283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:26.147283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:26.147283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:26.147283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:26.147283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:26.147283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:26.147283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:26.148598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:26.148598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:26.148598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:26.148598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:26.148598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:26.148598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:26.148598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:26.148598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:26.148598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:26.148598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:26.148598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:26.148598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:26.148598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:26.148598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:26.148598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:26.148598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:26.149619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:26.149619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:26.149619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:26.149619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:26.149619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:26.149619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:26.149619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:26.149619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:26.149619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:26.149619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:26.149619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:26.149619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:26.149619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 06:57:26.149619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:26.157747 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 491/960] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Aug 9 06:57:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:26.158775 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78bafb-2610-4701-b0cd-f84bd1274b9b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:26.214635 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322d36b-22a1-4011-8246-eca144bdb20b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:26.257358 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd6fb3-7c97-4551-8bf5-dfe6ebd5d950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:26.258090 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd6fb3-7c97-4551-8bf5-dfe6ebd5d950 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:26.258790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd6fb3-7c97-4551-8bf5-dfe6ebd5d950 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:26.259066 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd6fb3-7c97-4551-8bf5-dfe6ebd5d950 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:26.260038 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd6fb3-7c97-4551-8bf5-dfe6ebd5d950 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:26.260385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd6fb3-7c97-4551-8bf5-dfe6ebd5d950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:26.262294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd6fb3-7c97-4551-8bf5-dfe6ebd5d950 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:26.271447 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78bafb-2610-4701-b0cd-f84bd1274b9b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:26.273287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 470/961] 10.222.0.40 () {56 vars in 1115 bytes} [Tue Aug 9 06:57:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:26.280334 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd6fb3-7c97-4551-8bf5-dfe6ebd5d950 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:26.312424 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c276ac-f331-4436-a2b0-7cf67b36f8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:26.313071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c276ac-f331-4436-a2b0-7cf67b36f8ff None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:26.313350 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c276ac-f331-4436-a2b0-7cf67b36f8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:26.313625 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c276ac-f331-4436-a2b0-7cf67b36f8ff None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:26.314308 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c276ac-f331-4436-a2b0-7cf67b36f8ff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:26.314616 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c276ac-f331-4436-a2b0-7cf67b36f8ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:26.316011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c276ac-f331-4436-a2b0-7cf67b36f8ff None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:26.321250 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 492/962] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Aug 9 06:57:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:26.327534 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c276ac-f331-4436-a2b0-7cf67b36f8ff None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:26.394153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:26.409894 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd6fb3-7c97-4551-8bf5-dfe6ebd5d950 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:26.412713 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:26.441437 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c276ac-f331-4436-a2b0-7cf67b36f8ff None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:26.449796 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b1500-f9e9-47fa-8586-833b4129d757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:26.450427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b1500-f9e9-47fa-8586-833b4129d757 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:26.450891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b1500-f9e9-47fa-8586-833b4129d757 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:26.451016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b1500-f9e9-47fa-8586-833b4129d757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:26.461932 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b1500-f9e9-47fa-8586-833b4129d757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:26.463071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b1500-f9e9-47fa-8586-833b4129d757 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:26.476601 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f761be-4369-4b3e-88ce-87e7ca54e3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:26.477139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f761be-4369-4b3e-88ce-87e7ca54e3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:26.477416 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f761be-4369-4b3e-88ce-87e7ca54e3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:26.477685 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f761be-4369-4b3e-88ce-87e7ca54e3c8 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:26.478307 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f761be-4369-4b3e-88ce-87e7ca54e3c8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:26.478611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f761be-4369-4b3e-88ce-87e7ca54e3c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:26.478848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-940b1500-f9e9-47fa-8586-833b4129d757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:26.478848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:26.478848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:26.478848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:26.478848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:26.478848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:26.478848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:26.478848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:26.478848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:26.478848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:26.478848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:26.478848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:26.478848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:26.478848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:26.478848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:26.478848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:26.480557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:26.480557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:26.480557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:26.480557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:26.480557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:26.480557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:26.480557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:26.480557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:26.480557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:26.480557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:26.480557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:26.480557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:26.480557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:26.480557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:26.480557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:26.480557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:26.480557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:26.481474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:26.481474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:26.481474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:26.482231 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f761be-4369-4b3e-88ce-87e7ca54e3c8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:26.485238 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 471/963] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:26.490450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 493/964] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Aug 9 06:57:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:26.490450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f761be-4369-4b3e-88ce-87e7ca54e3c8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:26.490798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde17566-b56b-4d39-8177-063efc06cda9 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:26.490798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde17566-b56b-4d39-8177-063efc06cda9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:26.490798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde17566-b56b-4d39-8177-063efc06cda9 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:26.490798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 472/965] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:26.491437 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde17566-b56b-4d39-8177-063efc06cda9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:26.597524 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f761be-4369-4b3e-88ce-87e7ca54e3c8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:26.598504 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde17566-b56b-4d39-8177-063efc06cda9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:26.629884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:26.638495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be182644-e3e4-4293-b7cf-c571ceb7ba7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:26.639126 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be182644-e3e4-4293-b7cf-c571ceb7ba7b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:26.639435 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be182644-e3e4-4293-b7cf-c571ceb7ba7b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:26.639673 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be182644-e3e4-4293-b7cf-c571ceb7ba7b None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:26.644270 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be182644-e3e4-4293-b7cf-c571ceb7ba7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:26.644270 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be182644-e3e4-4293-b7cf-c571ceb7ba7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:26.644270 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be182644-e3e4-4293-b7cf-c571ceb7ba7b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:26.649865 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4c8b8-5e44-44e4-b6e0-e8fbe264b5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:26.650477 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4c8b8-5e44-44e4-b6e0-e8fbe264b5c9 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:26.650755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4c8b8-5e44-44e4-b6e0-e8fbe264b5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:26.652004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4c8b8-5e44-44e4-b6e0-e8fbe264b5c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:26.652671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4c8b8-5e44-44e4-b6e0-e8fbe264b5c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:26.654179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4c8b8-5e44-44e4-b6e0-e8fbe264b5c9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:26.654845 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 494/966] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:26.656108 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b732d-bc0a-4b57-9eeb-0af05cd26f90 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:26.656359 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b732d-bc0a-4b57-9eeb-0af05cd26f90 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:26.656627 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b732d-bc0a-4b57-9eeb-0af05cd26f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:26.682176 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-418b732d-bc0a-4b57-9eeb-0af05cd26f90 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:26.682460 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 473/967] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 06:57:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:57:26.682560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-418b732d-bc0a-4b57-9eeb-0af05cd26f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:26.682648 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4c8b8-5e44-44e4-b6e0-e8fbe264b5c9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:26.700018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:26.795331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 495/968] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:26.809219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4c8b8-5e44-44e4-b6e0-e8fbe264b5c9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:26.826016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b732d-bc0a-4b57-9eeb-0af05cd26f90 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:26.852477 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f753284-a9a5-4d3e-9c24-4523bb048e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:26.853114 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f753284-a9a5-4d3e-9c24-4523bb048e87 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:26.853396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f753284-a9a5-4d3e-9c24-4523bb048e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:26.853661 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f753284-a9a5-4d3e-9c24-4523bb048e87 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:26.863162 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f753284-a9a5-4d3e-9c24-4523bb048e87 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:26.864336 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f753284-a9a5-4d3e-9c24-4523bb048e87 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:26.883526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1f753284-a9a5-4d3e-9c24-4523bb048e87 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 06:57:26.883526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:26.883526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:26.883526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:26.883526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:26.883526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:26.883526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:26.883526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:26.883526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:26.883526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:26.883526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:26.883526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:26.883526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:57:26.883526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:57:26.883526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:57:26.883526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:57:26.884560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:26.884560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:26.884560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:57:26.884560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:26.884560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:57:26.884560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:26.884560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:26.884560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:26.884560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:26.884560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:26.884560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:26.884560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:26.884560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:26.884560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:26.884560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:26.884560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:26.884560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:26.884560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:26.886087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:26.886087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:26.886087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:57:26.886087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:57:26.886087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:57:26.886087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:57:26.886087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:57:26.886087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:57:26.886087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 06:57:26.886087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:26.886730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 474/969] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Aug 9 06:57:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:26.891932 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f753284-a9a5-4d3e-9c24-4523bb048e87 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:26.954797 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b732d-bc0a-4b57-9eeb-0af05cd26f90 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:26.974417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:26.982199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:27.008845 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f788f-9b96-4aa2-8134-fae525c0e97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:27.010988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f788f-9b96-4aa2-8134-fae525c0e97a None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:27.011889 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f788f-9b96-4aa2-8134-fae525c0e97a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:27.012611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f788f-9b96-4aa2-8134-fae525c0e97a None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:27.014000 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f788f-9b96-4aa2-8134-fae525c0e97a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:27.016148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f788f-9b96-4aa2-8134-fae525c0e97a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:27.019308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f753284-a9a5-4d3e-9c24-4523bb048e87 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:27.036199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.sql.core [None req-515f788f-9b96-4aa2-8134-fae525c0e97a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 06:57:27.036199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 09 06:57:27.036199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [parameters: {'user_id': 'e63a95b9910b43328410dcb44b29c798', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 09 06:57:27.036199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80233) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 06:57:27.046604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-515f788f-9b96-4aa2-8134-fae525c0e97a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 09 06:57:27.046604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:27.046604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 06:57:27.046604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 06:57:27.046604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 06:57:27.046604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 06:57:27.046604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 06:57:27.046604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 06:57:27.046604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 06:57:27.046604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application conn.query(q) Aug 09 06:57:27.046604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 06:57:27.046604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 06:57:27.046604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 06:57:27.046604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result.read() Aug 09 06:57:27.046604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 06:57:27.047792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 06:57:27.047792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 06:57:27.047792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 06:57:27.047792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 06:57:27.047792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 06:57:27.047792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 06:57:27.047792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 06:57:27.047792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 06:57:27.047792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:27.047792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 06:57:27.047792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:27.047792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:27.047792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 06:57:27.047792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 06:57:27.047792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 09 06:57:27.047792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 09 06:57:27.047792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 06:57:27.047792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application next(self.gen) Aug 09 06:57:27.048988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 06:57:27.048988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application yield resource Aug 09 06:57:27.048988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 06:57:27.048988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application next(self.gen) Aug 09 06:57:27.048988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 06:57:27.048988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 06:57:27.048988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 06:57:27.048988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 06:57:27.048988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 06:57:27.048988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise self.value Aug 09 06:57:27.048988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 06:57:27.048988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 06:57:27.048988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 06:57:27.048988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application session.commit() Aug 09 06:57:27.048988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 06:57:27.048988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 06:57:27.048988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 06:57:27.050112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 06:57:27.050112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 06:57:27.050112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.session.flush() Aug 09 06:57:27.050112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 06:57:27.050112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 06:57:27.050112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 06:57:27.050112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 06:57:27.050112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 06:57:27.050112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application compat.raise_( Aug 09 06:57:27.050112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 06:57:27.050112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception Aug 09 06:57:27.050112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 06:57:27.050112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 06:57:27.050112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 06:57:27.050112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 06:57:27.050112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 06:57:27.050112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 06:57:27.051229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 06:57:27.051229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 06:57:27.051229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 09 06:57:27.051229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 09 06:57:27.051229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 06:57:27.051229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 06:57:27.051229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 06:57:27.051229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 06:57:27.051229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 06:57:27.051229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 06:57:27.051229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 06:57:27.051229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 06:57:27.051229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 06:57:27.051229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 06:57:27.051229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 06:57:27.051229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception Aug 09 06:57:27.052297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 06:57:27.052297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 06:57:27.052297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 06:57:27.052297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 06:57:27.052297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 06:57:27.052297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 06:57:27.052297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 06:57:27.052297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application conn.query(q) Aug 09 06:57:27.052297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 06:57:27.052297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 06:57:27.052297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 06:57:27.052297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result.read() Aug 09 06:57:27.052297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 06:57:27.052297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 06:57:27.052297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 06:57:27.052297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 06:57:27.053542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 06:57:27.053542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 06:57:27.053542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 06:57:27.053542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 06:57:27.053542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 06:57:27.053542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 09 06:57:27.053542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e63a95b9910b43328410dcb44b29c798', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 09 06:57:27.053542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 06:57:27.053542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:27.053542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:27.053542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:27.053542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:27.053542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:27.053542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:27.053542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:27.054499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:27.054499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:27.054499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:27.054499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:27.054499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:27.054499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:27.054499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:27.054499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 09 06:57:27.054499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 09 06:57:27.054499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:27.054499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:27.054499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:57:27.054499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:27.054499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:57:27.054499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:27.054499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 09 06:57:27.054499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 09 06:57:27.055630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 09 06:57:27.055630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 09 06:57:27.055630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 06:57:27.055630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 06:57:27.055630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 09 06:57:27.055630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:27.063373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 496/970] 10.222.0.40 () {60 vars in 1131 bytes} [Tue Aug 9 06:57:26 2022] POST /identity/v3/users => generated 160 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:27.065238 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f788f-9b96-4aa2-8134-fae525c0e97a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:27.071578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca539c-8aff-4ab6-b475-d0fc5e846a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:27.072558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca539c-8aff-4ab6-b475-d0fc5e846a76 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:27.073685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca539c-8aff-4ab6-b475-d0fc5e846a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:27.074165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca539c-8aff-4ab6-b475-d0fc5e846a76 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:27.075123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca539c-8aff-4ab6-b475-d0fc5e846a76 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:27.075653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca539c-8aff-4ab6-b475-d0fc5e846a76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:27.077276 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca539c-8aff-4ab6-b475-d0fc5e846a76 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:27.098072 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 475/971] 10.222.0.40 () {56 vars in 1149 bytes} [Tue Aug 9 06:57:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:27.106506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca539c-8aff-4ab6-b475-d0fc5e846a76 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:27.186536 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f788f-9b96-4aa2-8134-fae525c0e97a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:27.221193 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca539c-8aff-4ab6-b475-d0fc5e846a76 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:27.231643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79429b-c2d0-4e05-a461-2bb5e76b89e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:27.232529 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79429b-c2d0-4e05-a461-2bb5e76b89e9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:27.232938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79429b-c2d0-4e05-a461-2bb5e76b89e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:27.233360 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79429b-c2d0-4e05-a461-2bb5e76b89e9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:27.241569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79429b-c2d0-4e05-a461-2bb5e76b89e9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:27.243192 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79429b-c2d0-4e05-a461-2bb5e76b89e9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:27.255320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-9f79429b-c2d0-4e05-a461-2bb5e76b89e9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 06:57:27.255320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:27.255320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:27.255320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:27.255320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:27.255320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:27.255320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:27.255320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:27.255320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:27.255320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:27.255320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:27.255320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:27.255320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:57:27.255320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:57:27.255320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:57:27.255320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:57:27.256335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:27.256335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:27.256335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:57:27.256335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:27.256335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:57:27.256335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:27.256335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:27.256335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:27.256335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:27.256335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:27.256335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:27.256335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:27.256335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:27.256335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:27.256335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:27.256335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:27.256335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:27.256335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:27.258302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:27.258302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:27.258302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:57:27.258302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:57:27.258302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:57:27.258302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:57:27.258302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:57:27.258302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:57:27.258302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 06:57:27.258302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:27.258302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 497/972] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:57:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:27.261894 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:27.263794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79429b-c2d0-4e05-a461-2bb5e76b89e9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:27.271251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49b8ea-c45e-47f0-a199-1f0837cddd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:27.271867 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49b8ea-c45e-47f0-a199-1f0837cddd02 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:27.272142 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49b8ea-c45e-47f0-a199-1f0837cddd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:27.272410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49b8ea-c45e-47f0-a199-1f0837cddd02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:27.306029 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:27.344258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49b8ea-c45e-47f0-a199-1f0837cddd02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:27.345687 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49b8ea-c45e-47f0-a199-1f0837cddd02 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:27.381160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79429b-c2d0-4e05-a461-2bb5e76b89e9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:27.419812 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a09f9d-fd6d-40c5-a653-86c7787589a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:27.420831 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a09f9d-fd6d-40c5-a653-86c7787589a6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:27.421326 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a09f9d-fd6d-40c5-a653-86c7787589a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:27.421934 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a09f9d-fd6d-40c5-a653-86c7787589a6 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:27.422846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a09f9d-fd6d-40c5-a653-86c7787589a6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:27.423399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a09f9d-fd6d-40c5-a653-86c7787589a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:27.425220 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a09f9d-fd6d-40c5-a653-86c7787589a6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:27.452986 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 476/973] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:57:27 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 06:57:27.455629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49b8ea-c45e-47f0-a199-1f0837cddd02 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:27.472315 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 498/974] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Aug 9 06:57:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:27.495936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:27.526941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4194a-0514-4c59-8242-03b063f2b366 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:27.527520 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4194a-0514-4c59-8242-03b063f2b366 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:27.527916 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4194a-0514-4c59-8242-03b063f2b366 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:27.529811 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 499/975] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:57:27.535542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79da21a-2a7a-41a5-af8e-b71d1e078c37 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:27.535941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79da21a-2a7a-41a5-af8e-b71d1e078c37 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:27.536325 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79da21a-2a7a-41a5-af8e-b71d1e078c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:27.557628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f79da21a-2a7a-41a5-af8e-b71d1e078c37 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:27.559622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f79da21a-2a7a-41a5-af8e-b71d1e078c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:27.602210 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49b8ea-c45e-47f0-a199-1f0837cddd02 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:27.666124 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65416488-c3dc-459d-9d83-bb220e1043cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:27.667320 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65416488-c3dc-459d-9d83-bb220e1043cd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:27.667602 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65416488-c3dc-459d-9d83-bb220e1043cd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:27.667913 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65416488-c3dc-459d-9d83-bb220e1043cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:27.670751 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 500/976] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:27.678378 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65416488-c3dc-459d-9d83-bb220e1043cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:27.679929 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65416488-c3dc-459d-9d83-bb220e1043cd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:27.694614 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79da21a-2a7a-41a5-af8e-b71d1e078c37 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:27.700179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-65416488-c3dc-459d-9d83-bb220e1043cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:27.700179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:27.700179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:27.700179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:27.700179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:27.700179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:27.700179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:27.700179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:27.700179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:27.700179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:27.700179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:27.700179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:27.700179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:27.700179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:27.700179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:27.700179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:27.701216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:27.701216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:27.701216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:27.701216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:27.701216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:27.701216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:27.701216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:27.701216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:27.701216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:27.701216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:27.701216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:27.701216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:27.701216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:27.701216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:27.701216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:27.701216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:27.701216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:27.702123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:27.702123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:27.702123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:27.702123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 477/977] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:27.708102 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65416488-c3dc-459d-9d83-bb220e1043cd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:27.722203 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:27.818321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:27.824475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79da21a-2a7a-41a5-af8e-b71d1e078c37 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:27.838257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65416488-c3dc-459d-9d83-bb220e1043cd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:27.861688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a933dce-7cc1-4f1d-9d48-f88a95c2cdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:27.862394 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a933dce-7cc1-4f1d-9d48-f88a95c2cdc3 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:27.862946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a933dce-7cc1-4f1d-9d48-f88a95c2cdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:27.863054 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a933dce-7cc1-4f1d-9d48-f88a95c2cdc3 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:27.863704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a933dce-7cc1-4f1d-9d48-f88a95c2cdc3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:27.865164 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a933dce-7cc1-4f1d-9d48-f88a95c2cdc3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:27.873296 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671b007-489e-4c6c-bc2f-f125a01f5e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:27.874023 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671b007-489e-4c6c-bc2f-f125a01f5e3e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:27.874198 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671b007-489e-4c6c-bc2f-f125a01f5e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:27.874445 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671b007-489e-4c6c-bc2f-f125a01f5e3e None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:27.875119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671b007-489e-4c6c-bc2f-f125a01f5e3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:27.875409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671b007-489e-4c6c-bc2f-f125a01f5e3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:27.876759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671b007-489e-4c6c-bc2f-f125a01f5e3e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:27.881224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 501/978] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Aug 9 06:57:27 2022] POST /identity/v3/services => generated 242 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:57:27.895130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 478/979] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:27.899509 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a933dce-7cc1-4f1d-9d48-f88a95c2cdc3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:27.999407 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:28.029228 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a933dce-7cc1-4f1d-9d48-f88a95c2cdc3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:28.066111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3648e8a-ed8a-4247-a87d-17b6984d3e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:28.066733 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3648e8a-ed8a-4247-a87d-17b6984d3e8a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:28.067003 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3648e8a-ed8a-4247-a87d-17b6984d3e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:28.067297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3648e8a-ed8a-4247-a87d-17b6984d3e8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:28.074764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3648e8a-ed8a-4247-a87d-17b6984d3e8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:28.076283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3648e8a-ed8a-4247-a87d-17b6984d3e8a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:28.087560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-c3648e8a-ed8a-4247-a87d-17b6984d3e8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:28.087560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:28.087560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:28.087560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:28.087560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:28.087560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:28.087560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:28.087560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:28.087560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:28.087560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:28.087560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:28.087560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:28.087560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:57:28.087560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:57:28.087560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:57:28.088870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:57:28.088870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:28.088870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:28.088870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:28.088870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:28.088870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:28.088870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:28.088870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:28.088870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:28.088870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:28.088870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:28.088870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:28.088870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:28.088870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:28.088870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:28.088870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:28.088870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:28.090341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:57:28.090341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:57:28.090341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:57:28.090341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:57:28.090341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:57:28.090341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:57:28.090341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:28.090341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:28.090341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 502/980] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:28.094699 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671b007-489e-4c6c-bc2f-f125a01f5e3e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:28.194762 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671b007-489e-4c6c-bc2f-f125a01f5e3e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:28.228516 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064bb01-cb51-4d49-b443-900fe5f2627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:28.229156 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064bb01-cb51-4d49-b443-900fe5f2627b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:28.229423 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064bb01-cb51-4d49-b443-900fe5f2627b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:28.229687 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064bb01-cb51-4d49-b443-900fe5f2627b None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:28.230431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064bb01-cb51-4d49-b443-900fe5f2627b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:28.230734 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064bb01-cb51-4d49-b443-900fe5f2627b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:28.232164 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064bb01-cb51-4d49-b443-900fe5f2627b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:28.243537 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 479/981] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:57:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:28.249696 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3648e8a-ed8a-4247-a87d-17b6984d3e8a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:28.352427 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3648e8a-ed8a-4247-a87d-17b6984d3e8a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:28.388143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198f7b3-5039-49bc-a062-d0e49f98b032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:28.388809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198f7b3-5039-49bc-a062-d0e49f98b032 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:28.389087 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198f7b3-5039-49bc-a062-d0e49f98b032 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:28.389354 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198f7b3-5039-49bc-a062-d0e49f98b032 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:28.390078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198f7b3-5039-49bc-a062-d0e49f98b032 None admin] RBAC: Adding query filter params (role.id=03e6aa0df3364e0f8f7179debccb832b, scope.project.id=342524b45def418783374ff6733e94b9, user.id=664e4353726c42c9bfb80b1701d35aae) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:28.390382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198f7b3-5039-49bc-a062-d0e49f98b032 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:28.391820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198f7b3-5039-49bc-a062-d0e49f98b032 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:28.403171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 503/982] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:57:28 2022] GET /identity/v3/role_assignments?user.id=664e4353726c42c9bfb80b1701d35aae&scope.project.id=342524b45def418783374ff6733e94b9&role.id=03e6aa0df3364e0f8f7179debccb832b => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:28.877546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df549814-c7b8-4d9f-84b4-89e38910407e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:28.877546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df549814-c7b8-4d9f-84b4-89e38910407e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:28.877546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df549814-c7b8-4d9f-84b4-89e38910407e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:28.878387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 480/983] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:28.883553 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95329fb-4ad8-45fd-b7b3-da7ee0684c9a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:28.883740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95329fb-4ad8-45fd-b7b3-da7ee0684c9a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:28.883974 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95329fb-4ad8-45fd-b7b3-da7ee0684c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:28.890475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:28.904014 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b95329fb-4ad8-45fd-b7b3-da7ee0684c9a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:28.905202 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b95329fb-4ad8-45fd-b7b3-da7ee0684c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:28.971862 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 504/984] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:28 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:28.994306 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df549814-c7b8-4d9f-84b4-89e38910407e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:28.997240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:29.100457 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df549814-c7b8-4d9f-84b4-89e38910407e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:29.134314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c7be5-7d45-48dd-aef7-570fef7dfdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:29.134862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c7be5-7d45-48dd-aef7-570fef7dfdba None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:29.135701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c7be5-7d45-48dd-aef7-570fef7dfdba None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:29.135964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c7be5-7d45-48dd-aef7-570fef7dfdba None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:29.136541 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c7be5-7d45-48dd-aef7-570fef7dfdba None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:29.137896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c7be5-7d45-48dd-aef7-570fef7dfdba None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:29.146408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-461c7be5-7d45-48dd-aef7-570fef7dfdba None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 06:57:29.146408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:29.146408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:29.146408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:29.146408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:29.146408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:29.146408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:29.146408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:29.146408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 06:57:29.146408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:29.146408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:29.146408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:29.146408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:29.146408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:29.146408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:29.146408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:29.146408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:29.147525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:29.147525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:29.147525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:29.147525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:29.147525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:29.147525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:29.147525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:29.147525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:29.147525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:29.147525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:29.147525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:29.147525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:29.147525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:29.147525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:29.147525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:29.147525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:29.148412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:29.148412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:29.148412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:29.148412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:29.148412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:29.148412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:29.148412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:29.148412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:29.148412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:29.148412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:29.148412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:29.148412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:29.148412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 06:57:29.148412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:29.151790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 481/985] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Aug 9 06:57:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:29.154218 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95329fb-4ad8-45fd-b7b3-da7ee0684c9a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:29.250810 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95329fb-4ad8-45fd-b7b3-da7ee0684c9a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:29.281584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:29.287562 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e66f02-1b0b-4324-a0ee-1ad2c2f79778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:29.288174 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e66f02-1b0b-4324-a0ee-1ad2c2f79778 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:29.288452 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e66f02-1b0b-4324-a0ee-1ad2c2f79778 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:29.288723 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e66f02-1b0b-4324-a0ee-1ad2c2f79778 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:29.289348 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e66f02-1b0b-4324-a0ee-1ad2c2f79778 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:29.289650 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e66f02-1b0b-4324-a0ee-1ad2c2f79778 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:29.290996 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e66f02-1b0b-4324-a0ee-1ad2c2f79778 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:29.296032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 505/986] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Aug 9 06:57:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:29.301520 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c7be5-7d45-48dd-aef7-570fef7dfdba None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:29.366332 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:29.403513 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c7be5-7d45-48dd-aef7-570fef7dfdba None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:29.436606 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c443f97-8bd3-4f08-8178-f8dd373a6fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:29.437212 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c443f97-8bd3-4f08-8178-f8dd373a6fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:29.437491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c443f97-8bd3-4f08-8178-f8dd373a6fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:29.437759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c443f97-8bd3-4f08-8178-f8dd373a6fb2 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:29.438392 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c443f97-8bd3-4f08-8178-f8dd373a6fb2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:29.438791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c443f97-8bd3-4f08-8178-f8dd373a6fb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:29.440055 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c443f97-8bd3-4f08-8178-f8dd373a6fb2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:29.450320 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 482/987] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Aug 9 06:57:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:29.451402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e66f02-1b0b-4324-a0ee-1ad2c2f79778 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:29.554921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e66f02-1b0b-4324-a0ee-1ad2c2f79778 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:29.590295 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fa983-9b35-4e75-ad9c-f76ebb3ec7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:29.590907 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fa983-9b35-4e75-ad9c-f76ebb3ec7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:29.591224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fa983-9b35-4e75-ad9c-f76ebb3ec7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:29.591496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fa983-9b35-4e75-ad9c-f76ebb3ec7b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:29.592205 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fa983-9b35-4e75-ad9c-f76ebb3ec7b3 None admin] RBAC: Adding query filter params (interface=admin, service_id=eb3dc11734b04eaba7c4ae7471fc1501, region_id=RegionOne) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:29.592514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fa983-9b35-4e75-ad9c-f76ebb3ec7b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:29.593875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fa983-9b35-4e75-ad9c-f76ebb3ec7b3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:29.603527 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 506/988] 10.222.0.40 () {56 vars in 1249 bytes} [Tue Aug 9 06:57:29 2022] GET /identity/v3/endpoints?service_id=eb3dc11734b04eaba7c4ae7471fc1501&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:29.605570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c443f97-8bd3-4f08-8178-f8dd373a6fb2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:29.712286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c443f97-8bd3-4f08-8178-f8dd373a6fb2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:29.740786 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:29.747417 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f845f-b2ff-46eb-ae46-f04d42603233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:29.748025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f845f-b2ff-46eb-ae46-f04d42603233 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:29.748304 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f845f-b2ff-46eb-ae46-f04d42603233 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:29.748577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f845f-b2ff-46eb-ae46-f04d42603233 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:29.749177 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f845f-b2ff-46eb-ae46-f04d42603233 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:29.750531 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f845f-b2ff-46eb-ae46-f04d42603233 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:29.763116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 483/989] 10.222.0.40 () {56 vars in 1087 bytes} [Tue Aug 9 06:57:29 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 06:57:29.921876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b660a5-fabc-4f93-b385-0831efb3e2c9 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:29.922162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b660a5-fabc-4f93-b385-0831efb3e2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:29.922435 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b660a5-fabc-4f93-b385-0831efb3e2c9 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:29.923959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 507/990] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:29.929130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436aebb-4707-4786-81d0-0062ce0c41d0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:29.929578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436aebb-4707-4786-81d0-0062ce0c41d0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:29.929760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436aebb-4707-4786-81d0-0062ce0c41d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:29.952269 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f436aebb-4707-4786-81d0-0062ce0c41d0 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:29.953438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f436aebb-4707-4786-81d0-0062ce0c41d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:30.021165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 484/991] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:30.044113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b660a5-fabc-4f93-b385-0831efb3e2c9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:30.108160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:30.153325 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b660a5-fabc-4f93-b385-0831efb3e2c9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:30.188669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab11d27-b6a2-48b0-be10-2783bedc4af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:30.189326 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab11d27-b6a2-48b0-be10-2783bedc4af6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:30.189568 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab11d27-b6a2-48b0-be10-2783bedc4af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:30.189819 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab11d27-b6a2-48b0-be10-2783bedc4af6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:30.190403 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab11d27-b6a2-48b0-be10-2783bedc4af6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:30.191774 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab11d27-b6a2-48b0-be10-2783bedc4af6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:30.201622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-7ab11d27-b6a2-48b0-be10-2783bedc4af6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 06:57:30.201622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:30.201622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:30.201622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:30.201622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:30.201622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:30.201622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:30.201622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:30.201622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 06:57:30.201622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:30.201622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:30.201622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:30.201622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:30.201622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:30.201622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:30.201622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:30.201622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:30.202665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:30.202665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:30.202665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:30.202665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:30.202665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:30.202665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:30.202665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:30.202665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:30.202665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:30.202665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:30.202665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:30.202665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:30.202665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:30.202665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:30.202665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:30.202665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:30.203684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:30.203684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:30.203684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:30.203684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:30.203684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:30.203684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:30.203684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:30.203684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:30.203684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:30.203684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:30.203684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:30.203684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:30.203684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 06:57:30.203684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:30.207254 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 508/992] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:30.209163 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436aebb-4707-4786-81d0-0062ce0c41d0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:30.315788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436aebb-4707-4786-81d0-0062ce0c41d0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:30.341178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:30.352910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545a69f-0754-41e6-8a89-9658cf85cc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:30.353521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545a69f-0754-41e6-8a89-9658cf85cc37 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:30.353800 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545a69f-0754-41e6-8a89-9658cf85cc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:30.354180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545a69f-0754-41e6-8a89-9658cf85cc37 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:30.354804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545a69f-0754-41e6-8a89-9658cf85cc37 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:30.355130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545a69f-0754-41e6-8a89-9658cf85cc37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:30.356486 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545a69f-0754-41e6-8a89-9658cf85cc37 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:30.365932 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 485/993] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Aug 9 06:57:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:30.367218 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab11d27-b6a2-48b0-be10-2783bedc4af6 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:30.463791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afd856-9eae-476d-add4-f3d156c869f3 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:30.464166 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afd856-9eae-476d-add4-f3d156c869f3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:30.464355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afd856-9eae-476d-add4-f3d156c869f3 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:30.465723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 486/994] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:57:30.470903 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09214714-4163-4497-997b-2ac683c1a11e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:30.471459 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09214714-4163-4497-997b-2ac683c1a11e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:30.471741 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09214714-4163-4497-997b-2ac683c1a11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:30.475543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab11d27-b6a2-48b0-be10-2783bedc4af6 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:30.488937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-09214714-4163-4497-997b-2ac683c1a11e None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:30.490098 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-09214714-4163-4497-997b-2ac683c1a11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:30.500059 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:30.513070 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdedb2d1-27f4-4f7a-847c-db25ddd11ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:30.513714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedb2d1-27f4-4f7a-847c-db25ddd11ecf None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:30.513998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedb2d1-27f4-4f7a-847c-db25ddd11ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:30.514271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedb2d1-27f4-4f7a-847c-db25ddd11ecf None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:30.514899 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdedb2d1-27f4-4f7a-847c-db25ddd11ecf None admin] RBAC: Adding query filter params (type=compute) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:30.515230 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdedb2d1-27f4-4f7a-847c-db25ddd11ecf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:30.516582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdedb2d1-27f4-4f7a-847c-db25ddd11ecf None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:30.521443 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 509/995] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Aug 9 06:57:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:30.527310 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdedb2d1-27f4-4f7a-847c-db25ddd11ecf None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:30.573484 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 487/996] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 06:57:30.605762 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09214714-4163-4497-997b-2ac683c1a11e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:30.642969 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdedb2d1-27f4-4f7a-847c-db25ddd11ecf None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:30.677740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae51e2-4c5e-4886-8905-ecc92f850d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:30.678334 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae51e2-4c5e-4886-8905-ecc92f850d08 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:30.678606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae51e2-4c5e-4886-8905-ecc92f850d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:30.678872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae51e2-4c5e-4886-8905-ecc92f850d08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:30.679640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae51e2-4c5e-4886-8905-ecc92f850d08 None admin] RBAC: Adding query filter params (interface=public, service_id=0f5be77f41f34504b29f1a970be5db58, region_id=RegionOne) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:30.679888 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae51e2-4c5e-4886-8905-ecc92f850d08 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:30.681226 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae51e2-4c5e-4886-8905-ecc92f850d08 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:30.688089 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 510/997] 10.222.0.40 () {56 vars in 1251 bytes} [Tue Aug 9 06:57:30 2022] GET /identity/v3/endpoints?service_id=0f5be77f41f34504b29f1a970be5db58&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:30.693413 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae51e2-4c5e-4886-8905-ecc92f850d08 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:30.715311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09214714-4163-4497-997b-2ac683c1a11e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:30.733863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:30.752793 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:30.755030 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3ce7d-59a6-4186-b0b6-2781c6ca797e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:30.755744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3ce7d-59a6-4186-b0b6-2781c6ca797e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:30.756056 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3ce7d-59a6-4186-b0b6-2781c6ca797e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:30.756320 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3ce7d-59a6-4186-b0b6-2781c6ca797e None admin] PATH_INFO: `/v3/services/image` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:30.756969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3ce7d-59a6-4186-b0b6-2781c6ca797e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:30.758267 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3ce7d-59a6-4186-b0b6-2781c6ca797e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:30.767433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-64c3ce7d-59a6-4186-b0b6-2781c6ca797e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 06:57:30.767433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:30.767433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:30.767433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:30.767433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:30.767433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:30.767433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:30.767433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:30.767433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 06:57:30.767433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:30.767433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:30.767433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:30.767433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:30.767433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:30.767433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:30.767433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:30.767433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:30.768464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:30.768464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:30.768464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:30.768464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:30.768464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:30.768464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:30.768464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:30.768464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:30.768464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:30.768464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:30.768464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:30.768464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:30.768464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:30.768464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:30.768464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:30.768464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:30.769311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:30.769311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:30.769311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:30.769311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:30.769311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:30.769311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:30.769311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:30.769311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:30.769311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:30.769311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:30.769311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:30.769311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:30.769311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 06:57:30.769311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:30.769311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 488/998] 10.222.0.40 () {56 vars in 1105 bytes} [Tue Aug 9 06:57:30 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:30.775006 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3ce7d-59a6-4186-b0b6-2781c6ca797e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:30.808716 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae51e2-4c5e-4886-8905-ecc92f850d08 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:30.845361 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4810b8-05b7-431e-8b84-1e2f4da1f751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:30.846001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4810b8-05b7-431e-8b84-1e2f4da1f751 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:30.846263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4810b8-05b7-431e-8b84-1e2f4da1f751 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:30.846535 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4810b8-05b7-431e-8b84-1e2f4da1f751 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:30.847196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4810b8-05b7-431e-8b84-1e2f4da1f751 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:30.848509 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4810b8-05b7-431e-8b84-1e2f4da1f751 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:30.855529 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 511/999] 10.222.0.40 () {56 vars in 1087 bytes} [Tue Aug 9 06:57:30 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 06:57:30.889595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3ce7d-59a6-4186-b0b6-2781c6ca797e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:30.928332 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158a570-cd51-4dc5-8fcd-af16beb0058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:30.928956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158a570-cd51-4dc5-8fcd-af16beb0058f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:30.929233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158a570-cd51-4dc5-8fcd-af16beb0058f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:30.929780 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158a570-cd51-4dc5-8fcd-af16beb0058f None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:30.930145 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158a570-cd51-4dc5-8fcd-af16beb0058f None admin] RBAC: Adding query filter params (name=image) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:30.930435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158a570-cd51-4dc5-8fcd-af16beb0058f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:30.931863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158a570-cd51-4dc5-8fcd-af16beb0058f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:30.942976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 489/1000] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:30.944017 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4810b8-05b7-431e-8b84-1e2f4da1f751 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:31.050409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4810b8-05b7-431e-8b84-1e2f4da1f751 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:31.067192 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:31.086761 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2f5b1-95a9-4522-a4e8-c6a0b37d457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:31.087483 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2f5b1-95a9-4522-a4e8-c6a0b37d457f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:31.087830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2f5b1-95a9-4522-a4e8-c6a0b37d457f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:31.088171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2f5b1-95a9-4522-a4e8-c6a0b37d457f None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:31.088962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2f5b1-95a9-4522-a4e8-c6a0b37d457f None admin] RBAC: Adding query filter params (type=image) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:31.089331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2f5b1-95a9-4522-a4e8-c6a0b37d457f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:31.090737 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2f5b1-95a9-4522-a4e8-c6a0b37d457f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:31.095534 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 512/1001] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:30 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:31.786929 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fccbb-98f7-4f2f-96cf-91275944424a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:31.787320 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fccbb-98f7-4f2f-96cf-91275944424a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:31.787505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fccbb-98f7-4f2f-96cf-91275944424a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:31.788980 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 490/1002] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:31.794074 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8526ce-03bf-45a7-be77-384904cab8dc None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:31.794567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8526ce-03bf-45a7-be77-384904cab8dc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:31.794649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8526ce-03bf-45a7-be77-384904cab8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:31.813173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7a8526ce-03bf-45a7-be77-384904cab8dc None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:31.814340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7a8526ce-03bf-45a7-be77-384904cab8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:31.880791 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 513/1003] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:31.903178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fccbb-98f7-4f2f-96cf-91275944424a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:31.949555 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:32.006076 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fccbb-98f7-4f2f-96cf-91275944424a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:32.043204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f699c0-86a1-4057-9bdf-c193b2bc87e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:32.043983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f699c0-86a1-4057-9bdf-c193b2bc87e4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:32.044363 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f699c0-86a1-4057-9bdf-c193b2bc87e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:32.044729 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f699c0-86a1-4057-9bdf-c193b2bc87e4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:32.045404 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f699c0-86a1-4057-9bdf-c193b2bc87e4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:32.046856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f699c0-86a1-4057-9bdf-c193b2bc87e4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:32.055595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-97f699c0-86a1-4057-9bdf-c193b2bc87e4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 06:57:32.055595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:32.055595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:32.055595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:32.055595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:32.055595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:32.055595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:32.055595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:32.055595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 06:57:32.055595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:32.055595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:32.055595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:32.055595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:32.055595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:32.055595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:32.055595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:32.055595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:32.056759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:32.056759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:32.056759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:32.056759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:32.056759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:32.056759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:32.056759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:32.056759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:32.056759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:32.056759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:32.056759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:32.056759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:32.056759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:32.056759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:32.056759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:32.056759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:32.057850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:32.057850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:32.057850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:32.057850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:32.057850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:32.057850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:32.057850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:32.057850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:32.057850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:32.057850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:32.057850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:32.057850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:32.057850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 06:57:32.057850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:32.059741 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 491/1004] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Aug 9 06:57:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:32.065657 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8526ce-03bf-45a7-be77-384904cab8dc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:32.163912 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8526ce-03bf-45a7-be77-384904cab8dc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:32.175552 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:32.200541 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90550941-483d-4069-9d03-7a8a2e1cddac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:32.201019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90550941-483d-4069-9d03-7a8a2e1cddac None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:32.201256 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90550941-483d-4069-9d03-7a8a2e1cddac None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:32.201526 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90550941-483d-4069-9d03-7a8a2e1cddac None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:32.202150 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90550941-483d-4069-9d03-7a8a2e1cddac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:32.202449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90550941-483d-4069-9d03-7a8a2e1cddac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:32.203825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90550941-483d-4069-9d03-7a8a2e1cddac None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:32.208971 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 514/1005] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Aug 9 06:57:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:32.214646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f699c0-86a1-4057-9bdf-c193b2bc87e4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:32.316075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f699c0-86a1-4057-9bdf-c193b2bc87e4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:32.326466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:32.350621 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ef53a-85f2-4ac1-86b4-53e6673bdb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:32.351334 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ef53a-85f2-4ac1-86b4-53e6673bdb22 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:32.351678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ef53a-85f2-4ac1-86b4-53e6673bdb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:32.352013 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ef53a-85f2-4ac1-86b4-53e6673bdb22 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:32.352703 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ef53a-85f2-4ac1-86b4-53e6673bdb22 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:32.353070 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ef53a-85f2-4ac1-86b4-53e6673bdb22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:32.355325 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ef53a-85f2-4ac1-86b4-53e6673bdb22 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:32.364726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 492/1006] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Aug 9 06:57:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:32.365898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90550941-483d-4069-9d03-7a8a2e1cddac None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:32.466696 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90550941-483d-4069-9d03-7a8a2e1cddac None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:32.500401 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033f75a-c374-4f8e-abb5-0b6be798361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:32.501085 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033f75a-c374-4f8e-abb5-0b6be798361e None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:32.501426 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033f75a-c374-4f8e-abb5-0b6be798361e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:32.501761 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033f75a-c374-4f8e-abb5-0b6be798361e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:32.502478 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033f75a-c374-4f8e-abb5-0b6be798361e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:32.503923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033f75a-c374-4f8e-abb5-0b6be798361e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:32.520996 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 515/1007] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 06:57:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:57:32.919220 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e551d2-5fb9-4f75-93cd-40ff24803a5a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:32.919399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e551d2-5fb9-4f75-93cd-40ff24803a5a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:32.919679 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e551d2-5fb9-4f75-93cd-40ff24803a5a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:32.921144 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 493/1008] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:32.926159 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd745c-cdc6-4c83-b381-3907da037adf None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:32.926620 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd745c-cdc6-4c83-b381-3907da037adf None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:32.926697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd745c-cdc6-4c83-b381-3907da037adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:32.944741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f1fd745c-cdc6-4c83-b381-3907da037adf None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:32.945899 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f1fd745c-cdc6-4c83-b381-3907da037adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:32.973248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:33.023932 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 516/1009] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:32 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:33.046714 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e551d2-5fb9-4f75-93cd-40ff24803a5a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:33.150296 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e551d2-5fb9-4f75-93cd-40ff24803a5a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:33.161553 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca76880-687a-46da-84f3-31f2110c2abf None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:33.161843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca76880-687a-46da-84f3-31f2110c2abf None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:33.162119 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca76880-687a-46da-84f3-31f2110c2abf None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:33.163621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 517/1010] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:33.168674 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdbd59-92fc-470f-855b-27fba8cf3045 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:33.168958 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdbd59-92fc-470f-855b-27fba8cf3045 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:33.169285 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdbd59-92fc-470f-855b-27fba8cf3045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:33.186281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fd871-04b5-4b04-a760-e2585b300977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:33.186910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fd871-04b5-4b04-a760-e2585b300977 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:33.187211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fd871-04b5-4b04-a760-e2585b300977 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:33.187467 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8dfdbd59-92fc-470f-855b-27fba8cf3045 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:33.187572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fd871-04b5-4b04-a760-e2585b300977 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:33.188039 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fd871-04b5-4b04-a760-e2585b300977 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:33.188647 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8dfdbd59-92fc-470f-855b-27fba8cf3045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:33.189372 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fd871-04b5-4b04-a760-e2585b300977 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:33.198910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-776fd871-04b5-4b04-a760-e2585b300977 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 06:57:33.198910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:33.198910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:33.198910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:33.198910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:33.198910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:33.198910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:33.198910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:33.198910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 06:57:33.198910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:33.198910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:33.198910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:33.198910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:33.198910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:33.198910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:33.198910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:33.198910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:33.200075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:33.200075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:33.200075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:33.200075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:33.200075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:33.200075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:33.200075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:33.200075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:33.200075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:33.200075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:33.200075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:33.200075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:33.200075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:33.200075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:33.200075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:33.200075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:33.200927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:33.200927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:33.200927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:33.200927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:33.200927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:33.200927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:33.200927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:33.200927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:33.200927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:33.200927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:33.200927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:33.200927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:33.200927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 06:57:33.200927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:33.203400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 494/1011] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:33.205981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fd871-04b5-4b04-a760-e2585b300977 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:33.252686 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:33.263689 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 518/1012] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:33 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 06:57:33.288109 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdbd59-92fc-470f-855b-27fba8cf3045 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:33.315143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fd871-04b5-4b04-a760-e2585b300977 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:33.350953 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d83213-14b6-4f95-8578-f3e33e52dce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:33.351591 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d83213-14b6-4f95-8578-f3e33e52dce7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:33.351866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d83213-14b6-4f95-8578-f3e33e52dce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:33.352121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d83213-14b6-4f95-8578-f3e33e52dce7 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:33.352742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d83213-14b6-4f95-8578-f3e33e52dce7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:33.353039 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d83213-14b6-4f95-8578-f3e33e52dce7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:33.354572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d83213-14b6-4f95-8578-f3e33e52dce7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:33.359474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 495/1013] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Aug 9 06:57:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:33.364776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d83213-14b6-4f95-8578-f3e33e52dce7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:33.381516 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:33.392443 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdbd59-92fc-470f-855b-27fba8cf3045 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:33.429129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6f480-22b8-4ea9-87a1-1af975a4120e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:33.429666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6f480-22b8-4ea9-87a1-1af975a4120e None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:33.429946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6f480-22b8-4ea9-87a1-1af975a4120e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:33.430209 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6f480-22b8-4ea9-87a1-1af975a4120e None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:33.430863 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6f480-22b8-4ea9-87a1-1af975a4120e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:33.432767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6f480-22b8-4ea9-87a1-1af975a4120e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:33.449327 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 519/1014] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Aug 9 06:57:33 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 06:57:33.468387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d83213-14b6-4f95-8578-f3e33e52dce7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:33.470120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:33.514671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112419a3-8535-48f0-96bc-38cfa671e45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:33.515318 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112419a3-8535-48f0-96bc-38cfa671e45d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:33.515595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112419a3-8535-48f0-96bc-38cfa671e45d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:33.515863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112419a3-8535-48f0-96bc-38cfa671e45d None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:33.516492 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112419a3-8535-48f0-96bc-38cfa671e45d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:33.516793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112419a3-8535-48f0-96bc-38cfa671e45d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:33.518180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112419a3-8535-48f0-96bc-38cfa671e45d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:33.529121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 496/1015] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Aug 9 06:57:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:33.530339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6f480-22b8-4ea9-87a1-1af975a4120e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:33.639761 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6f480-22b8-4ea9-87a1-1af975a4120e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:33.675743 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cabd0-e83f-430e-b1a1-f390f64c1c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:33.676351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cabd0-e83f-430e-b1a1-f390f64c1c1c None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:33.676629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cabd0-e83f-430e-b1a1-f390f64c1c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:33.676903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cabd0-e83f-430e-b1a1-f390f64c1c1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:33.677585 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499cabd0-e83f-430e-b1a1-f390f64c1c1c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:33.678925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499cabd0-e83f-430e-b1a1-f390f64c1c1c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:33.700827 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 520/1016] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 06:57:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 06:57:34.551500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865a794-126b-41f6-bc91-d27446db9359 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:34.552015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865a794-126b-41f6-bc91-d27446db9359 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:34.552015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865a794-126b-41f6-bc91-d27446db9359 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:34.553494 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 497/1017] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:34.558429 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fce8f2-3152-4825-86b5-bb64cd5491d7 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:34.558826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fce8f2-3152-4825-86b5-bb64cd5491d7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:34.559024 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fce8f2-3152-4825-86b5-bb64cd5491d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:34.571484 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:34.577836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a1fce8f2-3152-4825-86b5-bb64cd5491d7 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:34.579136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a1fce8f2-3152-4825-86b5-bb64cd5491d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:34.662459 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 521/1018] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 06:57:34.686677 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865a794-126b-41f6-bc91-d27446db9359 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:34.788383 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865a794-126b-41f6-bc91-d27446db9359 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:34.821052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cb3d7-f239-40b7-b80f-20cdf87c3ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:34.821601 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cb3d7-f239-40b7-b80f-20cdf87c3ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:34.821872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cb3d7-f239-40b7-b80f-20cdf87c3ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:34.822138 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cb3d7-f239-40b7-b80f-20cdf87c3ca4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:34.823515 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cb3d7-f239-40b7-b80f-20cdf87c3ca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:34.824926 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cb3d7-f239-40b7-b80f-20cdf87c3ca4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:34.826602 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 498/1019] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:34.832399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fce8f2-3152-4825-86b5-bb64cd5491d7 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:34.936008 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fce8f2-3152-4825-86b5-bb64cd5491d7 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:34.965302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:34.971686 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d4d50-dff1-4801-aab9-718fe9a3aa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:34.972293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d4d50-dff1-4801-aab9-718fe9a3aa56 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:34.972570 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d4d50-dff1-4801-aab9-718fe9a3aa56 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:34.972839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d4d50-dff1-4801-aab9-718fe9a3aa56 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:34.973490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d4d50-dff1-4801-aab9-718fe9a3aa56 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:34.974891 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d4d50-dff1-4801-aab9-718fe9a3aa56 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:35.002115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 522/1020] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Aug 9 06:57:34 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 06:57:35.502143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13241e2a-c0f2-4b08-8dac-79b7d4b941ae None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:35.502526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13241e2a-c0f2-4b08-8dac-79b7d4b941ae None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:35.502742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13241e2a-c0f2-4b08-8dac-79b7d4b941ae None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:35.504280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 499/1021] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:35.509333 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e7358-eb57-4c21-a925-a4a0f358eef0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:35.509679 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e7358-eb57-4c21-a925-a4a0f358eef0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:35.510020 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e7358-eb57-4c21-a925-a4a0f358eef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:35.528535 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-164e7358-eb57-4c21-a925-a4a0f358eef0 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:35.529703 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-164e7358-eb57-4c21-a925-a4a0f358eef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:35.596977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 523/1022] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:35.619787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13241e2a-c0f2-4b08-8dac-79b7d4b941ae None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:35.651104 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:35.723395 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13241e2a-c0f2-4b08-8dac-79b7d4b941ae None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:35.757725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adce5ce-8edc-4334-9ded-5c0ab7ac657a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:35.758256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adce5ce-8edc-4334-9ded-5c0ab7ac657a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:35.758529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adce5ce-8edc-4334-9ded-5c0ab7ac657a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:35.758794 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adce5ce-8edc-4334-9ded-5c0ab7ac657a None admin] PATH_INFO: `/v3/services/image` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:35.759401 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adce5ce-8edc-4334-9ded-5c0ab7ac657a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:35.760872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adce5ce-8edc-4334-9ded-5c0ab7ac657a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:35.769464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6adce5ce-8edc-4334-9ded-5c0ab7ac657a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 06:57:35.769464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:35.769464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:35.769464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:35.769464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:35.769464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:35.769464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:35.769464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:35.769464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 06:57:35.769464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:35.769464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:35.769464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:35.769464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:35.769464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:35.769464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:35.769464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:35.769464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:35.770566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:35.770566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:35.770566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:35.770566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:35.770566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:35.770566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:35.770566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:35.770566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:35.770566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:35.770566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:35.770566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:35.770566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:35.770566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:35.770566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:35.770566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:35.770566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:35.771840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:35.771840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:35.771840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:35.771840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:35.771840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:35.771840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:35.771840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:35.771840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:35.771840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:35.771840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:35.771840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:35.771840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:35.771840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 06:57:35.771840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:35.772970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 500/1023] 10.222.0.40 () {56 vars in 1105 bytes} [Tue Aug 9 06:57:35 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:35.777496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e7358-eb57-4c21-a925-a4a0f358eef0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:35.809092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea6f35-72c5-43c4-8896-daef9c4fb4a4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:35.809369 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea6f35-72c5-43c4-8896-daef9c4fb4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:35.809638 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea6f35-72c5-43c4-8896-daef9c4fb4a4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:35.810971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 501/1024] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:57:35.815845 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea64e32-1ec3-46a9-a346-2fbb5f01e3dd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:35.816118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea64e32-1ec3-46a9-a346-2fbb5f01e3dd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:35.816385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea64e32-1ec3-46a9-a346-2fbb5f01e3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:35.834811 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7ea64e32-1ec3-46a9-a346-2fbb5f01e3dd None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:35.836103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7ea64e32-1ec3-46a9-a346-2fbb5f01e3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:35.886027 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e7358-eb57-4c21-a925-a4a0f358eef0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:35.899462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:35.912315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 502/1025] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:35.921302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d97fd-8d05-4ae7-b190-c985ffbeaca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:35.921954 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d97fd-8d05-4ae7-b190-c985ffbeaca0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:35.922227 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d97fd-8d05-4ae7-b190-c985ffbeaca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:35.922511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d97fd-8d05-4ae7-b190-c985ffbeaca0 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:35.923161 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d97fd-8d05-4ae7-b190-c985ffbeaca0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:35.923462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d97fd-8d05-4ae7-b190-c985ffbeaca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:35.924787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d97fd-8d05-4ae7-b190-c985ffbeaca0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:35.934456 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 524/1026] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:35.936374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d97fd-8d05-4ae7-b190-c985ffbeaca0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:35.936510 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea64e32-1ec3-46a9-a346-2fbb5f01e3dd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:35.965156 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:36.044848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea64e32-1ec3-46a9-a346-2fbb5f01e3dd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:36.047108 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d97fd-8d05-4ae7-b190-c985ffbeaca0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:36.081058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40fda0-bb5f-4ba6-96d6-d1fb63f2e3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:36.081801 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40fda0-bb5f-4ba6-96d6-d1fb63f2e3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:36.082082 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40fda0-bb5f-4ba6-96d6-d1fb63f2e3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:36.082354 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40fda0-bb5f-4ba6-96d6-d1fb63f2e3c1 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:36.082920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd09fa9-1337-4655-a8c8-0b78566420ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:36.083037 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40fda0-bb5f-4ba6-96d6-d1fb63f2e3c1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:36.083298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40fda0-bb5f-4ba6-96d6-d1fb63f2e3c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:36.083577 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd09fa9-1337-4655-a8c8-0b78566420ac None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:36.083862 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd09fa9-1337-4655-a8c8-0b78566420ac None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:36.084130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd09fa9-1337-4655-a8c8-0b78566420ac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:36.084652 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40fda0-bb5f-4ba6-96d6-d1fb63f2e3c1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:36.089888 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 503/1027] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:36.095527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40fda0-bb5f-4ba6-96d6-d1fb63f2e3c1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:36.095806 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd09fa9-1337-4655-a8c8-0b78566420ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:57:36.101138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-2fd09fa9-1337-4655-a8c8-0b78566420ac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 06:57:36.101138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:36.101138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:36.101138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:36.101138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:36.101138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:36.101138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:36.101138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:36.101138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:36.101138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:36.101138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:36.101138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:36.101138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:57:36.101138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:57:36.101138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:57:36.101138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:57:36.102127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:57:36.102127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:57:36.102127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:57:36.102127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:57:36.102127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:36.102127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:36.102127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:36.102127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:36.102127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:36.102127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:36.102127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:36.102127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:36.102127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:36.102127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:36.102127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:36.102127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:36.103012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:36.103012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:36.103012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:36.103012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:36.103012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:57:36.103012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:57:36.103012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:57:36.103012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:57:36.103012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:57:36.103012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:57:36.103012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 06:57:36.103012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:36.103012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 525/1028] 10.222.0.40 () {56 vars in 1120 bytes} [Tue Aug 9 06:57:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:36.109776 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd09fa9-1337-4655-a8c8-0b78566420ac None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:36.153788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:36.192136 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:36.207108 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40fda0-bb5f-4ba6-96d6-d1fb63f2e3c1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:36.225607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd09fa9-1337-4655-a8c8-0b78566420ac None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:36.241887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc3637-967e-43e5-912d-0261cb727a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:36.242497 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc3637-967e-43e5-912d-0261cb727a22 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:36.242773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc3637-967e-43e5-912d-0261cb727a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:36.243039 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc3637-967e-43e5-912d-0261cb727a22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:36.243780 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc3637-967e-43e5-912d-0261cb727a22 None admin] RBAC: Adding query filter params (interface=public, service_id=bab66fcc8d2849b7b77b562077c9d25c, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:36.244087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc3637-967e-43e5-912d-0261cb727a22 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:36.246402 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc3637-967e-43e5-912d-0261cb727a22 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:36.256043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 504/1029] 10.222.0.40 () {56 vars in 1251 bytes} [Tue Aug 9 06:57:36 2022] GET /identity/v3/endpoints?service_id=bab66fcc8d2849b7b77b562077c9d25c&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:36.256944 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc3637-967e-43e5-912d-0261cb727a22 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:36.265053 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae72dcd-f6be-4bc0-ae57-78a167472c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:36.265660 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae72dcd-f6be-4bc0-ae57-78a167472c68 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:36.265939 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae72dcd-f6be-4bc0-ae57-78a167472c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:36.266282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae72dcd-f6be-4bc0-ae57-78a167472c68 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:36.266941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae72dcd-f6be-4bc0-ae57-78a167472c68 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:36.267302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae72dcd-f6be-4bc0-ae57-78a167472c68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:36.268847 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae72dcd-f6be-4bc0-ae57-78a167472c68 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:36.282103 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 526/1030] 10.222.0.40 () {56 vars in 1115 bytes} [Tue Aug 9 06:57:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:36.283176 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae72dcd-f6be-4bc0-ae57-78a167472c68 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:36.371434 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc3637-967e-43e5-912d-0261cb727a22 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:36.388457 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:36.391759 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae72dcd-f6be-4bc0-ae57-78a167472c68 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:36.408876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04f059-1924-4f3d-a9a0-5d482d40c0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:36.409478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04f059-1924-4f3d-a9a0-5d482d40c0ac None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:36.409875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04f059-1924-4f3d-a9a0-5d482d40c0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:36.410163 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04f059-1924-4f3d-a9a0-5d482d40c0ac None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:36.410787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04f059-1924-4f3d-a9a0-5d482d40c0ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:36.412174 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04f059-1924-4f3d-a9a0-5d482d40c0ac None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:36.420150 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 505/1031] 10.222.0.40 () {56 vars in 1087 bytes} [Tue Aug 9 06:57:36 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 06:57:36.435752 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484ef89-a8b8-4b45-b161-c7b0584f20c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:36.436507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484ef89-a8b8-4b45-b161-c7b0584f20c7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:36.436858 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484ef89-a8b8-4b45-b161-c7b0584f20c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:36.437196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484ef89-a8b8-4b45-b161-c7b0584f20c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:36.450952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484ef89-a8b8-4b45-b161-c7b0584f20c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:36.452480 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484ef89-a8b8-4b45-b161-c7b0584f20c7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:36.468925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-1484ef89-a8b8-4b45-b161-c7b0584f20c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:36.468925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:36.468925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:36.468925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:36.468925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:36.468925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:36.468925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:36.468925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:36.468925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:36.468925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:36.468925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:36.468925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:36.468925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:36.468925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:36.468925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:36.468925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:36.469962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:36.469962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:36.469962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:36.469962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:36.469962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:36.469962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:36.469962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:36.469962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:36.469962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:36.469962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:36.469962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:36.469962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:36.469962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:36.469962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:36.469962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:36.469962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:36.469962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:36.476226 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:36.476226 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:36.476226 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:36.476226 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 527/1032] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:36.477722 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04f059-1924-4f3d-a9a0-5d482d40c0ac None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:36.499883 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:36.589552 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04f059-1924-4f3d-a9a0-5d482d40c0ac None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:36.626839 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9daaafa-004e-4d25-a68d-c5bbc9c6166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:36.627491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daaafa-004e-4d25-a68d-c5bbc9c6166e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:36.627653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daaafa-004e-4d25-a68d-c5bbc9c6166e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:36.627921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daaafa-004e-4d25-a68d-c5bbc9c6166e None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:36.628558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9daaafa-004e-4d25-a68d-c5bbc9c6166e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:36.628852 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9daaafa-004e-4d25-a68d-c5bbc9c6166e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:36.630197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9daaafa-004e-4d25-a68d-c5bbc9c6166e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:36.643147 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 506/1033] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:36.648480 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484ef89-a8b8-4b45-b161-c7b0584f20c7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:36.752451 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484ef89-a8b8-4b45-b161-c7b0584f20c7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:36.786447 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca0aa7-1d4a-4b36-83c5-2d8dbcabe6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:36.787070 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca0aa7-1d4a-4b36-83c5-2d8dbcabe6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:36.787375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca0aa7-1d4a-4b36-83c5-2d8dbcabe6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:36.787645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca0aa7-1d4a-4b36-83c5-2d8dbcabe6a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:36.795787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca0aa7-1d4a-4b36-83c5-2d8dbcabe6a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:36.797205 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca0aa7-1d4a-4b36-83c5-2d8dbcabe6a4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:36.808133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-49ca0aa7-1d4a-4b36-83c5-2d8dbcabe6a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 06:57:36.808133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:36.808133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:36.808133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:36.808133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:36.808133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:36.808133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:36.808133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:36.808133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:36.808133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:36.808133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:36.808133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:36.808133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:57:36.808133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:57:36.808133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:57:36.808133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:57:36.809113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:36.809113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:36.809113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:57:36.809113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:36.809113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:57:36.809113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:36.809113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:36.809113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:36.809113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:36.809113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:36.809113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:36.809113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:36.809113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:36.809113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:36.809113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:36.809113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:36.809113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:36.809113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:36.810104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:36.810104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:36.810104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:57:36.810104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:57:36.810104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:57:36.810104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:57:36.810104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:57:36.810104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:57:36.810104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 06:57:36.810104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:36.810104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 528/1034] 10.222.0.40 () {56 vars in 1093 bytes} [Tue Aug 9 06:57:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:36.816915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9daaafa-004e-4d25-a68d-c5bbc9c6166e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:36.898900 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:36.927707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9daaafa-004e-4d25-a68d-c5bbc9c6166e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:36.964068 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daad6e-a5d9-40df-bf67-e12f87e59fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:36.964678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daad6e-a5d9-40df-bf67-e12f87e59fbd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:36.964957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daad6e-a5d9-40df-bf67-e12f87e59fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:36.965226 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daad6e-a5d9-40df-bf67-e12f87e59fbd None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:36.965941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4daad6e-a5d9-40df-bf67-e12f87e59fbd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:36.966245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4daad6e-a5d9-40df-bf67-e12f87e59fbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:36.967706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4daad6e-a5d9-40df-bf67-e12f87e59fbd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:36.990060 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 507/1035] 10.222.0.40 () {56 vars in 1133 bytes} [Tue Aug 9 06:57:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:36.991526 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca0aa7-1d4a-4b36-83c5-2d8dbcabe6a4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:37.007525 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:37.074963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef157d-6599-4620-bb57-3fd34c56b57e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:37.075349 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef157d-6599-4620-bb57-3fd34c56b57e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:37.075526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef157d-6599-4620-bb57-3fd34c56b57e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:37.076847 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 508/1036] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:37.081941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31e968-f0af-4d0b-a629-0f157387a210 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:37.082222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31e968-f0af-4d0b-a629-0f157387a210 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:37.082493 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31e968-f0af-4d0b-a629-0f157387a210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:37.095885 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca0aa7-1d4a-4b36-83c5-2d8dbcabe6a4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:37.099986 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9e31e968-f0af-4d0b-a629-0f157387a210 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:37.101211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9e31e968-f0af-4d0b-a629-0f157387a210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:37.136780 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f9136-aa74-4b24-853c-28b3ed3b6a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:37.138046 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f9136-aa74-4b24-853c-28b3ed3b6a53 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:37.138526 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f9136-aa74-4b24-853c-28b3ed3b6a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:37.138995 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f9136-aa74-4b24-853c-28b3ed3b6a53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:37.175405 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 509/1037] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 06:57:37.197241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31e968-f0af-4d0b-a629-0f157387a210 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:37.210756 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f9136-aa74-4b24-853c-28b3ed3b6a53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:37.212215 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f9136-aa74-4b24-853c-28b3ed3b6a53 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:37.228296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:37.261327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:37.301759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31e968-f0af-4d0b-a629-0f157387a210 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:37.320604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 529/1038] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:57:36 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 06:57:37.326534 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f9136-aa74-4b24-853c-28b3ed3b6a53 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:37.340349 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114ce2b-9c3f-4566-a666-910b9162e435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:37.340979 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114ce2b-9c3f-4566-a666-910b9162e435 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:37.341259 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114ce2b-9c3f-4566-a666-910b9162e435 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:37.341532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114ce2b-9c3f-4566-a666-910b9162e435 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:37.342627 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114ce2b-9c3f-4566-a666-910b9162e435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:37.344083 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114ce2b-9c3f-4566-a666-910b9162e435 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:37.345634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 510/1039] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:37.351168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114ce2b-9c3f-4566-a666-910b9162e435 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:37.440003 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f9136-aa74-4b24-853c-28b3ed3b6a53 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:37.455097 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:37.455263 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114ce2b-9c3f-4566-a666-910b9162e435 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:37.479734 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187af45-7f96-4c82-8021-65a0376bcbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:37.480474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187af45-7f96-4c82-8021-65a0376bcbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:37.480770 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187af45-7f96-4c82-8021-65a0376bcbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:37.481037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187af45-7f96-4c82-8021-65a0376bcbe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:37.487340 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:37.491346 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187af45-7f96-4c82-8021-65a0376bcbe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:37.492785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187af45-7f96-4c82-8021-65a0376bcbe4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:37.494118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee178b99-077f-471b-8ffb-04b4c5f1b1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:37.495893 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee178b99-077f-471b-8ffb-04b4c5f1b1e2 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:37.496357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee178b99-077f-471b-8ffb-04b4c5f1b1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:37.496823 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee178b99-077f-471b-8ffb-04b4c5f1b1e2 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:37.497637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee178b99-077f-471b-8ffb-04b4c5f1b1e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:37.499262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee178b99-077f-471b-8ffb-04b4c5f1b1e2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:37.507343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-d187af45-7f96-4c82-8021-65a0376bcbe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:37.507343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:37.507343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:37.507343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:37.507343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:37.507343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:37.507343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:37.507343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:37.507343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:37.507343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:37.507343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:37.507343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:37.507343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:37.507343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:37.507343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:37.507343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:37.508299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:37.508299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:37.508299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:37.508299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:37.508299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:37.508299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:37.508299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:37.508299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:37.508299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:37.508299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:37.508299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:37.508299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:37.508299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:37.508299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:37.508299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:37.508299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:37.508299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:37.509235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:37.509235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:37.509235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:37.511425 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 530/1040] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:37.515685 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187af45-7f96-4c82-8021-65a0376bcbe4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:37.526581 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 511/1041] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Aug 9 06:57:37 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:57:37.647159 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187af45-7f96-4c82-8021-65a0376bcbe4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:37.685454 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8d40b-3352-4380-827f-3eac26b9e1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:37.686074 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8d40b-3352-4380-827f-3eac26b9e1ad None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:37.686329 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8d40b-3352-4380-827f-3eac26b9e1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:37.686597 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8d40b-3352-4380-827f-3eac26b9e1ad None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:37.687330 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8d40b-3352-4380-827f-3eac26b9e1ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:37.687633 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8d40b-3352-4380-827f-3eac26b9e1ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:37.688973 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8d40b-3352-4380-827f-3eac26b9e1ad None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:37.702204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 531/1042] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:37.708086 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee178b99-077f-471b-8ffb-04b4c5f1b1e2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:37.814034 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee178b99-077f-471b-8ffb-04b4c5f1b1e2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:37.847609 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c88bb-d87f-4412-acbc-8daf119a49ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:37.848236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c88bb-d87f-4412-acbc-8daf119a49ce None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:37.848514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c88bb-d87f-4412-acbc-8daf119a49ce None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:37.848782 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c88bb-d87f-4412-acbc-8daf119a49ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:37.855558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c88bb-d87f-4412-acbc-8daf119a49ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:37.856989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c88bb-d87f-4412-acbc-8daf119a49ce None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:37.867879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f60c88bb-d87f-4412-acbc-8daf119a49ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:37.867879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:37.867879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:37.867879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:37.867879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:37.867879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:37.867879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:37.867879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:37.867879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:37.867879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:37.867879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:37.867879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:37.867879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:57:37.867879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:57:37.867879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:57:37.868793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:57:37.868793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:37.868793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:37.868793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:37.868793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:37.868793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:37.868793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:37.868793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:37.868793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:37.868793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:37.868793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:37.868793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:37.868793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:37.868793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:37.868793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:37.868793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:37.868793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:37.870567 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:57:37.870567 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:57:37.870567 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:57:37.870567 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:57:37.870567 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:57:37.870567 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:57:37.870567 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:37.870567 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:37.870567 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 512/1043] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:37.876895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8d40b-3352-4380-827f-3eac26b9e1ad None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:37.902724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:37.979120 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8d40b-3352-4380-827f-3eac26b9e1ad None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:38.014322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541eb723-79ef-4c09-a1f4-32827b2089d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:38.014932 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541eb723-79ef-4c09-a1f4-32827b2089d4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:38.015242 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541eb723-79ef-4c09-a1f4-32827b2089d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:38.015513 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541eb723-79ef-4c09-a1f4-32827b2089d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:38.017058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541eb723-79ef-4c09-a1f4-32827b2089d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:38.017390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541eb723-79ef-4c09-a1f4-32827b2089d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:38.018822 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541eb723-79ef-4c09-a1f4-32827b2089d4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:38.037914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 532/1044] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:57:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:38.039384 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c88bb-d87f-4412-acbc-8daf119a49ce None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:38.090758 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:38.143691 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c88bb-d87f-4412-acbc-8daf119a49ce None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:38.177815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70d502-411d-4802-af26-5cc579a56809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:38.178476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70d502-411d-4802-af26-5cc579a56809 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:38.178745 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70d502-411d-4802-af26-5cc579a56809 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:38.179009 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70d502-411d-4802-af26-5cc579a56809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:38.179758 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70d502-411d-4802-af26-5cc579a56809 None admin] RBAC: Adding query filter params (role.id=03e6aa0df3364e0f8f7179debccb832b, scope.project.id=342524b45def418783374ff6733e94b9, user.id=6e949d9666be44a0b6122d510168c7ab) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:38.180065 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70d502-411d-4802-af26-5cc579a56809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:38.181488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70d502-411d-4802-af26-5cc579a56809 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:38.195137 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 513/1045] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:57:38 2022] GET /identity/v3/role_assignments?user.id=6e949d9666be44a0b6122d510168c7ab&scope.project.id=342524b45def418783374ff6733e94b9&role.id=03e6aa0df3364e0f8f7179debccb832b => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:38.477799 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d69cfa-9bef-444a-a66f-1d7af1ade28d None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:38.478178 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d69cfa-9bef-444a-a66f-1d7af1ade28d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:38.478375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d69cfa-9bef-444a-a66f-1d7af1ade28d None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:38.480055 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 533/1046] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:38.485040 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec84da-6ff5-4a0f-b50b-d6d7fca009e4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:38.485327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec84da-6ff5-4a0f-b50b-d6d7fca009e4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:38.485738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec84da-6ff5-4a0f-b50b-d6d7fca009e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:38.504362 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1eec84da-6ff5-4a0f-b50b-d6d7fca009e4 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:38.505525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1eec84da-6ff5-4a0f-b50b-d6d7fca009e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:38.571750 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 514/1047] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 06:57:38.594570 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d69cfa-9bef-444a-a66f-1d7af1ade28d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:38.697028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:38.717629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d69cfa-9bef-444a-a66f-1d7af1ade28d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:38.751987 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a9c48-270c-4cf4-9f0b-f7ee2879b63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:38.752843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a9c48-270c-4cf4-9f0b-f7ee2879b63e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:38.753272 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a9c48-270c-4cf4-9f0b-f7ee2879b63e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:38.753688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a9c48-270c-4cf4-9f0b-f7ee2879b63e None admin] PATH_INFO: `/v3/services/image` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:38.754416 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a9c48-270c-4cf4-9f0b-f7ee2879b63e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:38.755960 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a9c48-270c-4cf4-9f0b-f7ee2879b63e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:38.765233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-c90a9c48-270c-4cf4-9f0b-f7ee2879b63e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 06:57:38.765233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:38.765233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:57:38.765233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:57:38.765233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:57:38.765233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:57:38.765233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:57:38.765233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:38.765233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 06:57:38.765233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:38.765233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:57:38.765233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:38.765233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:38.765233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:38.765233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:38.765233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:38.765233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:38.766449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:38.766449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:38.766449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:38.766449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:38.766449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:38.766449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:38.766449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:57:38.766449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:57:38.766449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:57:38.766449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:57:38.766449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:38.766449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:38.766449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:38.766449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:38.766449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:38.766449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:38.767540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:38.767540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:38.767540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:38.767540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:38.767540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:38.767540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:38.767540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:38.767540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:38.767540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:38.767540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:38.767540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:57:38.767540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:57:38.767540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 06:57:38.767540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:38.769646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 534/1048] 10.222.0.40 () {56 vars in 1105 bytes} [Tue Aug 9 06:57:38 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:38.775901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec84da-6ff5-4a0f-b50b-d6d7fca009e4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:38.819762 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:38.878236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec84da-6ff5-4a0f-b50b-d6d7fca009e4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:38.911104 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0f537-5834-4450-88d1-05bd942d7598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:38.911732 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0f537-5834-4450-88d1-05bd942d7598 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:38.912004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0f537-5834-4450-88d1-05bd942d7598 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:38.912272 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0f537-5834-4450-88d1-05bd942d7598 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:38.912883 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0f537-5834-4450-88d1-05bd942d7598 None admin] RBAC: Adding query filter params (name=image) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:38.913182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0f537-5834-4450-88d1-05bd942d7598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:38.914530 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0f537-5834-4450-88d1-05bd942d7598 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:38.919956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 515/1049] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:38.925433 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a9c48-270c-4cf4-9f0b-f7ee2879b63e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:39.026947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a9c48-270c-4cf4-9f0b-f7ee2879b63e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:39.061396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed01743-34e5-4cd4-a408-a8a615f7b28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:39.061998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed01743-34e5-4cd4-a408-a8a615f7b28a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:39.062276 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed01743-34e5-4cd4-a408-a8a615f7b28a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:39.062546 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed01743-34e5-4cd4-a408-a8a615f7b28a None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:39.063195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed01743-34e5-4cd4-a408-a8a615f7b28a None admin] RBAC: Adding query filter params (type=image) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:39.063500 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed01743-34e5-4cd4-a408-a8a615f7b28a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:39.064856 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed01743-34e5-4cd4-a408-a8a615f7b28a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:39.074468 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 535/1050] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:39.075413 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0f537-5834-4450-88d1-05bd942d7598 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:39.175513 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0f537-5834-4450-88d1-05bd942d7598 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:39.182625 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:39.211017 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cd022-279b-4360-aaa0-7cfa074e708e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:39.211648 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cd022-279b-4360-aaa0-7cfa074e708e None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:39.211925 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cd022-279b-4360-aaa0-7cfa074e708e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:39.212195 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cd022-279b-4360-aaa0-7cfa074e708e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:39.212862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cd022-279b-4360-aaa0-7cfa074e708e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:39.214741 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cd022-279b-4360-aaa0-7cfa074e708e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:39.243111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 516/1051] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 06:57:39 2022] POST /identity/v3/endpoints => generated 327 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 06:57:39.616518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb661a-07bb-4664-be86-50b7bba427d6 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:39.616518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb661a-07bb-4664-be86-50b7bba427d6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:39.616518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb661a-07bb-4664-be86-50b7bba427d6 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:39.616877 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 536/1052] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:39.622666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f46fac-20ff-49ac-a34f-7b1ab2fc180c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:39.622950 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f46fac-20ff-49ac-a34f-7b1ab2fc180c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:39.623256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f46fac-20ff-49ac-a34f-7b1ab2fc180c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:39.645214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-38f46fac-20ff-49ac-a34f-7b1ab2fc180c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:39.646391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-38f46fac-20ff-49ac-a34f-7b1ab2fc180c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:39.727427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 517/1053] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 06:57:39.749218 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb661a-07bb-4664-be86-50b7bba427d6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:39.764627 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:39.857620 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb661a-07bb-4664-be86-50b7bba427d6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:39.892375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df279e1-52c3-4c85-b9ba-be36a7b7c54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:39.893002 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df279e1-52c3-4c85-b9ba-be36a7b7c54f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:39.893278 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df279e1-52c3-4c85-b9ba-be36a7b7c54f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:39.893544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df279e1-52c3-4c85-b9ba-be36a7b7c54f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:39.904352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df279e1-52c3-4c85-b9ba-be36a7b7c54f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:57:39.909198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-1df279e1-52c3-4c85-b9ba-be36a7b7c54f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:57:39.909198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:39.909198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:39.909198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:39.909198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:39.909198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:39.909198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:39.909198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:39.909198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:39.909198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:39.909198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:39.909198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:39.909198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:57:39.909198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:57:39.909198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:57:39.909198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:57:39.910155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:57:39.910155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:57:39.910155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:57:39.910155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:57:39.910155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:39.910155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:39.910155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:39.910155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:39.910155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:39.910155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:39.910155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:39.910155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:39.910155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:39.910155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:39.910155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:39.910155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:39.911040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:39.911040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:39.911040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:39.911040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:39.911040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:57:39.911040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:57:39.911040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:57:39.911040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:57:39.911040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:57:39.911040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:57:39.911040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:57:39.911040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:39.912438 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 537/1054] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:57:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:39.916612 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f46fac-20ff-49ac-a34f-7b1ab2fc180c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:40.004593 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:40.019285 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f46fac-20ff-49ac-a34f-7b1ab2fc180c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:40.053256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871e23c-c8bf-439b-87e0-551a06fe0d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:40.053866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871e23c-c8bf-439b-87e0-551a06fe0d02 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:40.054145 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871e23c-c8bf-439b-87e0-551a06fe0d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:40.054424 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871e23c-c8bf-439b-87e0-551a06fe0d02 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:40.055168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871e23c-c8bf-439b-87e0-551a06fe0d02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:40.055471 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871e23c-c8bf-439b-87e0-551a06fe0d02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:40.057406 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871e23c-c8bf-439b-87e0-551a06fe0d02 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:40.070283 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 518/1055] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:57:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:40.071526 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df279e1-52c3-4c85-b9ba-be36a7b7c54f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:40.143282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:40.173348 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df279e1-52c3-4c85-b9ba-be36a7b7c54f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:40.200336 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a005d0-035c-4677-a6ec-2ad760b98cdf None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:40.200631 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a005d0-035c-4677-a6ec-2ad760b98cdf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:40.200886 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a005d0-035c-4677-a6ec-2ad760b98cdf None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:40.202355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 519/1056] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:57:40.207351 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a6936-7b48-4dda-9bab-25b8b6edd881 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:40.207685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a6936-7b48-4dda-9bab-25b8b6edd881 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:40.207910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a6936-7b48-4dda-9bab-25b8b6edd881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:40.208335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbee00d-2a88-473d-aced-bc5cb2d46e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:40.208957 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbee00d-2a88-473d-aced-bc5cb2d46e9d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:40.209228 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbee00d-2a88-473d-aced-bc5cb2d46e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:40.209496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbee00d-2a88-473d-aced-bc5cb2d46e9d None admin] PATH_INFO: `/v3/users/280295a832f648e2b4df52ad4a07ef99` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:40.224429 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbee00d-2a88-473d-aced-bc5cb2d46e9d None admin] RBAC: Authorizing `identity:get_user(user_id=280295a832f648e2b4df52ad4a07ef99)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:40.225650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d16a6936-7b48-4dda-9bab-25b8b6edd881 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:40.225962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbee00d-2a88-473d-aced-bc5cb2d46e9d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:40.226840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d16a6936-7b48-4dda-9bab-25b8b6edd881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:40.227767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 538/1057] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:57:40 2022] GET /identity/v3/users/280295a832f648e2b4df52ad4a07ef99 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:40.233345 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbee00d-2a88-473d-aced-bc5cb2d46e9d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:40.297765 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 520/1058] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 06:57:40.320937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a6936-7b48-4dda-9bab-25b8b6edd881 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:40.335076 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbee00d-2a88-473d-aced-bc5cb2d46e9d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:40.366733 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:40.374961 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb663720-b2e8-4a3b-a03a-d41f51659678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:40.375598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb663720-b2e8-4a3b-a03a-d41f51659678 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:40.375866 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb663720-b2e8-4a3b-a03a-d41f51659678 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:40.376128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb663720-b2e8-4a3b-a03a-d41f51659678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:40.411685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:40.432677 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a6936-7b48-4dda-9bab-25b8b6edd881 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:40.457441 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb663720-b2e8-4a3b-a03a-d41f51659678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:40.459360 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb663720-b2e8-4a3b-a03a-d41f51659678 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:40.468973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0c4e5-02b1-41dd-88bc-ac2a0462ac28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:40.469610 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0c4e5-02b1-41dd-88bc-ac2a0462ac28 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:40.469887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0c4e5-02b1-41dd-88bc-ac2a0462ac28 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:40.470155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0c4e5-02b1-41dd-88bc-ac2a0462ac28 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:40.482132 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0c4e5-02b1-41dd-88bc-ac2a0462ac28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:57:40.486770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-25b0c4e5-02b1-41dd-88bc-ac2a0462ac28 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 06:57:40.486770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:40.486770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:40.486770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:40.486770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:40.486770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:40.486770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:40.486770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:40.486770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:40.486770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:40.486770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:40.486770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:40.486770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:57:40.486770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:57:40.486770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:57:40.486770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:57:40.487760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:57:40.487760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:57:40.487760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:57:40.487760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:57:40.487760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:40.487760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:40.487760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:40.487760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:40.487760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:40.487760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:40.487760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:40.487760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:40.487760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:40.487760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:40.487760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:40.487760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:40.488613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:40.488613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:40.488613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:40.488613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:40.488613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:57:40.488613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:57:40.488613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:57:40.488613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:57:40.488613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:57:40.488613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:57:40.488613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 06:57:40.488613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:40.488613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 521/1059] 10.222.0.40 () {56 vars in 1120 bytes} [Tue Aug 9 06:57:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:40.495016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0c4e5-02b1-41dd-88bc-ac2a0462ac28 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:40.574290 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 539/1060] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:57:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 06:57:40.575694 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb663720-b2e8-4a3b-a03a-d41f51659678 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:40.596022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0c4e5-02b1-41dd-88bc-ac2a0462ac28 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:40.605636 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:40.637613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c3c88-aa37-4a97-ab9d-a89337445cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:40.638227 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c3c88-aa37-4a97-ab9d-a89337445cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:40.638507 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c3c88-aa37-4a97-ab9d-a89337445cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:40.638777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c3c88-aa37-4a97-ab9d-a89337445cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:40.639469 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c3c88-aa37-4a97-ab9d-a89337445cb2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:40.640033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c3c88-aa37-4a97-ab9d-a89337445cb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:40.641132 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c3c88-aa37-4a97-ab9d-a89337445cb2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:40.649213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 522/1061] 10.222.0.40 () {56 vars in 1115 bytes} [Tue Aug 9 06:57:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:40.655465 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c3c88-aa37-4a97-ab9d-a89337445cb2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:40.661888 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:40.687584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb663720-b2e8-4a3b-a03a-d41f51659678 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:40.727059 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799921b-f7d2-46f3-b614-6f757d1367a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:40.727719 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799921b-f7d2-46f3-b614-6f757d1367a2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:40.727989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799921b-f7d2-46f3-b614-6f757d1367a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:40.728252 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799921b-f7d2-46f3-b614-6f757d1367a2 None admin] PATH_INFO: `/v3/projects/dea45cc1e93b4c72a414ba8135ec72c6` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:40.729809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799921b-f7d2-46f3-b614-6f757d1367a2 None admin] RBAC: Authorizing `identity:get_project(project_id=dea45cc1e93b4c72a414ba8135ec72c6)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:40.731255 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799921b-f7d2-46f3-b614-6f757d1367a2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:40.733365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 540/1062] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:57:40 2022] GET /identity/v3/projects/dea45cc1e93b4c72a414ba8135ec72c6 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:40.739920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799921b-f7d2-46f3-b614-6f757d1367a2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:40.769245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c3c88-aa37-4a97-ab9d-a89337445cb2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:40.804604 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba700b2f-0009-4a08-84e7-fb770efa0dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:40.805252 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba700b2f-0009-4a08-84e7-fb770efa0dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:40.805504 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba700b2f-0009-4a08-84e7-fb770efa0dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:40.805776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba700b2f-0009-4a08-84e7-fb770efa0dc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:40.817214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba700b2f-0009-4a08-84e7-fb770efa0dc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:40.818688 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba700b2f-0009-4a08-84e7-fb770efa0dc1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:40.833199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ba700b2f-0009-4a08-84e7-fb770efa0dc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:40.833199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:40.833199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:40.833199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:40.833199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:40.833199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:40.833199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:40.833199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:40.833199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:40.833199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:40.833199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:40.833199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:40.833199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:40.833199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:40.833199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:40.833199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:40.834211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:40.834211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:40.834211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:40.834211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:40.834211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:40.834211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:40.834211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:40.834211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:40.834211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:40.834211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:40.834211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:40.834211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:40.834211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:40.834211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:40.834211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:40.834211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:40.834211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:40.835579 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:40.835579 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:40.835579 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:40.839570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 523/1063] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:40.840923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba700b2f-0009-4a08-84e7-fb770efa0dc1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:40.843340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:40.847423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799921b-f7d2-46f3-b614-6f757d1367a2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:40.889138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812b605-1593-4491-915d-0093de6cbc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:40.889948 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812b605-1593-4491-915d-0093de6cbc5f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:40.890224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812b605-1593-4491-915d-0093de6cbc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:40.890601 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812b605-1593-4491-915d-0093de6cbc5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:40.891359 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812b605-1593-4491-915d-0093de6cbc5f None admin] RBAC: Adding query filter params (role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.project.id=dea45cc1e93b4c72a414ba8135ec72c6, user.id=280295a832f648e2b4df52ad4a07ef99) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:40.891664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812b605-1593-4491-915d-0093de6cbc5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:40.893109 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812b605-1593-4491-915d-0093de6cbc5f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:40.896022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:40.911122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 541/1064] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:57:40 2022] GET /identity/v3/role_assignments?user.id=280295a832f648e2b4df52ad4a07ef99&scope.project.id=dea45cc1e93b4c72a414ba8135ec72c6&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:40.962764 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba700b2f-0009-4a08-84e7-fb770efa0dc1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:40.999556 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62937afa-b103-49ff-a414-f45d962f3e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:41.000182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62937afa-b103-49ff-a414-f45d962f3e62 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:41.000474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62937afa-b103-49ff-a414-f45d962f3e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:41.000792 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62937afa-b103-49ff-a414-f45d962f3e62 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:41.001512 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62937afa-b103-49ff-a414-f45d962f3e62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:41.001872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62937afa-b103-49ff-a414-f45d962f3e62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:41.003348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62937afa-b103-49ff-a414-f45d962f3e62 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:41.021704 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 524/1065] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:41.023295 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812b605-1593-4491-915d-0093de6cbc5f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:41.126487 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812b605-1593-4491-915d-0093de6cbc5f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:41.160981 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0a637-2bf9-4e06-8e8f-669ecefdd6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:41.161961 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0a637-2bf9-4e06-8e8f-669ecefdd6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:41.162435 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0a637-2bf9-4e06-8e8f-669ecefdd6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:41.162921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0a637-2bf9-4e06-8e8f-669ecefdd6c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:41.170752 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0a637-2bf9-4e06-8e8f-669ecefdd6c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:41.172454 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0a637-2bf9-4e06-8e8f-669ecefdd6c7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:41.183941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-2bb0a637-2bf9-4e06-8e8f-669ecefdd6c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 06:57:41.183941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:41.183941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:41.183941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:41.183941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:41.183941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:41.183941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:41.183941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:41.183941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:41.183941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:41.183941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:41.183941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:41.183941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:57:41.183941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:57:41.183941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:57:41.183941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:57:41.184920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:41.184920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:41.184920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:57:41.184920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:41.184920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:57:41.184920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:41.184920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:41.184920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:41.184920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:41.184920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:41.184920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:41.184920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:41.184920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:41.184920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:41.184920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:41.184920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:41.184920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:41.184920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:41.185884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:41.185884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:41.185884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:57:41.185884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:57:41.185884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:57:41.185884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:57:41.185884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:57:41.185884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:57:41.185884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 06:57:41.185884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:41.192780 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 542/1066] 10.222.0.40 () {56 vars in 1093 bytes} [Tue Aug 9 06:57:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:41.194063 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62937afa-b103-49ff-a414-f45d962f3e62 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:41.301486 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62937afa-b103-49ff-a414-f45d962f3e62 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:41.317397 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:41.324351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b9ca7-bacd-43c3-9d11-7afb01e05338 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:41.324640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b9ca7-bacd-43c3-9d11-7afb01e05338 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:41.324898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b9ca7-bacd-43c3-9d11-7afb01e05338 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:41.326365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 543/1067] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:57:41.331683 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca39d6-7be7-451f-9965-cc00f1f7727d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:41.331969 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca39d6-7be7-451f-9965-cc00f1f7727d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:41.332243 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca39d6-7be7-451f-9965-cc00f1f7727d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:41.340827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c41655-5f63-4ea3-8856-94788fd6656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:41.341442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c41655-5f63-4ea3-8856-94788fd6656e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:41.343387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c41655-5f63-4ea3-8856-94788fd6656e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:41.343387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c41655-5f63-4ea3-8856-94788fd6656e None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:41.343387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c41655-5f63-4ea3-8856-94788fd6656e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:41.343387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c41655-5f63-4ea3-8856-94788fd6656e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:41.344423 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c41655-5f63-4ea3-8856-94788fd6656e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:41.350691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-afca39d6-7be7-451f-9965-cc00f1f7727d None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:41.351912 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-afca39d6-7be7-451f-9965-cc00f1f7727d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:41.367140 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 525/1068] 10.222.0.40 () {56 vars in 1133 bytes} [Tue Aug 9 06:57:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:41.368224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c41655-5f63-4ea3-8856-94788fd6656e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:41.374423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:41.431118 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 544/1069] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 06:57:41.449331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca39d6-7be7-451f-9965-cc00f1f7727d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:41.480983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c41655-5f63-4ea3-8856-94788fd6656e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:41.519031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ee191-ab08-41c0-9b50-9c8915bb0a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:41.519684 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ee191-ab08-41c0-9b50-9c8915bb0a3c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:41.519960 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ee191-ab08-41c0-9b50-9c8915bb0a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:41.520230 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ee191-ab08-41c0-9b50-9c8915bb0a3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:41.535045 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ee191-ab08-41c0-9b50-9c8915bb0a3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:41.536673 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ee191-ab08-41c0-9b50-9c8915bb0a3c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:41.552379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-071ee191-ab08-41c0-9b50-9c8915bb0a3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:41.552379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:41.552379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:41.552379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:41.552379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:41.552379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:41.552379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:41.552379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:41.552379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:41.552379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:41.552379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:41.552379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:41.552379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:41.552379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:41.552379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:41.552379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:41.553617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:41.553617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:41.553617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:41.553617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:41.553617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:41.553617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:41.553617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:41.553617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:41.553617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:41.553617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:41.553617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:41.553617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:41.553617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:41.553617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:41.553617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:41.553617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:41.553617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:41.554744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:41.554744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:41.554744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:41.554957 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca39d6-7be7-451f-9965-cc00f1f7727d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:41.555905 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 526/1070] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:41.561314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ee191-ab08-41c0-9b50-9c8915bb0a3c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:41.587726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:41.592828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e97a84-ed94-4202-ada5-b083e9b4be7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:41.593713 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e97a84-ed94-4202-ada5-b083e9b4be7f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:41.593994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e97a84-ed94-4202-ada5-b083e9b4be7f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:41.594260 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e97a84-ed94-4202-ada5-b083e9b4be7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:41.624032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:41.675639 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ee191-ab08-41c0-9b50-9c8915bb0a3c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:41.678217 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e97a84-ed94-4202-ada5-b083e9b4be7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:41.679772 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e97a84-ed94-4202-ada5-b083e9b4be7f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:41.713110 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e8e91-ef8d-4875-8ac2-b0c632104ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:41.713986 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e8e91-ef8d-4875-8ac2-b0c632104ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:41.714260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e8e91-ef8d-4875-8ac2-b0c632104ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:41.714529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e8e91-ef8d-4875-8ac2-b0c632104ae1 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:41.715182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e8e91-ef8d-4875-8ac2-b0c632104ae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:41.715478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e8e91-ef8d-4875-8ac2-b0c632104ae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:41.716822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e8e91-ef8d-4875-8ac2-b0c632104ae1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:41.732943 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 527/1071] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:41.733931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e8e91-ef8d-4875-8ac2-b0c632104ae1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:41.787133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 545/1072] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:57:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 06:57:41.792306 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e97a84-ed94-4202-ada5-b083e9b4be7f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:41.820463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:41.838233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e8e91-ef8d-4875-8ac2-b0c632104ae1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:41.845099 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:41.876724 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eda337-fa77-491e-9577-d2568df0410c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:41.877603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda337-fa77-491e-9577-d2568df0410c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:41.878022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda337-fa77-491e-9577-d2568df0410c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:41.878430 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda337-fa77-491e-9577-d2568df0410c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:41.886491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eda337-fa77-491e-9577-d2568df0410c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:41.887934 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eda337-fa77-491e-9577-d2568df0410c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:41.895967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e97a84-ed94-4202-ada5-b083e9b4be7f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:41.898887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-73eda337-fa77-491e-9577-d2568df0410c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:41.898887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:41.898887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:41.898887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:41.898887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:41.898887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:41.898887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:41.898887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:41.898887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:41.898887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:41.898887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:41.898887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:41.898887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:57:41.898887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:57:41.898887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:57:41.899804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:57:41.899804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:41.899804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:41.899804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:41.899804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:41.899804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:41.899804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:41.899804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:41.899804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:41.899804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:41.899804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:41.899804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:41.899804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:41.899804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:41.899804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:41.899804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:41.899804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:41.900921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:57:41.900921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:57:41.900921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:57:41.900921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:57:41.900921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:57:41.900921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:57:41.900921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:41.900921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:41.900921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 528/1073] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:41.905852 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eda337-fa77-491e-9577-d2568df0410c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:41.936848 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566ff0d-bee7-4eb8-94ee-357c136e9161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:41.937467 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566ff0d-bee7-4eb8-94ee-357c136e9161 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:41.937745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566ff0d-bee7-4eb8-94ee-357c136e9161 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:41.938012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566ff0d-bee7-4eb8-94ee-357c136e9161 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:41.949406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566ff0d-bee7-4eb8-94ee-357c136e9161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:41.950838 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566ff0d-bee7-4eb8-94ee-357c136e9161 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:41.970129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3566ff0d-bee7-4eb8-94ee-357c136e9161 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:41.970129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:41.970129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:41.970129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:41.970129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:41.970129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:41.970129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:41.970129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:41.970129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:41.970129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:41.970129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:41.970129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:41.970129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:41.970129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:41.970129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:41.970129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:41.971182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:41.971182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:41.971182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:41.971182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:41.971182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:41.971182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:41.971182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:41.971182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:41.971182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:41.971182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:41.971182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:41.971182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:41.971182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:41.971182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:41.971182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:41.971182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:41.971182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:41.972111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:41.972111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:41.972111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:41.972111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 546/1074] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:41.977015 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566ff0d-bee7-4eb8-94ee-357c136e9161 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:42.014008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eda337-fa77-491e-9577-d2568df0410c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:42.052854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5499fcc-455d-486f-8d61-329588da6fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:42.053769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5499fcc-455d-486f-8d61-329588da6fee None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:42.054220 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5499fcc-455d-486f-8d61-329588da6fee None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:42.054663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5499fcc-455d-486f-8d61-329588da6fee None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:42.055570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5499fcc-455d-486f-8d61-329588da6fee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:42.056087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5499fcc-455d-486f-8d61-329588da6fee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:42.057563 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5499fcc-455d-486f-8d61-329588da6fee None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:42.070390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 529/1075] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:57:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:42.076665 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5499fcc-455d-486f-8d61-329588da6fee None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:42.081167 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:42.085104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566ff0d-bee7-4eb8-94ee-357c136e9161 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:42.088553 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:42.122438 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a9146-ec04-4886-9b0d-18e2031813e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:42.123046 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a9146-ec04-4886-9b0d-18e2031813e1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:42.123367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a9146-ec04-4886-9b0d-18e2031813e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:42.123640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a9146-ec04-4886-9b0d-18e2031813e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:42.124336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a9146-ec04-4886-9b0d-18e2031813e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:42.124642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a9146-ec04-4886-9b0d-18e2031813e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:42.125985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a9146-ec04-4886-9b0d-18e2031813e1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:42.147132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 547/1076] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:42.193546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5499fcc-455d-486f-8d61-329588da6fee None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:42.231382 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955aa235-b925-4f0e-95d5-9bcf9d59ad7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:42.232051 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955aa235-b925-4f0e-95d5-9bcf9d59ad7b None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:42.232325 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955aa235-b925-4f0e-95d5-9bcf9d59ad7b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:42.232590 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955aa235-b925-4f0e-95d5-9bcf9d59ad7b None admin] PATH_INFO: `/v3/projects/342524b45def418783374ff6733e94b9/users/6e949d9666be44a0b6122d510168c7ab/roles/03e6aa0df3364e0f8f7179debccb832b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:42.234755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955aa235-b925-4f0e-95d5-9bcf9d59ad7b None admin] RBAC: Authorizing `identity:create_grant(project_id=342524b45def418783374ff6733e94b9, user_id=6e949d9666be44a0b6122d510168c7ab, role_id=03e6aa0df3364e0f8f7179debccb832b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:42.236222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955aa235-b925-4f0e-95d5-9bcf9d59ad7b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:42.251075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 530/1077] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:57:42 2022] PUT /identity/v3/projects/342524b45def418783374ff6733e94b9/users/6e949d9666be44a0b6122d510168c7ab/roles/03e6aa0df3364e0f8f7179debccb832b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 06:57:42.892312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5e103-ddae-49cd-b2a0-5eba8ea0f007 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:42.892820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5e103-ddae-49cd-b2a0-5eba8ea0f007 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:42.892820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5e103-ddae-49cd-b2a0-5eba8ea0f007 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:42.894230 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 548/1078] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:42.899272 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf855b1-a26b-4631-85ba-0bc342f79936 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:42.899561 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf855b1-a26b-4631-85ba-0bc342f79936 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:42.899840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf855b1-a26b-4631-85ba-0bc342f79936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:42.918762 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ccf855b1-a26b-4631-85ba-0bc342f79936 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:42.919974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ccf855b1-a26b-4631-85ba-0bc342f79936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:42.977177 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:42.987346 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 531/1079] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:43.009412 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5e103-ddae-49cd-b2a0-5eba8ea0f007 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:43.116937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5e103-ddae-49cd-b2a0-5eba8ea0f007 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:43.148575 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e31c79-98ef-44d3-ba11-434fb4a753c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:43.149116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e31c79-98ef-44d3-ba11-434fb4a753c9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:43.149386 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e31c79-98ef-44d3-ba11-434fb4a753c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:43.149648 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e31c79-98ef-44d3-ba11-434fb4a753c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:43.159768 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e31c79-98ef-44d3-ba11-434fb4a753c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:57:43.164312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-c0e31c79-98ef-44d3-ba11-434fb4a753c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:57:43.164312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:43.164312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:43.164312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:43.164312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:43.164312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:43.164312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:43.164312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:43.164312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:43.164312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:43.164312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:43.164312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:43.164312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:57:43.164312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:57:43.164312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:57:43.164312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:57:43.165405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:57:43.165405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:57:43.165405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:57:43.165405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:57:43.165405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:43.165405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:43.165405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:43.165405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:43.165405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:43.165405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:43.165405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:43.165405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:43.165405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:43.165405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:43.165405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:43.165405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:43.166486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:43.166486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:43.166486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:43.166486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:43.166486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:57:43.166486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:57:43.166486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:57:43.166486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:57:43.166486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:57:43.166486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:57:43.166486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:57:43.166486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:43.166486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 549/1080] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:57:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:43.172182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf855b1-a26b-4631-85ba-0bc342f79936 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:43.268742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf855b1-a26b-4631-85ba-0bc342f79936 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:43.302473 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5520286-e8a0-4802-bbe0-8c27faab6687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:43.303071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5520286-e8a0-4802-bbe0-8c27faab6687 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:43.303378 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5520286-e8a0-4802-bbe0-8c27faab6687 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:43.303641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5520286-e8a0-4802-bbe0-8c27faab6687 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:43.304290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5520286-e8a0-4802-bbe0-8c27faab6687 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:43.304588 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5520286-e8a0-4802-bbe0-8c27faab6687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:43.305962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5520286-e8a0-4802-bbe0-8c27faab6687 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:43.313925 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 532/1081] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:57:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:43.319734 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e31c79-98ef-44d3-ba11-434fb4a753c9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:43.346038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:43.420030 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e31c79-98ef-44d3-ba11-434fb4a753c9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:43.454616 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1303aa-9701-45ce-8712-0d865894cd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:43.455279 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1303aa-9701-45ce-8712-0d865894cd1b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:43.455561 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1303aa-9701-45ce-8712-0d865894cd1b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:43.455833 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1303aa-9701-45ce-8712-0d865894cd1b None admin] PATH_INFO: `/v3/users/280295a832f648e2b4df52ad4a07ef99` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:43.456991 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1303aa-9701-45ce-8712-0d865894cd1b None admin] RBAC: Authorizing `identity:get_user(user_id=280295a832f648e2b4df52ad4a07ef99)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:43.458438 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1303aa-9701-45ce-8712-0d865894cd1b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:43.460108 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 550/1082] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:57:43 2022] GET /identity/v3/users/280295a832f648e2b4df52ad4a07ef99 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:43.466750 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5520286-e8a0-4802-bbe0-8c27faab6687 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:43.525967 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:43.569300 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5520286-e8a0-4802-bbe0-8c27faab6687 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:43.602721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182b02f-5bae-474e-9b6b-d781288c4639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:43.603399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182b02f-5bae-474e-9b6b-d781288c4639 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:43.603807 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182b02f-5bae-474e-9b6b-d781288c4639 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:43.604182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182b02f-5bae-474e-9b6b-d781288c4639 None admin] PATH_INFO: `/v3/projects/dea45cc1e93b4c72a414ba8135ec72c6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:43.605215 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182b02f-5bae-474e-9b6b-d781288c4639 None admin] RBAC: Authorizing `identity:get_project(project_id=dea45cc1e93b4c72a414ba8135ec72c6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:43.606657 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182b02f-5bae-474e-9b6b-d781288c4639 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:43.608295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 533/1083] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:57:43 2022] GET /identity/v3/projects/dea45cc1e93b4c72a414ba8135ec72c6 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:43.614179 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1303aa-9701-45ce-8712-0d865894cd1b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:43.703075 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:43.712401 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1303aa-9701-45ce-8712-0d865894cd1b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:43.744948 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c5805-d10c-47df-abad-85d2edf8f741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:43.745663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c5805-d10c-47df-abad-85d2edf8f741 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:43.745940 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c5805-d10c-47df-abad-85d2edf8f741 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:43.746206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c5805-d10c-47df-abad-85d2edf8f741 None admin] PATH_INFO: `/v3/projects/dea45cc1e93b4c72a414ba8135ec72c6/users/280295a832f648e2b4df52ad4a07ef99/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:43.751621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c5805-d10c-47df-abad-85d2edf8f741 None admin] RBAC: Authorizing `identity:create_grant(project_id=dea45cc1e93b4c72a414ba8135ec72c6, user_id=280295a832f648e2b4df52ad4a07ef99, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:43.753908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c5805-d10c-47df-abad-85d2edf8f741 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:43.767397 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 551/1084] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:57:43 2022] PUT /identity/v3/projects/dea45cc1e93b4c72a414ba8135ec72c6/users/280295a832f648e2b4df52ad4a07ef99/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:57:44.333943 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa05d30-e2ea-4c19-bb00-2c94e51239f4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:44.334544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa05d30-e2ea-4c19-bb00-2c94e51239f4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:44.334544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa05d30-e2ea-4c19-bb00-2c94e51239f4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:44.335833 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 534/1085] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:44.341223 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563132d-896f-48bf-8d77-883101d7cb28 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:44.341607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563132d-896f-48bf-8d77-883101d7cb28 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:44.341786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563132d-896f-48bf-8d77-883101d7cb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:44.359902 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0563132d-896f-48bf-8d77-883101d7cb28 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:44.361062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0563132d-896f-48bf-8d77-883101d7cb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:44.425062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 552/1086] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:44.448177 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa05d30-e2ea-4c19-bb00-2c94e51239f4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:44.553879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa05d30-e2ea-4c19-bb00-2c94e51239f4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:44.576559 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:44.587654 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16736bfe-028a-4dcf-aab7-b39d3ccbd4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:44.588728 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16736bfe-028a-4dcf-aab7-b39d3ccbd4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:44.589001 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16736bfe-028a-4dcf-aab7-b39d3ccbd4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:44.589267 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16736bfe-028a-4dcf-aab7-b39d3ccbd4b7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:44.599295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16736bfe-028a-4dcf-aab7-b39d3ccbd4b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:57:44.604050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-16736bfe-028a-4dcf-aab7-b39d3ccbd4b7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 06:57:44.604050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:44.604050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:44.604050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:44.604050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:44.604050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:44.604050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:44.604050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:44.604050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:44.604050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:44.604050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:44.604050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:44.604050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:57:44.604050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:57:44.604050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:57:44.604050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:57:44.605347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:57:44.605347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:57:44.605347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:57:44.605347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:57:44.605347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:44.605347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:44.605347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:44.605347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:44.605347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:44.605347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:44.605347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:44.605347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:44.605347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:44.605347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:44.605347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:44.605347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:44.606222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:44.606222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:44.606222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:44.606222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:44.606222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:57:44.606222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:57:44.606222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:57:44.606222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:57:44.606222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:57:44.606222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:57:44.606222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 06:57:44.606222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:44.606222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 535/1087] 10.222.0.40 () {56 vars in 1120 bytes} [Tue Aug 9 06:57:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:44.611331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563132d-896f-48bf-8d77-883101d7cb28 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:44.688292 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:44.707710 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563132d-896f-48bf-8d77-883101d7cb28 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:44.740109 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae31348-ab1b-4275-a844-fe799417da14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:44.740707 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae31348-ab1b-4275-a844-fe799417da14 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:44.740985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae31348-ab1b-4275-a844-fe799417da14 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:44.741256 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae31348-ab1b-4275-a844-fe799417da14 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:44.741929 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae31348-ab1b-4275-a844-fe799417da14 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:44.742217 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae31348-ab1b-4275-a844-fe799417da14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:44.743833 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae31348-ab1b-4275-a844-fe799417da14 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:44.752990 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 553/1088] 10.222.0.40 () {56 vars in 1115 bytes} [Tue Aug 9 06:57:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:44.758859 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16736bfe-028a-4dcf-aab7-b39d3ccbd4b7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:44.858853 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16736bfe-028a-4dcf-aab7-b39d3ccbd4b7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:44.892563 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34164f20-1acd-45ed-a800-eea9e7e3b0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:44.893263 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34164f20-1acd-45ed-a800-eea9e7e3b0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:44.893539 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34164f20-1acd-45ed-a800-eea9e7e3b0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:44.893808 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34164f20-1acd-45ed-a800-eea9e7e3b0d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:44.903514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34164f20-1acd-45ed-a800-eea9e7e3b0d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:44.904949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34164f20-1acd-45ed-a800-eea9e7e3b0d1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:44.919335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-34164f20-1acd-45ed-a800-eea9e7e3b0d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:44.919335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:44.919335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:44.919335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:44.919335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:44.919335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:44.919335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:44.919335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:44.919335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:44.919335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:44.919335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:44.919335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:44.919335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:44.919335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:44.919335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:44.919335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:44.925237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:44.925237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:44.925237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:44.925237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:44.925237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:44.925237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:44.925237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:44.925237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:44.925237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:44.925237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:44.925237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:44.925237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:44.925237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:44.925237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:44.925237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:44.925237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:44.925237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:44.926459 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:44.926459 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:44.926459 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:44.926459 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 536/1089] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:44.926710 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae31348-ab1b-4275-a844-fe799417da14 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:45.024006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae31348-ab1b-4275-a844-fe799417da14 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:45.060318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072d1e3-6f30-401c-a223-6f23bd8c35e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:45.060910 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072d1e3-6f30-401c-a223-6f23bd8c35e1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:45.061184 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072d1e3-6f30-401c-a223-6f23bd8c35e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:45.061452 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072d1e3-6f30-401c-a223-6f23bd8c35e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:45.062077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072d1e3-6f30-401c-a223-6f23bd8c35e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:45.062371 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072d1e3-6f30-401c-a223-6f23bd8c35e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:45.066251 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072d1e3-6f30-401c-a223-6f23bd8c35e1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:45.080440 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 554/1090] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:45.086123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34164f20-1acd-45ed-a800-eea9e7e3b0d1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:45.120647 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:45.184540 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34164f20-1acd-45ed-a800-eea9e7e3b0d1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:45.216805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d92d6-a9a3-4df3-ad3f-9b53a1bbe395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:45.217415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d92d6-a9a3-4df3-ad3f-9b53a1bbe395 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:45.217686 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d92d6-a9a3-4df3-ad3f-9b53a1bbe395 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:45.217951 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d92d6-a9a3-4df3-ad3f-9b53a1bbe395 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:45.224997 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d92d6-a9a3-4df3-ad3f-9b53a1bbe395 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:45.226464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d92d6-a9a3-4df3-ad3f-9b53a1bbe395 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:45.237388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-727d92d6-a9a3-4df3-ad3f-9b53a1bbe395 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 06:57:45.237388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:45.237388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:45.237388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:45.237388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:45.237388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:45.237388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:45.237388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:45.237388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:45.237388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:45.237388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:45.237388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:45.237388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:57:45.237388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:57:45.237388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:57:45.237388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:57:45.238337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:45.238337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:45.238337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:57:45.238337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:45.238337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:57:45.238337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:57:45.238337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:45.238337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:45.238337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:45.238337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:45.238337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:45.238337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:45.238337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:45.238337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:45.238337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:45.238337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:45.238337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:45.238337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:45.239355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:45.239355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:45.239355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:57:45.239355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:57:45.239355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:57:45.239355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:57:45.239355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:57:45.239355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:57:45.239355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 06:57:45.239355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:45.239355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 537/1091] 10.222.0.40 () {56 vars in 1093 bytes} [Tue Aug 9 06:57:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:45.245010 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072d1e3-6f30-401c-a223-6f23bd8c35e1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:45.249716 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:45.343560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072d1e3-6f30-401c-a223-6f23bd8c35e1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:45.378238 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796612cc-379e-4925-8c0b-27d03f14157e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:45.378750 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796612cc-379e-4925-8c0b-27d03f14157e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:45.379022 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796612cc-379e-4925-8c0b-27d03f14157e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:45.379314 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796612cc-379e-4925-8c0b-27d03f14157e None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:45.380033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796612cc-379e-4925-8c0b-27d03f14157e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:45.380330 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796612cc-379e-4925-8c0b-27d03f14157e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:45.381719 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796612cc-379e-4925-8c0b-27d03f14157e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:45.398456 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 555/1092] 10.222.0.40 () {56 vars in 1133 bytes} [Tue Aug 9 06:57:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:45.404889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d92d6-a9a3-4df3-ad3f-9b53a1bbe395 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:45.497984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:45.504370 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d92d6-a9a3-4df3-ad3f-9b53a1bbe395 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:45.536882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46809094-1a5d-413d-a955-da2c7e97b6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:45.537473 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46809094-1a5d-413d-a955-da2c7e97b6ee None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:45.537746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46809094-1a5d-413d-a955-da2c7e97b6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:45.538010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46809094-1a5d-413d-a955-da2c7e97b6ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:45.602238 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46809094-1a5d-413d-a955-da2c7e97b6ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:45.603746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46809094-1a5d-413d-a955-da2c7e97b6ee None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:45.700236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:45.708668 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 538/1093] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:57:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 06:57:45.715668 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796612cc-379e-4925-8c0b-27d03f14157e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:45.758231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03998372-ea49-43e3-ab9f-be6e7342a9a7 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:45.758512 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03998372-ea49-43e3-ab9f-be6e7342a9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:45.758783 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03998372-ea49-43e3-ab9f-be6e7342a9a7 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:45.761144 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 539/1094] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:57:45.766000 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a092227-4634-4e40-8153-b9c883683db1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:45.766280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a092227-4634-4e40-8153-b9c883683db1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:45.766552 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a092227-4634-4e40-8153-b9c883683db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:45.776798 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:45.785345 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8a092227-4634-4e40-8153-b9c883683db1 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:45.786523 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8a092227-4634-4e40-8153-b9c883683db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:45.814174 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796612cc-379e-4925-8c0b-27d03f14157e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:45.848131 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e338b6-9e36-4d49-aca5-c32d42164c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:45.848753 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e338b6-9e36-4d49-aca5-c32d42164c34 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:45.849028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e338b6-9e36-4d49-aca5-c32d42164c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:45.849297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e338b6-9e36-4d49-aca5-c32d42164c34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:45.852743 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 540/1095] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 06:57:45.859253 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e338b6-9e36-4d49-aca5-c32d42164c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:45.860674 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e338b6-9e36-4d49-aca5-c32d42164c34 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:45.874554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-51e338b6-9e36-4d49-aca5-c32d42164c34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:45.874554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:45.874554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:45.874554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:45.874554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:45.874554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:45.874554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:45.874554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:45.874554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:45.874554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:45.874554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:45.874554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:45.874554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:57:45.874554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:57:45.874554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:57:45.874554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:57:45.875697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:45.875697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:45.875697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:45.875697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:45.875697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:45.875697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:45.875697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:45.875697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:45.875697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:45.875697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:45.875697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:45.875697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:45.875697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:45.875697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:45.875697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:45.875697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:45.875697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:57:45.876817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:57:45.876817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:57:45.876817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:57:45.876993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a092227-4634-4e40-8153-b9c883683db1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:45.877067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 556/1096] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:45.881025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e338b6-9e36-4d49-aca5-c32d42164c34 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:45.974401 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a092227-4634-4e40-8153-b9c883683db1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:45.979042 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e338b6-9e36-4d49-aca5-c32d42164c34 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:45.991919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:45.999894 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:46.011493 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278b518-5287-4f2c-89e1-ffebfbb7ca46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:46.012122 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278b518-5287-4f2c-89e1-ffebfbb7ca46 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:46.012400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278b518-5287-4f2c-89e1-ffebfbb7ca46 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:46.012668 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278b518-5287-4f2c-89e1-ffebfbb7ca46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:46.014792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de7317-9a84-4284-86c3-c17c2468e9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:46.015413 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de7317-9a84-4284-86c3-c17c2468e9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:46.015689 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de7317-9a84-4284-86c3-c17c2468e9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:46.015952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de7317-9a84-4284-86c3-c17c2468e9c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:46.016583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de7317-9a84-4284-86c3-c17c2468e9c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:46.016876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de7317-9a84-4284-86c3-c17c2468e9c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:46.018208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de7317-9a84-4284-86c3-c17c2468e9c4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:46.022550 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278b518-5287-4f2c-89e1-ffebfbb7ca46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:57:46.027368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e278b518-5287-4f2c-89e1-ffebfbb7ca46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:57:46.027368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:46.027368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:46.027368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:46.027368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:46.027368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:46.027368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:46.027368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:46.027368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:46.027368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:46.027368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:46.027368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:46.027368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:57:46.027368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:57:46.027368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:57:46.027368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:57:46.028387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:57:46.028387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:57:46.028387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:57:46.028387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:57:46.028387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:46.028387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:46.028387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:46.028387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:46.028387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:46.028387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:46.028387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:46.028387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:46.028387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:46.028387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:46.028387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:46.028387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:46.029258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:46.029258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:46.029258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:46.029258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:46.029258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:57:46.029258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:57:46.029258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:57:46.029258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:57:46.029258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:57:46.029258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:57:46.029258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:57:46.029258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:46.034578 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 557/1097] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:46.034699 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 541/1098] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:57:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:57:46.034786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de7317-9a84-4284-86c3-c17c2468e9c4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:46.035537 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278b518-5287-4f2c-89e1-ffebfbb7ca46 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:46.133331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de7317-9a84-4284-86c3-c17c2468e9c4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:46.133650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278b518-5287-4f2c-89e1-ffebfbb7ca46 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:46.166700 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f310c5c-e08e-4c09-bb42-f5fbf7b34b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:46.167316 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f310c5c-e08e-4c09-bb42-f5fbf7b34b5e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:46.167582 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd05c5c-590c-4ea5-b2df-9741e00b0c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:46.167695 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f310c5c-e08e-4c09-bb42-f5fbf7b34b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:46.167846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f310c5c-e08e-4c09-bb42-f5fbf7b34b5e None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:46.168198 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd05c5c-590c-4ea5-b2df-9741e00b0c3b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:46.168474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd05c5c-590c-4ea5-b2df-9741e00b0c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:46.168577 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f310c5c-e08e-4c09-bb42-f5fbf7b34b5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:46.168742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd05c5c-590c-4ea5-b2df-9741e00b0c3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:46.168836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f310c5c-e08e-4c09-bb42-f5fbf7b34b5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:46.170094 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f310c5c-e08e-4c09-bb42-f5fbf7b34b5e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:46.175319 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd05c5c-590c-4ea5-b2df-9741e00b0c3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:46.176725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd05c5c-590c-4ea5-b2df-9741e00b0c3b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:46.178063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 558/1099] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:57:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:46.184437 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f310c5c-e08e-4c09-bb42-f5fbf7b34b5e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:46.188815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1dd05c5c-590c-4ea5-b2df-9741e00b0c3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:46.188815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:57:46.188815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:57:46.188815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:57:46.188815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:57:46.188815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:57:46.188815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:57:46.188815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:57:46.188815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:57:46.188815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:57:46.188815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:57:46.188815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:57:46.188815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:57:46.188815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:57:46.188815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:57:46.189904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:57:46.189904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:57:46.189904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:57:46.189904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:57:46.189904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:57:46.189904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:57:46.189904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:57:46.189904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:57:46.189904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:57:46.189904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:57:46.189904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:57:46.189904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:57:46.189904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:57:46.189904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:57:46.189904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:57:46.189904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:57:46.189904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:57:46.191033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:57:46.191033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:57:46.191033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:57:46.191033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:57:46.191033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:57:46.191033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:57:46.191033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:57:46.191033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:57:46.194743 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 542/1100] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:57:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:57:46.195411 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd05c5c-590c-4ea5-b2df-9741e00b0c3b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:46.218842 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:46.242385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:46.284565 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f310c5c-e08e-4c09-bb42-f5fbf7b34b5e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:46.296072 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd05c5c-590c-4ea5-b2df-9741e00b0c3b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:46.319246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327bbea4-526b-4e01-9a68-645424d0153a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:46.319874 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bbea4-526b-4e01-9a68-645424d0153a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:46.320151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bbea4-526b-4e01-9a68-645424d0153a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:46.320422 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bbea4-526b-4e01-9a68-645424d0153a None admin] PATH_INFO: `/v3/users/280295a832f648e2b4df52ad4a07ef99` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:46.321551 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327bbea4-526b-4e01-9a68-645424d0153a None admin] RBAC: Authorizing `identity:get_user(user_id=280295a832f648e2b4df52ad4a07ef99)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:46.323682 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327bbea4-526b-4e01-9a68-645424d0153a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:46.325263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 559/1101] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:57:46 2022] GET /identity/v3/users/280295a832f648e2b4df52ad4a07ef99 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:46.331299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327bbea4-526b-4e01-9a68-645424d0153a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:46.338267 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b81c15-6493-4934-8177-9aff6da986bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:46.338535 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b81c15-6493-4934-8177-9aff6da986bb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:46.338811 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b81c15-6493-4934-8177-9aff6da986bb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:46.339098 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b81c15-6493-4934-8177-9aff6da986bb None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:46.339790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b81c15-6493-4934-8177-9aff6da986bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:46.340091 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b81c15-6493-4934-8177-9aff6da986bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:46.341536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b81c15-6493-4934-8177-9aff6da986bb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:46.353155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 543/1102] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:57:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:46.359912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b81c15-6493-4934-8177-9aff6da986bb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:46.441238 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327bbea4-526b-4e01-9a68-645424d0153a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:46.443529 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:46.456948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b81c15-6493-4934-8177-9aff6da986bb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:46.464317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:46.478083 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132a3bd-616c-4970-be80-d1c1344e3194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:46.479271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132a3bd-616c-4970-be80-d1c1344e3194 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:46.479551 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132a3bd-616c-4970-be80-d1c1344e3194 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:46.479822 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132a3bd-616c-4970-be80-d1c1344e3194 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:46.491281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd7da0-dfbe-4175-9433-8ba39937024d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:46.491873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd7da0-dfbe-4175-9433-8ba39937024d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:46.492150 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd7da0-dfbe-4175-9433-8ba39937024d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:46.492473 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd7da0-dfbe-4175-9433-8ba39937024d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:46.493116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd7da0-dfbe-4175-9433-8ba39937024d None admin] RBAC: Adding query filter params (role.id=03e6aa0df3364e0f8f7179debccb832b, scope.project.id=342524b45def418783374ff6733e94b9, user.id=6e949d9666be44a0b6122d510168c7ab) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:46.493419 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd7da0-dfbe-4175-9433-8ba39937024d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:46.495440 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd7da0-dfbe-4175-9433-8ba39937024d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:46.501135 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 544/1103] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:57:46 2022] GET /identity/v3/role_assignments?user.id=6e949d9666be44a0b6122d510168c7ab&scope.project.id=342524b45def418783374ff6733e94b9&role.id=03e6aa0df3364e0f8f7179debccb832b => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:46.551150 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132a3bd-616c-4970-be80-d1c1344e3194 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:46.552635 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132a3bd-616c-4970-be80-d1c1344e3194 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:46.660271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 560/1104] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:57:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 06:57:46.669224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd7da0-dfbe-4175-9433-8ba39937024d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:46.772559 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd7da0-dfbe-4175-9433-8ba39937024d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:46.806032 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df9457-3685-4e79-9b87-47abde9b2bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:46.807406 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df9457-3685-4e79-9b87-47abde9b2bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:46.807697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df9457-3685-4e79-9b87-47abde9b2bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:46.807972 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df9457-3685-4e79-9b87-47abde9b2bf8 None admin] PATH_INFO: `/v3/projects/dea45cc1e93b4c72a414ba8135ec72c6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:46.810710 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df9457-3685-4e79-9b87-47abde9b2bf8 None admin] RBAC: Authorizing `identity:get_project(project_id=dea45cc1e93b4c72a414ba8135ec72c6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:46.810710 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df9457-3685-4e79-9b87-47abde9b2bf8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:46.812445 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 545/1105] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:57:46 2022] GET /identity/v3/projects/dea45cc1e93b4c72a414ba8135ec72c6 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:46.818423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132a3bd-616c-4970-be80-d1c1344e3194 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:46.822693 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:46.917557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132a3bd-616c-4970-be80-d1c1344e3194 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:46.962460 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc2713-bbbf-485b-854e-3bffc911d95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:46.963071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc2713-bbbf-485b-854e-3bffc911d95b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:46.963652 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc2713-bbbf-485b-854e-3bffc911d95b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:46.963927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc2713-bbbf-485b-854e-3bffc911d95b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:46.964662 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc2713-bbbf-485b-854e-3bffc911d95b None admin] RBAC: Adding query filter params (role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.project.id=dea45cc1e93b4c72a414ba8135ec72c6, user.id=280295a832f648e2b4df52ad4a07ef99) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:46.964967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc2713-bbbf-485b-854e-3bffc911d95b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:46.966375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc2713-bbbf-485b-854e-3bffc911d95b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:46.972449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 561/1106] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:57:46 2022] GET /identity/v3/role_assignments?user.id=280295a832f648e2b4df52ad4a07ef99&scope.project.id=dea45cc1e93b4c72a414ba8135ec72c6&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:48.991614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9976406-4130-4f9a-984c-f3661eaa7453 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:48.992202 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9976406-4130-4f9a-984c-f3661eaa7453 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:48.992202 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9976406-4130-4f9a-984c-f3661eaa7453 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:48.993462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 546/1107] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:48.998499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee8714-6fa8-4aaa-a630-c5deb3fc98bf None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:48.998903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee8714-6fa8-4aaa-a630-c5deb3fc98bf None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:48.999036 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee8714-6fa8-4aaa-a630-c5deb3fc98bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:49.016434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6cee8714-6fa8-4aaa-a630-c5deb3fc98bf None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:49.017605 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6cee8714-6fa8-4aaa-a630-c5deb3fc98bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:49.076219 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:49.082005 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 562/1108] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:49.106326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9976406-4130-4f9a-984c-f3661eaa7453 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:49.146510 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:49.203709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9976406-4130-4f9a-984c-f3661eaa7453 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:49.236752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc31ab-e326-43dd-8901-a85714023a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:49.237349 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc31ab-e326-43dd-8901-a85714023a54 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:49.237619 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc31ab-e326-43dd-8901-a85714023a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:49.237879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc31ab-e326-43dd-8901-a85714023a54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:49.238930 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc31ab-e326-43dd-8901-a85714023a54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:49.240355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc31ab-e326-43dd-8901-a85714023a54 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:49.241893 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 547/1109] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:57:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:49.247996 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee8714-6fa8-4aaa-a630-c5deb3fc98bf None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:49.347579 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee8714-6fa8-4aaa-a630-c5deb3fc98bf None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:49.380337 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8182eff-15b4-4b1b-a2dc-f2b535ada3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:49.380922 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8182eff-15b4-4b1b-a2dc-f2b535ada3ce None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:49.381196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8182eff-15b4-4b1b-a2dc-f2b535ada3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:49.381462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8182eff-15b4-4b1b-a2dc-f2b535ada3ce None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:49.382085 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8182eff-15b4-4b1b-a2dc-f2b535ada3ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:49.383533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8182eff-15b4-4b1b-a2dc-f2b535ada3ce None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:49.404588 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 563/1110] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Aug 9 06:57:49 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:57:51.418992 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2ffa0-207b-4345-bda8-e796d4a39084 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:51.419602 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2ffa0-207b-4345-bda8-e796d4a39084 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:51.419703 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2ffa0-207b-4345-bda8-e796d4a39084 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:51.421003 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 548/1111] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:51.426001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c60729-c70c-4d64-97c9-376f1df3ad78 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:51.426436 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c60729-c70c-4d64-97c9-376f1df3ad78 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:51.426537 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c60729-c70c-4d64-97c9-376f1df3ad78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:51.444050 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-69c60729-c70c-4d64-97c9-376f1df3ad78 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:51.445208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-69c60729-c70c-4d64-97c9-376f1df3ad78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:51.493126 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:51.512202 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 564/1112] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:51.534522 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2ffa0-207b-4345-bda8-e796d4a39084 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:51.635046 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2ffa0-207b-4345-bda8-e796d4a39084 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:51.642333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:51.668180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c903a-0a1f-4615-98e5-cebec5ee605e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:51.668785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c903a-0a1f-4615-98e5-cebec5ee605e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:51.669107 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c903a-0a1f-4615-98e5-cebec5ee605e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:51.669320 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c903a-0a1f-4615-98e5-cebec5ee605e None admin] PATH_INFO: `/v3/roles/617e0c2609e3413ea3273113659bccbc` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:51.670657 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c903a-0a1f-4615-98e5-cebec5ee605e None admin] RBAC: Authorizing `identity:get_role(role_id=617e0c2609e3413ea3273113659bccbc)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:51.672029 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c903a-0a1f-4615-98e5-cebec5ee605e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:51.673317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 549/1113] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:57:51 2022] GET /identity/v3/roles/617e0c2609e3413ea3273113659bccbc => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:51.679163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c60729-c70c-4d64-97c9-376f1df3ad78 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:51.773271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c60729-c70c-4d64-97c9-376f1df3ad78 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:51.806006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178aef75-03ca-4b4e-840f-7ab272139222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:51.806660 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178aef75-03ca-4b4e-840f-7ab272139222 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:51.806935 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178aef75-03ca-4b4e-840f-7ab272139222 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:51.807234 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178aef75-03ca-4b4e-840f-7ab272139222 None admin] PATH_INFO: `/v3/users/934c4c0cc15447a4ab3f362d58078d01` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:51.819503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178aef75-03ca-4b4e-840f-7ab272139222 None admin] RBAC: Authorizing `identity:get_user(user_id=934c4c0cc15447a4ab3f362d58078d01)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:51.820912 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178aef75-03ca-4b4e-840f-7ab272139222 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:51.823346 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 565/1114] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:57:51 2022] GET /identity/v3/users/934c4c0cc15447a4ab3f362d58078d01 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:57:51.829454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c903a-0a1f-4615-98e5-cebec5ee605e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:51.923034 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c903a-0a1f-4615-98e5-cebec5ee605e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:51.955230 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988a496-7760-4652-a6ec-de32ac383b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:51.955811 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988a496-7760-4652-a6ec-de32ac383b1e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:51.956084 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988a496-7760-4652-a6ec-de32ac383b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:51.956347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988a496-7760-4652-a6ec-de32ac383b1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:51.995709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:52.019958 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988a496-7760-4652-a6ec-de32ac383b1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:52.021367 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988a496-7760-4652-a6ec-de32ac383b1e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:52.112736 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 550/1115] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:57:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 06:57:52.118555 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178aef75-03ca-4b4e-840f-7ab272139222 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:52.160636 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:52.215422 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178aef75-03ca-4b4e-840f-7ab272139222 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:52.247876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf7386-f19a-4ddf-a38e-f6e30609c473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:52.248486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf7386-f19a-4ddf-a38e-f6e30609c473 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:52.248758 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf7386-f19a-4ddf-a38e-f6e30609c473 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:52.249025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf7386-f19a-4ddf-a38e-f6e30609c473 None admin] PATH_INFO: `/v3/projects/dea45cc1e93b4c72a414ba8135ec72c6` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:52.250116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf7386-f19a-4ddf-a38e-f6e30609c473 None admin] RBAC: Authorizing `identity:get_project(project_id=dea45cc1e93b4c72a414ba8135ec72c6)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:52.251550 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf7386-f19a-4ddf-a38e-f6e30609c473 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:52.253146 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 566/1116] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:57:52 2022] GET /identity/v3/projects/dea45cc1e93b4c72a414ba8135ec72c6 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:52.259262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988a496-7760-4652-a6ec-de32ac383b1e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:52.333393 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:52.357695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988a496-7760-4652-a6ec-de32ac383b1e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:52.389663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8e831-cf36-4ccd-aa25-3b2cf5d78482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:52.390254 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8e831-cf36-4ccd-aa25-3b2cf5d78482 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:52.390531 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8e831-cf36-4ccd-aa25-3b2cf5d78482 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:52.390799 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8e831-cf36-4ccd-aa25-3b2cf5d78482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:52.391534 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8e831-cf36-4ccd-aa25-3b2cf5d78482 None admin] RBAC: Adding query filter params (role.id=617e0c2609e3413ea3273113659bccbc, scope.project.id=dea45cc1e93b4c72a414ba8135ec72c6, user.id=934c4c0cc15447a4ab3f362d58078d01) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:52.391841 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8e831-cf36-4ccd-aa25-3b2cf5d78482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:52.393241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8e831-cf36-4ccd-aa25-3b2cf5d78482 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:52.398386 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 551/1117] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:57:52 2022] GET /identity/v3/role_assignments?user.id=934c4c0cc15447a4ab3f362d58078d01&scope.project.id=dea45cc1e93b4c72a414ba8135ec72c6&role.id=617e0c2609e3413ea3273113659bccbc => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:54.452056 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb77bf-16f3-4f06-82c3-135da1d41752 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:54.452615 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb77bf-16f3-4f06-82c3-135da1d41752 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:54.452615 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb77bf-16f3-4f06-82c3-135da1d41752 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:54.453906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 567/1118] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:54.459435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf42775-b886-4431-8977-275de05c422d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:54.459829 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf42775-b886-4431-8977-275de05c422d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:54.459978 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf42775-b886-4431-8977-275de05c422d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:54.478547 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bdf42775-b886-4431-8977-275de05c422d None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:54.479807 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bdf42775-b886-4431-8977-275de05c422d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:54.544790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 552/1119] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:54.567395 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb77bf-16f3-4f06-82c3-135da1d41752 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:54.666255 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb77bf-16f3-4f06-82c3-135da1d41752 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:54.676370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:54.699552 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ea46e-fde0-48cc-ba4f-dfd5097dfc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:54.700161 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ea46e-fde0-48cc-ba4f-dfd5097dfc57 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:54.700431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ea46e-fde0-48cc-ba4f-dfd5097dfc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:54.700692 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ea46e-fde0-48cc-ba4f-dfd5097dfc57 None admin] PATH_INFO: `/v3/roles/617e0c2609e3413ea3273113659bccbc` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:54.702037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ea46e-fde0-48cc-ba4f-dfd5097dfc57 None admin] RBAC: Authorizing `identity:get_role(role_id=617e0c2609e3413ea3273113659bccbc)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:54.703445 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ea46e-fde0-48cc-ba4f-dfd5097dfc57 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:54.704972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 568/1120] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:57:54 2022] GET /identity/v3/roles/617e0c2609e3413ea3273113659bccbc => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:54.710776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf42775-b886-4431-8977-275de05c422d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:54.774001 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:54.806049 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf42775-b886-4431-8977-275de05c422d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:54.838975 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff0a8c-14d5-49fb-bd45-9ee7f58cc727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:54.839610 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff0a8c-14d5-49fb-bd45-9ee7f58cc727 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:54.839883 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff0a8c-14d5-49fb-bd45-9ee7f58cc727 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:54.840145 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff0a8c-14d5-49fb-bd45-9ee7f58cc727 None admin] PATH_INFO: `/v3/users/934c4c0cc15447a4ab3f362d58078d01` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:54.841223 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff0a8c-14d5-49fb-bd45-9ee7f58cc727 None admin] RBAC: Authorizing `identity:get_user(user_id=934c4c0cc15447a4ab3f362d58078d01)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:54.842617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff0a8c-14d5-49fb-bd45-9ee7f58cc727 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:54.844290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 553/1121] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:57:54 2022] GET /identity/v3/users/934c4c0cc15447a4ab3f362d58078d01 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:54.850036 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ea46e-fde0-48cc-ba4f-dfd5097dfc57 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:54.943913 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ea46e-fde0-48cc-ba4f-dfd5097dfc57 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:54.975966 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9f15d-92f8-45c2-a363-02a37b9666b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:54.976570 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9f15d-92f8-45c2-a363-02a37b9666b8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:54.976843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9f15d-92f8-45c2-a363-02a37b9666b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:54.977110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9f15d-92f8-45c2-a363-02a37b9666b8 None admin] PATH_INFO: `/v3/projects/dea45cc1e93b4c72a414ba8135ec72c6` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:54.978248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9f15d-92f8-45c2-a363-02a37b9666b8 None admin] RBAC: Authorizing `identity:get_project(project_id=dea45cc1e93b4c72a414ba8135ec72c6)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:54.979757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9f15d-92f8-45c2-a363-02a37b9666b8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:54.981328 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 569/1122] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:57:54 2022] GET /identity/v3/projects/dea45cc1e93b4c72a414ba8135ec72c6 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:54.987198 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff0a8c-14d5-49fb-bd45-9ee7f58cc727 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:55.083421 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff0a8c-14d5-49fb-bd45-9ee7f58cc727 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:55.114924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290862a-3f94-4683-9c63-7a6983d77d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:55.115598 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290862a-3f94-4683-9c63-7a6983d77d61 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:55.115875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290862a-3f94-4683-9c63-7a6983d77d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:55.116146 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290862a-3f94-4683-9c63-7a6983d77d61 None admin] PATH_INFO: `/v3/projects/dea45cc1e93b4c72a414ba8135ec72c6/users/934c4c0cc15447a4ab3f362d58078d01/roles/617e0c2609e3413ea3273113659bccbc` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:55.118241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290862a-3f94-4683-9c63-7a6983d77d61 None admin] RBAC: Authorizing `identity:create_grant(project_id=dea45cc1e93b4c72a414ba8135ec72c6, user_id=934c4c0cc15447a4ab3f362d58078d01, role_id=617e0c2609e3413ea3273113659bccbc)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:55.120216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290862a-3f94-4683-9c63-7a6983d77d61 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:55.123127 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:55.133818 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 554/1123] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:57:54 2022] PUT /identity/v3/projects/dea45cc1e93b4c72a414ba8135ec72c6/users/934c4c0cc15447a4ab3f362d58078d01/roles/617e0c2609e3413ea3273113659bccbc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:57:57.085222 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbdf1c-3196-4d64-82a0-ec41ee736a99 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:57.085795 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbdf1c-3196-4d64-82a0-ec41ee736a99 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:57.085795 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbdf1c-3196-4d64-82a0-ec41ee736a99 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:57.087198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 570/1124] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:57:57.092872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d40ba3-b04a-42b7-8217-85004ded3d64 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:57.093252 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d40ba3-b04a-42b7-8217-85004ded3d64 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:57.093416 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d40ba3-b04a-42b7-8217-85004ded3d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:57.110663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-62d40ba3-b04a-42b7-8217-85004ded3d64 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:57:57.111846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-62d40ba3-b04a-42b7-8217-85004ded3d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:57:57.174479 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 555/1125] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:57:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:57:57.197433 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbdf1c-3196-4d64-82a0-ec41ee736a99 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:57.243876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:57.296881 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbdf1c-3196-4d64-82a0-ec41ee736a99 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:57.328869 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7381109-43c3-41b2-bdb9-65423fc14a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:57.329786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7381109-43c3-41b2-bdb9-65423fc14a0f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:57.330065 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7381109-43c3-41b2-bdb9-65423fc14a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:57.330334 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7381109-43c3-41b2-bdb9-65423fc14a0f None admin] PATH_INFO: `/v3/roles/617e0c2609e3413ea3273113659bccbc` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:57.331729 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7381109-43c3-41b2-bdb9-65423fc14a0f None admin] RBAC: Authorizing `identity:get_role(role_id=617e0c2609e3413ea3273113659bccbc)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:57.333065 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7381109-43c3-41b2-bdb9-65423fc14a0f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:57.334356 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 571/1126] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:57:57 2022] GET /identity/v3/roles/617e0c2609e3413ea3273113659bccbc => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:57.340882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d40ba3-b04a-42b7-8217-85004ded3d64 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:57.434579 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d40ba3-b04a-42b7-8217-85004ded3d64 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:57.458567 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:57.467862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4fc20-d965-4592-877a-e151af918609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:57.468471 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4fc20-d965-4592-877a-e151af918609 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:57.468744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4fc20-d965-4592-877a-e151af918609 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:57.469010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4fc20-d965-4592-877a-e151af918609 None admin] PATH_INFO: `/v3/users/934c4c0cc15447a4ab3f362d58078d01` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:57.470170 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4fc20-d965-4592-877a-e151af918609 None admin] RBAC: Authorizing `identity:get_user(user_id=934c4c0cc15447a4ab3f362d58078d01)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:57.471615 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4fc20-d965-4592-877a-e151af918609 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:57.473132 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 556/1127] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:57:57 2022] GET /identity/v3/users/934c4c0cc15447a4ab3f362d58078d01 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:57.479602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7381109-43c3-41b2-bdb9-65423fc14a0f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:57.574264 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7381109-43c3-41b2-bdb9-65423fc14a0f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:57.588393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:57.607490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31097b46-31f8-4d5d-850d-e1c96ee8f765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:57.608018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31097b46-31f8-4d5d-850d-e1c96ee8f765 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:57.608295 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31097b46-31f8-4d5d-850d-e1c96ee8f765 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:57.608566 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31097b46-31f8-4d5d-850d-e1c96ee8f765 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:57.674282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31097b46-31f8-4d5d-850d-e1c96ee8f765 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:57.675736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31097b46-31f8-4d5d-850d-e1c96ee8f765 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:57.767830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 572/1128] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:57:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 06:57:57.773708 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4fc20-d965-4592-877a-e151af918609 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:57.868099 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4fc20-d965-4592-877a-e151af918609 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:57.900319 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536097cd-32fb-4088-94d6-2387fcf559e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:57.900988 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536097cd-32fb-4088-94d6-2387fcf559e8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:57.901261 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536097cd-32fb-4088-94d6-2387fcf559e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:57.901528 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536097cd-32fb-4088-94d6-2387fcf559e8 None admin] PATH_INFO: `/v3/projects/dea45cc1e93b4c72a414ba8135ec72c6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:57.902617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536097cd-32fb-4088-94d6-2387fcf559e8 None admin] RBAC: Authorizing `identity:get_project(project_id=dea45cc1e93b4c72a414ba8135ec72c6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:57.904058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536097cd-32fb-4088-94d6-2387fcf559e8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:57.905614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 557/1129] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:57:57 2022] GET /identity/v3/projects/dea45cc1e93b4c72a414ba8135ec72c6 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:57:57.911514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31097b46-31f8-4d5d-850d-e1c96ee8f765 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:57:57.925734 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:58.006036 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31097b46-31f8-4d5d-850d-e1c96ee8f765 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:57:58.039029 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a737c32-4ca3-4a56-93f4-2cde2e3b0dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:57:58.039643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a737c32-4ca3-4a56-93f4-2cde2e3b0dba None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:57:58.039915 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a737c32-4ca3-4a56-93f4-2cde2e3b0dba None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:57:58.040183 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a737c32-4ca3-4a56-93f4-2cde2e3b0dba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:57:58.041126 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a737c32-4ca3-4a56-93f4-2cde2e3b0dba None admin] RBAC: Adding query filter params (role.id=617e0c2609e3413ea3273113659bccbc, scope.project.id=dea45cc1e93b4c72a414ba8135ec72c6, user.id=934c4c0cc15447a4ab3f362d58078d01) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:57:58.041440 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a737c32-4ca3-4a56-93f4-2cde2e3b0dba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:57:58.042839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a737c32-4ca3-4a56-93f4-2cde2e3b0dba None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:57:58.048472 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 573/1130] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:57:57 2022] GET /identity/v3/role_assignments?user.id=934c4c0cc15447a4ab3f362d58078d01&scope.project.id=dea45cc1e93b4c72a414ba8135ec72c6&role.id=617e0c2609e3413ea3273113659bccbc => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:00.092611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e18d05-d240-4065-95e2-0911584bb741 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:00.093166 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e18d05-d240-4065-95e2-0911584bb741 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:00.093166 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e18d05-d240-4065-95e2-0911584bb741 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:00.094496 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 558/1131] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:58:00.099510 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0444b-15b0-4c67-855e-2b0fd9f8965a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:00.099917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0444b-15b0-4c67-855e-2b0fd9f8965a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:00.100046 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0444b-15b0-4c67-855e-2b0fd9f8965a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:00.117378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7cc0444b-15b0-4c67-855e-2b0fd9f8965a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:58:00.118768 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7cc0444b-15b0-4c67-855e-2b0fd9f8965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:58:00.183612 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 574/1132] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:58:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 06:58:00.207145 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e18d05-d240-4065-95e2-0911584bb741 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:00.267149 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:00.304850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e18d05-d240-4065-95e2-0911584bb741 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:00.338501 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468581ed-8587-4a0f-991a-180e5dd1378c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:00.339124 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468581ed-8587-4a0f-991a-180e5dd1378c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:00.339403 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468581ed-8587-4a0f-991a-180e5dd1378c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:00.339667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468581ed-8587-4a0f-991a-180e5dd1378c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:00.340753 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468581ed-8587-4a0f-991a-180e5dd1378c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:00.342158 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468581ed-8587-4a0f-991a-180e5dd1378c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:00.343773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 559/1133] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:58:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:00.349542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0444b-15b0-4c67-855e-2b0fd9f8965a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:00.359669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:00.448366 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0444b-15b0-4c67-855e-2b0fd9f8965a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:00.480570 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce02c2-d5c2-4595-a500-c0345e5ce85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:00.481157 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce02c2-d5c2-4595-a500-c0345e5ce85c None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:00.481435 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce02c2-d5c2-4595-a500-c0345e5ce85c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:00.481708 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce02c2-d5c2-4595-a500-c0345e5ce85c None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:00.482342 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce02c2-d5c2-4595-a500-c0345e5ce85c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:00.483787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce02c2-d5c2-4595-a500-c0345e5ce85c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:00.510398 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 575/1134] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Aug 9 06:58:00 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:58:02.578731 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f55db-d756-43cb-aac6-8f75f917b56c None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:02.579576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f55db-d756-43cb-aac6-8f75f917b56c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:02.579576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f55db-d756-43cb-aac6-8f75f917b56c None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:02.580888 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 560/1135] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:58:02.586135 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25b107-a0a3-400e-acc1-c551c6169330 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:02.586580 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25b107-a0a3-400e-acc1-c551c6169330 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:02.586695 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25b107-a0a3-400e-acc1-c551c6169330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:02.604550 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6c25b107-a0a3-400e-acc1-c551c6169330 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:58:02.605731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6c25b107-a0a3-400e-acc1-c551c6169330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:58:02.666663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:02.678210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 576/1136] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:58:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:58:02.703495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f55db-d756-43cb-aac6-8f75f917b56c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:02.799937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f55db-d756-43cb-aac6-8f75f917b56c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:02.827061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:02.833361 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5dc3a-d179-478f-9614-cabca93cffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:02.833918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5dc3a-d179-478f-9614-cabca93cffd2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:02.834193 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5dc3a-d179-478f-9614-cabca93cffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:02.834462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5dc3a-d179-478f-9614-cabca93cffd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:02.835577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5dc3a-d179-478f-9614-cabca93cffd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:02.837200 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5dc3a-d179-478f-9614-cabca93cffd2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:02.839393 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 561/1137] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:58:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:02.844799 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25b107-a0a3-400e-acc1-c551c6169330 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:02.940967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25b107-a0a3-400e-acc1-c551c6169330 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:02.973531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a232df4-2f08-4eae-b26c-094541acf8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:02.974106 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a232df4-2f08-4eae-b26c-094541acf8ed None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:02.974376 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a232df4-2f08-4eae-b26c-094541acf8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:02.974639 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a232df4-2f08-4eae-b26c-094541acf8ed None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:02.975288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a232df4-2f08-4eae-b26c-094541acf8ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:02.976688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a232df4-2f08-4eae-b26c-094541acf8ed None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:02.998250 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 577/1138] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Aug 9 06:58:02 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:58:05.021626 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b0dcf-ff3b-40d9-8ea3-23cb2ad4830a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:05.022170 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b0dcf-ff3b-40d9-8ea3-23cb2ad4830a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:05.022170 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b0dcf-ff3b-40d9-8ea3-23cb2ad4830a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:05.023529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 562/1139] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:58:05.029348 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd5ed0-38ab-45c0-a260-4d181b854dac None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:05.029802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd5ed0-38ab-45c0-a260-4d181b854dac None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:05.029898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd5ed0-38ab-45c0-a260-4d181b854dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:05.047861 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3fdd5ed0-38ab-45c0-a260-4d181b854dac None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:58:05.049022 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3fdd5ed0-38ab-45c0-a260-4d181b854dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:58:05.090505 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:05.114149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 578/1140] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:58:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:58:05.137510 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b0dcf-ff3b-40d9-8ea3-23cb2ad4830a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:05.235540 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b0dcf-ff3b-40d9-8ea3-23cb2ad4830a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:05.267746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8b4eb-f1a8-4c57-a92e-56c4efaa76f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:05.268354 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8b4eb-f1a8-4c57-a92e-56c4efaa76f7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:05.268628 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8b4eb-f1a8-4c57-a92e-56c4efaa76f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:05.268894 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8b4eb-f1a8-4c57-a92e-56c4efaa76f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:05.279073 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8b4eb-f1a8-4c57-a92e-56c4efaa76f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:58:05.283660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-45a8b4eb-f1a8-4c57-a92e-56c4efaa76f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:58:05.283660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:58:05.283660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:58:05.283660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:58:05.283660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:58:05.283660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:58:05.283660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:58:05.283660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:58:05.283660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:58:05.283660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:58:05.283660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:58:05.283660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:58:05.283660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:58:05.283660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:58:05.283660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:58:05.283660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:58:05.284832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:58:05.284832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:58:05.284832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:58:05.284832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:58:05.284832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:58:05.284832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:58:05.284832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:58:05.284832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:58:05.284832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:58:05.284832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:58:05.284832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:58:05.284832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:58:05.284832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:58:05.284832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:58:05.284832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:58:05.284832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:58:05.285769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:58:05.285769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:58:05.285769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:58:05.285769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:58:05.285769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:58:05.285769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:58:05.285769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:58:05.285769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:58:05.285769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:58:05.285769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:58:05.285769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:58:05.285769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:58:05.285769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 563/1141] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:58:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:58:05.291197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd5ed0-38ab-45c0-a260-4d181b854dac None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:05.385523 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd5ed0-38ab-45c0-a260-4d181b854dac None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:05.417249 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2fcd7-8e0d-4cee-bdae-0d3efc31b74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:05.417831 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2fcd7-8e0d-4cee-bdae-0d3efc31b74a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:05.418103 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2fcd7-8e0d-4cee-bdae-0d3efc31b74a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:05.418366 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2fcd7-8e0d-4cee-bdae-0d3efc31b74a None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:05.419012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2fcd7-8e0d-4cee-bdae-0d3efc31b74a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:58:05.419336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2fcd7-8e0d-4cee-bdae-0d3efc31b74a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:05.420665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2fcd7-8e0d-4cee-bdae-0d3efc31b74a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:05.428334 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 579/1142] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:58:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:05.434607 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8b4eb-f1a8-4c57-a92e-56c4efaa76f7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:05.490775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:05.530486 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8b4eb-f1a8-4c57-a92e-56c4efaa76f7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:05.562861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131f7d3-3a6d-484d-a33e-200955378c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:05.563500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131f7d3-3a6d-484d-a33e-200955378c4c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:05.563776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131f7d3-3a6d-484d-a33e-200955378c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:05.564044 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131f7d3-3a6d-484d-a33e-200955378c4c None admin] PATH_INFO: `/v3/users/b464edd2c00b4d509c1c7e041c25a3fe` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:05.576990 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131f7d3-3a6d-484d-a33e-200955378c4c None admin] RBAC: Authorizing `identity:get_user(user_id=b464edd2c00b4d509c1c7e041c25a3fe)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:05.578403 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131f7d3-3a6d-484d-a33e-200955378c4c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:05.580250 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 564/1143] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:58:05 2022] GET /identity/v3/users/b464edd2c00b4d509c1c7e041c25a3fe => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:05.586027 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2fcd7-8e0d-4cee-bdae-0d3efc31b74a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:05.626481 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:05.685441 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2fcd7-8e0d-4cee-bdae-0d3efc31b74a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:05.717556 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7ad46-b4ae-47e0-a512-d06892d4c828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:05.718149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7ad46-b4ae-47e0-a512-d06892d4c828 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:05.718422 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7ad46-b4ae-47e0-a512-d06892d4c828 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:05.718695 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7ad46-b4ae-47e0-a512-d06892d4c828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:05.781745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7ad46-b4ae-47e0-a512-d06892d4c828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:05.783076 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7ad46-b4ae-47e0-a512-d06892d4c828 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:05.818855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:05.877276 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 580/1144] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:58:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 06:58:05.883170 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131f7d3-3a6d-484d-a33e-200955378c4c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:05.978458 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131f7d3-3a6d-484d-a33e-200955378c4c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:05.994099 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:06.011634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09350f-1ecb-4490-9bff-1a65c7f71264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:06.012246 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09350f-1ecb-4490-9bff-1a65c7f71264 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:06.012523 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09350f-1ecb-4490-9bff-1a65c7f71264 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:06.012794 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09350f-1ecb-4490-9bff-1a65c7f71264 None admin] PATH_INFO: `/v3/projects/7a12270dbb324c80b02cabac424d46b2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:06.013886 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09350f-1ecb-4490-9bff-1a65c7f71264 None admin] RBAC: Authorizing `identity:get_project(project_id=7a12270dbb324c80b02cabac424d46b2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:06.015329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09350f-1ecb-4490-9bff-1a65c7f71264 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:06.016914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 565/1145] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:58:05 2022] GET /identity/v3/projects/7a12270dbb324c80b02cabac424d46b2 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:06.022824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7ad46-b4ae-47e0-a512-d06892d4c828 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:06.117759 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7ad46-b4ae-47e0-a512-d06892d4c828 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:06.150874 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbdbda-a5de-494c-bece-792792bd31ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:06.151481 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbdbda-a5de-494c-bece-792792bd31ca None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:06.151757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbdbda-a5de-494c-bece-792792bd31ca None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:06.152026 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbdbda-a5de-494c-bece-792792bd31ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:06.152732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbdbda-a5de-494c-bece-792792bd31ca None admin] RBAC: Adding query filter params (role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.project.id=7a12270dbb324c80b02cabac424d46b2, user.id=b464edd2c00b4d509c1c7e041c25a3fe) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:58:06.153037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbdbda-a5de-494c-bece-792792bd31ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:06.154430 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbdbda-a5de-494c-bece-792792bd31ca None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:06.159532 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 581/1146] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:58:06 2022] GET /identity/v3/role_assignments?user.id=b464edd2c00b4d509c1c7e041c25a3fe&scope.project.id=7a12270dbb324c80b02cabac424d46b2&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:08.128382 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae17551-7bc7-45fb-9786-fefaf0828114 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:08.128939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae17551-7bc7-45fb-9786-fefaf0828114 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:08.128939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae17551-7bc7-45fb-9786-fefaf0828114 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:08.130261 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 566/1147] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:58:08.135965 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b980e45-db0e-43e6-8a50-07b27d734111 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:08.136373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b980e45-db0e-43e6-8a50-07b27d734111 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:08.136499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b980e45-db0e-43e6-8a50-07b27d734111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:08.142679 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:08.156170 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5b980e45-db0e-43e6-8a50-07b27d734111 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:58:08.157345 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5b980e45-db0e-43e6-8a50-07b27d734111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:58:08.221047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 582/1148] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:58:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:58:08.242974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae17551-7bc7-45fb-9786-fefaf0828114 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:08.340130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae17551-7bc7-45fb-9786-fefaf0828114 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:08.373135 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f606193-682f-4f24-abc8-e8dd2b652720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:08.373737 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f606193-682f-4f24-abc8-e8dd2b652720 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:08.374009 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f606193-682f-4f24-abc8-e8dd2b652720 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:08.374272 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f606193-682f-4f24-abc8-e8dd2b652720 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:08.383798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f606193-682f-4f24-abc8-e8dd2b652720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:58:08.388197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7f606193-682f-4f24-abc8-e8dd2b652720 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:58:08.388197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:58:08.388197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:58:08.388197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:58:08.388197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:58:08.388197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:58:08.388197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:58:08.388197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:58:08.388197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:58:08.388197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:58:08.388197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:58:08.388197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:58:08.388197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:58:08.388197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:58:08.388197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:58:08.388197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:58:08.389324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:58:08.389324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:58:08.389324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:58:08.389324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:58:08.389324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:58:08.389324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:58:08.389324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:58:08.389324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:58:08.389324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:58:08.389324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:58:08.389324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:58:08.389324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:58:08.389324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:58:08.389324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:58:08.389324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:58:08.389324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:58:08.390565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:58:08.390565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:58:08.390565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:58:08.390565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:58:08.390565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:58:08.390565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:58:08.390565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:58:08.390565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:58:08.390565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:58:08.390565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:58:08.390565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:58:08.390565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:58:08.390565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 567/1149] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:58:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:58:08.395207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b980e45-db0e-43e6-8a50-07b27d734111 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:08.489633 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b980e45-db0e-43e6-8a50-07b27d734111 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:08.516712 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:08.521799 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebaa3c-f8e8-488e-b4f1-dd123bb8093e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:08.522387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebaa3c-f8e8-488e-b4f1-dd123bb8093e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:08.522656 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebaa3c-f8e8-488e-b4f1-dd123bb8093e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:08.522917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebaa3c-f8e8-488e-b4f1-dd123bb8093e None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:08.523596 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebaa3c-f8e8-488e-b4f1-dd123bb8093e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:58:08.523891 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebaa3c-f8e8-488e-b4f1-dd123bb8093e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:08.525785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebaa3c-f8e8-488e-b4f1-dd123bb8093e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:08.533461 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 583/1150] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:58:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:08.539482 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f606193-682f-4f24-abc8-e8dd2b652720 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:08.584519 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:08.637153 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f606193-682f-4f24-abc8-e8dd2b652720 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:08.670723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6df35-a45f-4bad-8c09-07493763ac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:08.671361 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6df35-a45f-4bad-8c09-07493763ac10 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:08.671636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6df35-a45f-4bad-8c09-07493763ac10 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:08.671905 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6df35-a45f-4bad-8c09-07493763ac10 None admin] PATH_INFO: `/v3/users/b464edd2c00b4d509c1c7e041c25a3fe` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:08.673010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6df35-a45f-4bad-8c09-07493763ac10 None admin] RBAC: Authorizing `identity:get_user(user_id=b464edd2c00b4d509c1c7e041c25a3fe)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:08.674427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6df35-a45f-4bad-8c09-07493763ac10 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:08.675995 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 568/1151] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:58:08 2022] GET /identity/v3/users/b464edd2c00b4d509c1c7e041c25a3fe => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:08.681788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebaa3c-f8e8-488e-b4f1-dd123bb8093e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:08.780062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebaa3c-f8e8-488e-b4f1-dd123bb8093e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:08.812393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03b70b-329f-4fd6-b1d4-88d8e3e75477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:08.813002 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03b70b-329f-4fd6-b1d4-88d8e3e75477 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:08.813274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03b70b-329f-4fd6-b1d4-88d8e3e75477 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:08.813537 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03b70b-329f-4fd6-b1d4-88d8e3e75477 None admin] PATH_INFO: `/v3/projects/7a12270dbb324c80b02cabac424d46b2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:08.814621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03b70b-329f-4fd6-b1d4-88d8e3e75477 None admin] RBAC: Authorizing `identity:get_project(project_id=7a12270dbb324c80b02cabac424d46b2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:08.816052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03b70b-329f-4fd6-b1d4-88d8e3e75477 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:08.817658 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 584/1152] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:58:08 2022] GET /identity/v3/projects/7a12270dbb324c80b02cabac424d46b2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:08.824179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6df35-a45f-4bad-8c09-07493763ac10 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:08.918552 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6df35-a45f-4bad-8c09-07493763ac10 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:08.930286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:08.951192 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e795f4f-2022-45fd-9fe3-4d667bed775f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:08.951824 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795f4f-2022-45fd-9fe3-4d667bed775f None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:08.952097 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795f4f-2022-45fd-9fe3-4d667bed775f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:08.952366 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795f4f-2022-45fd-9fe3-4d667bed775f None admin] PATH_INFO: `/v3/projects/7a12270dbb324c80b02cabac424d46b2/users/b464edd2c00b4d509c1c7e041c25a3fe/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:08.954465 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e795f4f-2022-45fd-9fe3-4d667bed775f None admin] RBAC: Authorizing `identity:create_grant(project_id=7a12270dbb324c80b02cabac424d46b2, user_id=b464edd2c00b4d509c1c7e041c25a3fe, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:08.955895 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e795f4f-2022-45fd-9fe3-4d667bed775f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:08.968977 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 569/1153] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:58:08 2022] PUT /identity/v3/projects/7a12270dbb324c80b02cabac424d46b2/users/b464edd2c00b4d509c1c7e041c25a3fe/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:58:10.988230 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d1752-31c1-44c1-b8ba-8923584a226a None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:10.988760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d1752-31c1-44c1-b8ba-8923584a226a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:10.988760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d1752-31c1-44c1-b8ba-8923584a226a None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:10.990093 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 585/1154] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:58:10.995689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b86c57-f80e-42d8-863a-b92afb642e9b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:10.996108 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b86c57-f80e-42d8-863a-b92afb642e9b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:10.996226 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b86c57-f80e-42d8-863a-b92afb642e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:11.013626 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-95b86c57-f80e-42d8-863a-b92afb642e9b None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:58:11.014800 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-95b86c57-f80e-42d8-863a-b92afb642e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:58:11.079793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 570/1155] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:58:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:58:11.103836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d1752-31c1-44c1-b8ba-8923584a226a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:11.164913 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:11.203218 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d1752-31c1-44c1-b8ba-8923584a226a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:11.235470 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844f30a-50b2-41ea-a5fd-d42b50f26e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:11.236086 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844f30a-50b2-41ea-a5fd-d42b50f26e35 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:11.236364 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844f30a-50b2-41ea-a5fd-d42b50f26e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:11.236636 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844f30a-50b2-41ea-a5fd-d42b50f26e35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:11.246781 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844f30a-50b2-41ea-a5fd-d42b50f26e35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:58:11.251358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-e844f30a-50b2-41ea-a5fd-d42b50f26e35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:58:11.251358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:58:11.251358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:58:11.251358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:58:11.251358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:58:11.251358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:58:11.251358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:58:11.251358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:58:11.251358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:58:11.251358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:58:11.251358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:58:11.251358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:58:11.251358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:58:11.251358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:58:11.251358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:58:11.251358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:58:11.252490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:58:11.252490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:58:11.252490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:58:11.252490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:58:11.252490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:58:11.252490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:58:11.252490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:58:11.252490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:58:11.252490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:58:11.252490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:58:11.252490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:58:11.252490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:58:11.252490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:58:11.252490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:58:11.252490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:58:11.252490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:58:11.253560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:58:11.253560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:58:11.253560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:58:11.253560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:58:11.253560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:58:11.253560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:58:11.253560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:58:11.253560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:58:11.253560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:58:11.253560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:58:11.253560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:58:11.253560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:58:11.253560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 586/1156] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:58:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:58:11.259004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b86c57-f80e-42d8-863a-b92afb642e9b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:11.354602 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b86c57-f80e-42d8-863a-b92afb642e9b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:11.356097 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:11.388521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3da88-da7f-4c37-8771-589a505c4f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:11.389115 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3da88-da7f-4c37-8771-589a505c4f5b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:11.389390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3da88-da7f-4c37-8771-589a505c4f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:11.389660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3da88-da7f-4c37-8771-589a505c4f5b None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:11.390308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3da88-da7f-4c37-8771-589a505c4f5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:58:11.390607 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3da88-da7f-4c37-8771-589a505c4f5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:11.391982 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3da88-da7f-4c37-8771-589a505c4f5b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:11.400266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 571/1157] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:58:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:11.405975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844f30a-50b2-41ea-a5fd-d42b50f26e35 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:11.505433 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844f30a-50b2-41ea-a5fd-d42b50f26e35 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:11.526842 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:11.538149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2aee7-2289-4557-b52a-8f7bb999f6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:11.538760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2aee7-2289-4557-b52a-8f7bb999f6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:11.539032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2aee7-2289-4557-b52a-8f7bb999f6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:11.539327 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2aee7-2289-4557-b52a-8f7bb999f6f2 None admin] PATH_INFO: `/v3/users/b464edd2c00b4d509c1c7e041c25a3fe` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:11.540556 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2aee7-2289-4557-b52a-8f7bb999f6f2 None admin] RBAC: Authorizing `identity:get_user(user_id=b464edd2c00b4d509c1c7e041c25a3fe)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:11.541945 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2aee7-2289-4557-b52a-8f7bb999f6f2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:11.543536 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 587/1158] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:58:11 2022] GET /identity/v3/users/b464edd2c00b4d509c1c7e041c25a3fe => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:11.549303 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3da88-da7f-4c37-8771-589a505c4f5b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:11.646169 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3da88-da7f-4c37-8771-589a505c4f5b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:11.677691 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc504e-126b-4c50-9cb5-fa3a3f03bcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:11.678290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc504e-126b-4c50-9cb5-fa3a3f03bcab None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:11.678565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc504e-126b-4c50-9cb5-fa3a3f03bcab None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:11.678832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc504e-126b-4c50-9cb5-fa3a3f03bcab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:11.709122 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:11.745831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc504e-126b-4c50-9cb5-fa3a3f03bcab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:11.747295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc504e-126b-4c50-9cb5-fa3a3f03bcab None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:11.842295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 572/1159] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:58:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 06:58:11.848089 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2aee7-2289-4557-b52a-8f7bb999f6f2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:11.944403 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2aee7-2289-4557-b52a-8f7bb999f6f2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:11.975396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412091cb-3e9a-4ef7-b269-57be2570dbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:11.975991 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412091cb-3e9a-4ef7-b269-57be2570dbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:11.976261 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412091cb-3e9a-4ef7-b269-57be2570dbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:11.976522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412091cb-3e9a-4ef7-b269-57be2570dbc2 None admin] PATH_INFO: `/v3/projects/7a12270dbb324c80b02cabac424d46b2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:11.978108 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412091cb-3e9a-4ef7-b269-57be2570dbc2 None admin] RBAC: Authorizing `identity:get_project(project_id=7a12270dbb324c80b02cabac424d46b2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:11.979522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412091cb-3e9a-4ef7-b269-57be2570dbc2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:11.981086 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 588/1160] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:58:11 2022] GET /identity/v3/projects/7a12270dbb324c80b02cabac424d46b2 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:11.987040 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc504e-126b-4c50-9cb5-fa3a3f03bcab None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:12.047663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:12.085225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc504e-126b-4c50-9cb5-fa3a3f03bcab None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:12.119826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f078c3-736e-4ba8-929c-5123e8ae6f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:12.120357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f078c3-736e-4ba8-929c-5123e8ae6f1e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:12.120630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f078c3-736e-4ba8-929c-5123e8ae6f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:12.120898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f078c3-736e-4ba8-929c-5123e8ae6f1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:12.121601 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f078c3-736e-4ba8-929c-5123e8ae6f1e None admin] RBAC: Adding query filter params (role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.project.id=7a12270dbb324c80b02cabac424d46b2, user.id=b464edd2c00b4d509c1c7e041c25a3fe) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:58:12.121905 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f078c3-736e-4ba8-929c-5123e8ae6f1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:12.123332 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f078c3-736e-4ba8-929c-5123e8ae6f1e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:12.128854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 573/1161] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:58:11 2022] GET /identity/v3/role_assignments?user.id=b464edd2c00b4d509c1c7e041c25a3fe&scope.project.id=7a12270dbb324c80b02cabac424d46b2&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:14.131607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f86fa5-bfe7-41f2-bd98-32f9477aa0fb None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:14.132151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f86fa5-bfe7-41f2-bd98-32f9477aa0fb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:14.132151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f86fa5-bfe7-41f2-bd98-32f9477aa0fb None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:14.133985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 589/1162] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:58:14.139236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91df25a-8b3e-47d3-b1a5-86a902f53bc7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:14.139657 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91df25a-8b3e-47d3-b1a5-86a902f53bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:14.139787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91df25a-8b3e-47d3-b1a5-86a902f53bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:14.158091 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c91df25a-8b3e-47d3-b1a5-86a902f53bc7 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:58:14.159325 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c91df25a-8b3e-47d3-b1a5-86a902f53bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:58:14.226007 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 574/1163] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:58:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:58:14.248622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f86fa5-bfe7-41f2-bd98-32f9477aa0fb None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:14.306514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:14.348253 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f86fa5-bfe7-41f2-bd98-32f9477aa0fb None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:14.379653 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80189fa-9190-4df1-affb-b7e588d3bd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:14.380245 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80189fa-9190-4df1-affb-b7e588d3bd0a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:14.380521 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80189fa-9190-4df1-affb-b7e588d3bd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:14.380787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80189fa-9190-4df1-affb-b7e588d3bd0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:14.444418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80189fa-9190-4df1-affb-b7e588d3bd0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:14.445800 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80189fa-9190-4df1-affb-b7e588d3bd0a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:14.503511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:14.543471 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 590/1164] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:58:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 06:58:14.549366 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91df25a-8b3e-47d3-b1a5-86a902f53bc7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:14.608251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:14.648884 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91df25a-8b3e-47d3-b1a5-86a902f53bc7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:14.682597 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3a194-85ab-4cd8-bbbd-e76f82c61f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:14.683230 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3a194-85ab-4cd8-bbbd-e76f82c61f7b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:14.683509 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3a194-85ab-4cd8-bbbd-e76f82c61f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:14.683776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3a194-85ab-4cd8-bbbd-e76f82c61f7b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:14.690030 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3a194-85ab-4cd8-bbbd-e76f82c61f7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:14.691608 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3a194-85ab-4cd8-bbbd-e76f82c61f7b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:14.703281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f4e3a194-85ab-4cd8-bbbd-e76f82c61f7b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 09 06:58:14.703281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:58:14.703281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 09 06:58:14.703281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 09 06:58:14.703281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:58:14.703281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:58:14.703281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:58:14.703281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:58:14.703281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 09 06:58:14.703281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:58:14.703281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:58:14.703281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:58:14.703281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:58:14.703281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:58:14.703281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:58:14.703281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:58:14.703281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:58:14.704742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:58:14.704742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:58:14.704742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:58:14.704742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:58:14.704742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:58:14.704742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:58:14.704742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:58:14.704742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:58:14.704742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:58:14.704742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:58:14.704742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:58:14.704742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:58:14.704742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:58:14.704742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:58:14.704742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:58:14.704742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:58:14.705804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:58:14.705804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:58:14.705804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:58:14.705804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:58:14.705804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:58:14.705804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:58:14.705804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:58:14.705804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:58:14.705804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:58:14.705804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:58:14.705804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 09 06:58:14.705804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:58:14.705804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 09 06:58:14.705804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:58:14.705804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 575/1165] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Aug 9 06:58:14 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:58:14.710525 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80189fa-9190-4df1-affb-b7e588d3bd0a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:14.802980 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80189fa-9190-4df1-affb-b7e588d3bd0a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:14.835613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abbd5e-7678-46a9-aaf2-2aefff35a747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:14.836191 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abbd5e-7678-46a9-aaf2-2aefff35a747 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:14.836649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abbd5e-7678-46a9-aaf2-2aefff35a747 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:14.836923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abbd5e-7678-46a9-aaf2-2aefff35a747 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:14.837548 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abbd5e-7678-46a9-aaf2-2aefff35a747 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:58:14.837842 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abbd5e-7678-46a9-aaf2-2aefff35a747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:14.839189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abbd5e-7678-46a9-aaf2-2aefff35a747 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:14.846092 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 591/1166] 10.222.0.40 () {56 vars in 1115 bytes} [Tue Aug 9 06:58:14 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:16.862847 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1c130-b505-48b2-a285-860f15598702 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:16.863407 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1c130-b505-48b2-a285-860f15598702 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:16.863407 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1c130-b505-48b2-a285-860f15598702 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:16.864746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 576/1167] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:58:16.869944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fc87c-c092-43b1-93c7-d319ca78b43e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:16.870387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fc87c-c092-43b1-93c7-d319ca78b43e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:16.870482 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fc87c-c092-43b1-93c7-d319ca78b43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:16.887950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f13fc87c-c092-43b1-93c7-d319ca78b43e None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:58:16.889095 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f13fc87c-c092-43b1-93c7-d319ca78b43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:58:16.905333 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:16.953426 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 592/1168] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:58:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:58:16.976654 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1c130-b505-48b2-a285-860f15598702 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:17.075985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1c130-b505-48b2-a285-860f15598702 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:17.094121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:17.112895 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a2aa0-576c-4360-a5fd-699689e5bce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:17.113902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a2aa0-576c-4360-a5fd-699689e5bce6 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:17.114370 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a2aa0-576c-4360-a5fd-699689e5bce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:17.114748 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a2aa0-576c-4360-a5fd-699689e5bce6 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:17.115693 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a2aa0-576c-4360-a5fd-699689e5bce6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:17.117049 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a2aa0-576c-4360-a5fd-699689e5bce6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:17.132830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 577/1169] 10.222.0.40 () {60 vars in 1138 bytes} [Tue Aug 9 06:58:16 2022] POST /identity/v3/domains => generated 267 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:58:19.128503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3159953-82b2-4476-b904-010c8bd5109d None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:19.129081 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3159953-82b2-4476-b904-010c8bd5109d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:19.129081 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3159953-82b2-4476-b904-010c8bd5109d None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:19.130375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 593/1170] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:58:19.136112 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2717483-bbc4-4f7a-a6b8-4a0d93b57b38 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:19.136498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2717483-bbc4-4f7a-a6b8-4a0d93b57b38 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:19.136662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2717483-bbc4-4f7a-a6b8-4a0d93b57b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:19.154531 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c2717483-bbc4-4f7a-a6b8-4a0d93b57b38 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:58:19.155738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c2717483-bbc4-4f7a-a6b8-4a0d93b57b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:58:19.220685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 578/1171] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:58:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:58:19.243701 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3159953-82b2-4476-b904-010c8bd5109d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:19.339769 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3159953-82b2-4476-b904-010c8bd5109d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:19.371978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323134c-b35d-45ba-925b-7d5d1909d4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:19.372587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323134c-b35d-45ba-925b-7d5d1909d4ca None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:19.372865 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323134c-b35d-45ba-925b-7d5d1909d4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:19.373134 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323134c-b35d-45ba-925b-7d5d1909d4ca None admin] PATH_INFO: `/v3/domains/b385031e7b3e49468738e0e5eca63e5b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:19.382972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323134c-b35d-45ba-925b-7d5d1909d4ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=b385031e7b3e49468738e0e5eca63e5b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:19.384945 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323134c-b35d-45ba-925b-7d5d1909d4ca None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:19.386474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 594/1172] 10.222.0.40 () {56 vars in 1183 bytes} [Tue Aug 9 06:58:19 2022] GET /identity/v3/domains/b385031e7b3e49468738e0e5eca63e5b => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:19.392184 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2717483-bbc4-4f7a-a6b8-4a0d93b57b38 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:19.485170 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2717483-bbc4-4f7a-a6b8-4a0d93b57b38 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:19.493951 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:19.518609 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa99ac-0711-454c-adc5-af2ce09d150c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:19.519224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa99ac-0711-454c-adc5-af2ce09d150c None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:19.519498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa99ac-0711-454c-adc5-af2ce09d150c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:19.519764 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa99ac-0711-454c-adc5-af2ce09d150c None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:19.520396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa99ac-0711-454c-adc5-af2ce09d150c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:19.521802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa99ac-0711-454c-adc5-af2ce09d150c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:19.547531 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 579/1173] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Aug 9 06:58:19 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 06:58:21.570082 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f0058-891f-45ba-a35b-d5a37db54166 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:21.570631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f0058-891f-45ba-a35b-d5a37db54166 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:21.570719 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f0058-891f-45ba-a35b-d5a37db54166 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:21.572061 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 595/1174] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:58:21.577214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9239d-837d-47bf-9f9f-bea02408fb40 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:21.577620 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9239d-837d-47bf-9f9f-bea02408fb40 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:21.577755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9239d-837d-47bf-9f9f-bea02408fb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:21.595982 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-67e9239d-837d-47bf-9f9f-bea02408fb40 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:58:21.597146 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-67e9239d-837d-47bf-9f9f-bea02408fb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:58:21.661081 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 580/1175] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:58:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:58:21.686488 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f0058-891f-45ba-a35b-d5a37db54166 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:21.701942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:21.784474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f0058-891f-45ba-a35b-d5a37db54166 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:21.816939 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d674bd3-be9a-4a21-8c07-8da208fc41d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:21.817546 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d674bd3-be9a-4a21-8c07-8da208fc41d2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:21.817820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d674bd3-be9a-4a21-8c07-8da208fc41d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:21.818088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d674bd3-be9a-4a21-8c07-8da208fc41d2 None admin] PATH_INFO: `/v3/domains/b385031e7b3e49468738e0e5eca63e5b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:21.819194 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d674bd3-be9a-4a21-8c07-8da208fc41d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b385031e7b3e49468738e0e5eca63e5b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:21.820715 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d674bd3-be9a-4a21-8c07-8da208fc41d2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:21.822192 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 596/1176] 10.222.0.40 () {56 vars in 1183 bytes} [Tue Aug 9 06:58:21 2022] GET /identity/v3/domains/b385031e7b3e49468738e0e5eca63e5b => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:21.827866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9239d-837d-47bf-9f9f-bea02408fb40 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:21.914936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:21.925579 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9239d-837d-47bf-9f9f-bea02408fb40 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:21.957924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145cce9-d96e-412a-bfb7-896407eb7a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:21.958514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145cce9-d96e-412a-bfb7-896407eb7a04 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:21.958809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145cce9-d96e-412a-bfb7-896407eb7a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:21.959074 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145cce9-d96e-412a-bfb7-896407eb7a04 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:21.959858 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145cce9-d96e-412a-bfb7-896407eb7a04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:21.961757 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145cce9-d96e-412a-bfb7-896407eb7a04 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:21.981907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 581/1177] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Aug 9 06:58:21 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 06:58:24.015185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ae8f4-4e31-41cb-b577-3b7204f910fd None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:24.015746 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ae8f4-4e31-41cb-b577-3b7204f910fd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:24.015746 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ae8f4-4e31-41cb-b577-3b7204f910fd None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:24.017107 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 597/1178] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:58:24.022197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc3860-2086-4513-bbe9-ccdd191b474e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:24.022621 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc3860-2086-4513-bbe9-ccdd191b474e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:24.022748 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc3860-2086-4513-bbe9-ccdd191b474e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:24.041066 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-65dc3860-2086-4513-bbe9-ccdd191b474e None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:58:24.042239 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-65dc3860-2086-4513-bbe9-ccdd191b474e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:58:24.109608 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 582/1179] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:58:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:58:24.134860 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ae8f4-4e31-41cb-b577-3b7204f910fd None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:24.215139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:24.235446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ae8f4-4e31-41cb-b577-3b7204f910fd None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:24.266885 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600074c6-bd82-4cbc-8b01-fda8e91e86de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:24.267470 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600074c6-bd82-4cbc-8b01-fda8e91e86de None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:24.267749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600074c6-bd82-4cbc-8b01-fda8e91e86de None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:24.268019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600074c6-bd82-4cbc-8b01-fda8e91e86de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:24.279512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600074c6-bd82-4cbc-8b01-fda8e91e86de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:58:24.284104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-600074c6-bd82-4cbc-8b01-fda8e91e86de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:58:24.284104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:58:24.284104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:58:24.284104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:58:24.284104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:58:24.284104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:58:24.284104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:58:24.284104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:58:24.284104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:58:24.284104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:58:24.284104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:58:24.284104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:58:24.284104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:58:24.284104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:58:24.284104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:58:24.284104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:58:24.290173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:58:24.290173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:58:24.290173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:58:24.290173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:58:24.290173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:58:24.290173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:58:24.290173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:58:24.290173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:58:24.290173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:58:24.290173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:58:24.290173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:58:24.290173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:58:24.290173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:58:24.290173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:58:24.290173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:58:24.290173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:58:24.291378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:58:24.291378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:58:24.291378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:58:24.291378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:58:24.291378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:58:24.291378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:58:24.291378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:58:24.291378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:58:24.291378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:58:24.291378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:58:24.291378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:58:24.291378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:58:24.291378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 598/1180] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:58:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:58:24.292301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc3860-2086-4513-bbe9-ccdd191b474e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:24.363764 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:24.389594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc3860-2086-4513-bbe9-ccdd191b474e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:24.428866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0dd29-ab58-4970-a3fc-858422c5d411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:24.429454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0dd29-ab58-4970-a3fc-858422c5d411 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:24.429748 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0dd29-ab58-4970-a3fc-858422c5d411 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:24.430019 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0dd29-ab58-4970-a3fc-858422c5d411 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:24.430657 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0dd29-ab58-4970-a3fc-858422c5d411 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:58:24.430954 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0dd29-ab58-4970-a3fc-858422c5d411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:24.432331 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0dd29-ab58-4970-a3fc-858422c5d411 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:24.439942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 583/1181] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:58:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:58:24.445813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600074c6-bd82-4cbc-8b01-fda8e91e86de None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:24.542367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600074c6-bd82-4cbc-8b01-fda8e91e86de None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:24.574488 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f5227-8ca4-4e47-b194-b7814eb335da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:24.575117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f5227-8ca4-4e47-b194-b7814eb335da None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:24.575398 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f5227-8ca4-4e47-b194-b7814eb335da None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:24.575669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f5227-8ca4-4e47-b194-b7814eb335da None admin] PATH_INFO: `/v3/users/f31486686b314448b719bcb3d2c6f5b5` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:24.585713 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:24.589319 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f5227-8ca4-4e47-b194-b7814eb335da None admin] RBAC: Authorizing `identity:get_user(user_id=f31486686b314448b719bcb3d2c6f5b5)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:24.590738 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f5227-8ca4-4e47-b194-b7814eb335da None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:24.592362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 599/1182] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:58:24 2022] GET /identity/v3/users/f31486686b314448b719bcb3d2c6f5b5 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:24.598023 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0dd29-ab58-4970-a3fc-858422c5d411 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:24.697004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0dd29-ab58-4970-a3fc-858422c5d411 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:24.728916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f78543-a2b6-4bbc-9827-3c9ce2c35304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:24.729507 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f78543-a2b6-4bbc-9827-3c9ce2c35304 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:24.729786 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f78543-a2b6-4bbc-9827-3c9ce2c35304 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:24.730047 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f78543-a2b6-4bbc-9827-3c9ce2c35304 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:24.738144 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:24.796159 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f78543-a2b6-4bbc-9827-3c9ce2c35304 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:24.797534 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f78543-a2b6-4bbc-9827-3c9ce2c35304 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:24.891504 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 584/1183] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:58:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 06:58:24.897515 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f5227-8ca4-4e47-b194-b7814eb335da None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:24.991524 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f5227-8ca4-4e47-b194-b7814eb335da None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:25.023016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd06cac-830c-4be7-9f48-0431b8504239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:25.024186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd06cac-830c-4be7-9f48-0431b8504239 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:25.024400 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd06cac-830c-4be7-9f48-0431b8504239 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:25.024663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd06cac-830c-4be7-9f48-0431b8504239 None admin] PATH_INFO: `/v3/projects/94029ed6002244c3b1fcda7ba974786c` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:25.025758 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd06cac-830c-4be7-9f48-0431b8504239 None admin] RBAC: Authorizing `identity:get_project(project_id=94029ed6002244c3b1fcda7ba974786c)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:25.027171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd06cac-830c-4be7-9f48-0431b8504239 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:25.028765 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 600/1184] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:58:24 2022] GET /identity/v3/projects/94029ed6002244c3b1fcda7ba974786c => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:25.034690 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f78543-a2b6-4bbc-9827-3c9ce2c35304 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:25.072873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:25.130585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f78543-a2b6-4bbc-9827-3c9ce2c35304 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:25.163255 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792c5a7-78fc-4705-98ed-2d8b94e58ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:25.163850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792c5a7-78fc-4705-98ed-2d8b94e58ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:25.164782 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792c5a7-78fc-4705-98ed-2d8b94e58ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:25.165124 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792c5a7-78fc-4705-98ed-2d8b94e58ca4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:25.165939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792c5a7-78fc-4705-98ed-2d8b94e58ca4 None admin] RBAC: Adding query filter params (role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.project.id=94029ed6002244c3b1fcda7ba974786c, user.id=f31486686b314448b719bcb3d2c6f5b5) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:58:25.166249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792c5a7-78fc-4705-98ed-2d8b94e58ca4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:25.167702 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792c5a7-78fc-4705-98ed-2d8b94e58ca4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:25.172825 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 585/1185] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:58:25 2022] GET /identity/v3/role_assignments?user.id=f31486686b314448b719bcb3d2c6f5b5&scope.project.id=94029ed6002244c3b1fcda7ba974786c&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:27.146378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2d0b2-c05a-4134-8b01-ac45cd6dc9de None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:27.146941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2d0b2-c05a-4134-8b01-ac45cd6dc9de None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:27.146941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2d0b2-c05a-4134-8b01-ac45cd6dc9de None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:27.148291 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 601/1186] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:58:27.154280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d1241-5d35-422f-9aea-7b0642766301 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:27.154697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d1241-5d35-422f-9aea-7b0642766301 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:27.154834 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d1241-5d35-422f-9aea-7b0642766301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:27.172205 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2c0d1241-5d35-422f-9aea-7b0642766301 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:58:27.173378 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2c0d1241-5d35-422f-9aea-7b0642766301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:58:27.236736 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 586/1187] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:58:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:58:27.259645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2d0b2-c05a-4134-8b01-ac45cd6dc9de None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:27.324016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:27.358910 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2d0b2-c05a-4134-8b01-ac45cd6dc9de None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:27.391309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc61bda-75f3-44d6-8567-c2a22574f480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:27.391912 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc61bda-75f3-44d6-8567-c2a22574f480 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:27.392184 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc61bda-75f3-44d6-8567-c2a22574f480 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:27.392447 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc61bda-75f3-44d6-8567-c2a22574f480 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:27.402654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc61bda-75f3-44d6-8567-c2a22574f480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:58:27.407153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-7dc61bda-75f3-44d6-8567-c2a22574f480 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:58:27.407153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:58:27.407153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:58:27.407153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:58:27.407153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:58:27.407153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:58:27.407153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:58:27.407153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:58:27.407153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:58:27.407153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:58:27.407153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:58:27.407153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:58:27.407153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:58:27.407153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:58:27.407153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:58:27.407153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:58:27.408258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:58:27.408258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:58:27.408258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:58:27.408258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:58:27.408258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:58:27.408258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:58:27.408258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:58:27.408258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:58:27.408258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:58:27.408258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:58:27.408258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:58:27.408258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:58:27.408258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:58:27.408258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:58:27.408258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:58:27.408258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:58:27.409299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:58:27.409299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:58:27.409299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:58:27.409299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:58:27.409299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:58:27.409299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:58:27.409299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:58:27.409299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:58:27.409299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:58:27.409299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:58:27.409299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:58:27.409299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:58:27.409299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 602/1188] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:58:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:58:27.414295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d1241-5d35-422f-9aea-7b0642766301 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:27.443948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:27.510435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d1241-5d35-422f-9aea-7b0642766301 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:27.543042 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83958c9e-2a86-46b4-a242-99d11655a476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:27.543667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83958c9e-2a86-46b4-a242-99d11655a476 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:27.543948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83958c9e-2a86-46b4-a242-99d11655a476 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:27.544221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83958c9e-2a86-46b4-a242-99d11655a476 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:27.544870 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83958c9e-2a86-46b4-a242-99d11655a476 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:58:27.545172 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83958c9e-2a86-46b4-a242-99d11655a476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:27.546528 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83958c9e-2a86-46b4-a242-99d11655a476 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:27.554178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 587/1189] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:58:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:27.560588 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc61bda-75f3-44d6-8567-c2a22574f480 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:27.657590 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc61bda-75f3-44d6-8567-c2a22574f480 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:27.681576 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:27.689764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ecb0b-3be2-45ba-8fff-fb3c4716216d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:27.690371 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ecb0b-3be2-45ba-8fff-fb3c4716216d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:27.690642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ecb0b-3be2-45ba-8fff-fb3c4716216d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:27.690912 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ecb0b-3be2-45ba-8fff-fb3c4716216d None admin] PATH_INFO: `/v3/users/f31486686b314448b719bcb3d2c6f5b5` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:27.692026 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ecb0b-3be2-45ba-8fff-fb3c4716216d None admin] RBAC: Authorizing `identity:get_user(user_id=f31486686b314448b719bcb3d2c6f5b5)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:27.693435 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ecb0b-3be2-45ba-8fff-fb3c4716216d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:27.694975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 603/1190] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:58:27 2022] GET /identity/v3/users/f31486686b314448b719bcb3d2c6f5b5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:27.701380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83958c9e-2a86-46b4-a242-99d11655a476 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:27.792352 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:27.798912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83958c9e-2a86-46b4-a242-99d11655a476 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:27.831211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36596adc-f78d-40b6-aac3-31972a3206cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:27.831822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36596adc-f78d-40b6-aac3-31972a3206cc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:27.832097 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36596adc-f78d-40b6-aac3-31972a3206cc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:27.832366 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36596adc-f78d-40b6-aac3-31972a3206cc None admin] PATH_INFO: `/v3/projects/94029ed6002244c3b1fcda7ba974786c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:27.833454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36596adc-f78d-40b6-aac3-31972a3206cc None admin] RBAC: Authorizing `identity:get_project(project_id=94029ed6002244c3b1fcda7ba974786c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:27.834869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36596adc-f78d-40b6-aac3-31972a3206cc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:27.836483 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 588/1191] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:58:27 2022] GET /identity/v3/projects/94029ed6002244c3b1fcda7ba974786c => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:27.842831 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ecb0b-3be2-45ba-8fff-fb3c4716216d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:27.938234 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ecb0b-3be2-45ba-8fff-fb3c4716216d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:27.972305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bec6c4-1cff-4ccb-b847-cfdde440746c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:27.972968 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bec6c4-1cff-4ccb-b847-cfdde440746c None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:27.973246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bec6c4-1cff-4ccb-b847-cfdde440746c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:27.973514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bec6c4-1cff-4ccb-b847-cfdde440746c None admin] PATH_INFO: `/v3/projects/94029ed6002244c3b1fcda7ba974786c/users/f31486686b314448b719bcb3d2c6f5b5/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:27.975416 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bec6c4-1cff-4ccb-b847-cfdde440746c None admin] RBAC: Authorizing `identity:create_grant(project_id=94029ed6002244c3b1fcda7ba974786c, user_id=f31486686b314448b719bcb3d2c6f5b5, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:27.976836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bec6c4-1cff-4ccb-b847-cfdde440746c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:27.989359 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 604/1192] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:58:27 2022] PUT /identity/v3/projects/94029ed6002244c3b1fcda7ba974786c/users/f31486686b314448b719bcb3d2c6f5b5/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:58:29.965519 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762199b-0e95-4124-8f59-05e4108b0607 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:29.966053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762199b-0e95-4124-8f59-05e4108b0607 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:29.966053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762199b-0e95-4124-8f59-05e4108b0607 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:29.967431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 589/1193] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:58:29.972509 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51149001-46b9-4df0-b68a-0101ff9510c9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:29.972899 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51149001-46b9-4df0-b68a-0101ff9510c9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:29.973049 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51149001-46b9-4df0-b68a-0101ff9510c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:29.991165 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-51149001-46b9-4df0-b68a-0101ff9510c9 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:58:29.992363 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-51149001-46b9-4df0-b68a-0101ff9510c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:58:30.038917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:30.057993 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 605/1194] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:58:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:58:30.080893 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762199b-0e95-4124-8f59-05e4108b0607 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:30.178929 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762199b-0e95-4124-8f59-05e4108b0607 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:30.212377 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28beed9-bafa-49bc-a198-8c0cfd5abd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:30.212988 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28beed9-bafa-49bc-a198-8c0cfd5abd2a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:30.213265 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28beed9-bafa-49bc-a198-8c0cfd5abd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:30.213533 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28beed9-bafa-49bc-a198-8c0cfd5abd2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:30.223211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28beed9-bafa-49bc-a198-8c0cfd5abd2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:58:30.227779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d28beed9-bafa-49bc-a198-8c0cfd5abd2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:58:30.227779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:58:30.227779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:58:30.227779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:58:30.227779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:58:30.227779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:58:30.227779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:58:30.227779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:58:30.227779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:58:30.227779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:58:30.227779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:58:30.227779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:58:30.227779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:58:30.227779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:58:30.227779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:58:30.227779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:58:30.233506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:58:30.233506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:58:30.233506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:58:30.233506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:58:30.233506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:58:30.233506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:58:30.233506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:58:30.233506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:58:30.233506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:58:30.233506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:58:30.233506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:58:30.233506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:58:30.233506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:58:30.233506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:58:30.233506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:58:30.233506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:58:30.234633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:58:30.234633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:58:30.234633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:58:30.234633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:58:30.234633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:58:30.234633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:58:30.234633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:58:30.234633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:58:30.234633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:58:30.234633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:58:30.234633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:58:30.234633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:58:30.234633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 590/1195] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:58:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:58:30.235540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51149001-46b9-4df0-b68a-0101ff9510c9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:30.331343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51149001-46b9-4df0-b68a-0101ff9510c9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:30.363988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183bedc-bec8-42a0-9b86-2729717822c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:30.364580 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183bedc-bec8-42a0-9b86-2729717822c7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:30.364855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183bedc-bec8-42a0-9b86-2729717822c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:30.365125 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183bedc-bec8-42a0-9b86-2729717822c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:30.365778 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183bedc-bec8-42a0-9b86-2729717822c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:58:30.366077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183bedc-bec8-42a0-9b86-2729717822c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:30.367450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183bedc-bec8-42a0-9b86-2729717822c7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:30.376182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 606/1196] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:58:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:30.381890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28beed9-bafa-49bc-a198-8c0cfd5abd2a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:30.407707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:30.479267 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28beed9-bafa-49bc-a198-8c0cfd5abd2a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:30.512113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27c655-2c20-4bec-bb69-a9f8ba0693c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:30.512713 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27c655-2c20-4bec-bb69-a9f8ba0693c1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:30.512986 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27c655-2c20-4bec-bb69-a9f8ba0693c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:30.513252 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27c655-2c20-4bec-bb69-a9f8ba0693c1 None admin] PATH_INFO: `/v3/users/f31486686b314448b719bcb3d2c6f5b5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:30.514332 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27c655-2c20-4bec-bb69-a9f8ba0693c1 None admin] RBAC: Authorizing `identity:get_user(user_id=f31486686b314448b719bcb3d2c6f5b5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:30.515770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27c655-2c20-4bec-bb69-a9f8ba0693c1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:30.517293 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 591/1197] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Aug 9 06:58:30 2022] GET /identity/v3/users/f31486686b314448b719bcb3d2c6f5b5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:30.523168 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183bedc-bec8-42a0-9b86-2729717822c7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:30.568778 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:30.622637 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183bedc-bec8-42a0-9b86-2729717822c7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:30.657852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cdc34-28f3-4312-823c-c28a555ec961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:30.658457 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cdc34-28f3-4312-823c-c28a555ec961 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:30.659217 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cdc34-28f3-4312-823c-c28a555ec961 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:30.659498 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cdc34-28f3-4312-823c-c28a555ec961 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:30.724362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cdc34-28f3-4312-823c-c28a555ec961 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:30.725781 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cdc34-28f3-4312-823c-c28a555ec961 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:30.769329 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:30.821691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 607/1198] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:58:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 06:58:30.827685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27c655-2c20-4bec-bb69-a9f8ba0693c1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:30.914629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:30.924573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27c655-2c20-4bec-bb69-a9f8ba0693c1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:30.956146 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad9097-de68-49b5-8688-5dd7757888c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:30.956755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad9097-de68-49b5-8688-5dd7757888c7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:30.957029 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad9097-de68-49b5-8688-5dd7757888c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:30.957299 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad9097-de68-49b5-8688-5dd7757888c7 None admin] PATH_INFO: `/v3/projects/94029ed6002244c3b1fcda7ba974786c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:30.958383 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad9097-de68-49b5-8688-5dd7757888c7 None admin] RBAC: Authorizing `identity:get_project(project_id=94029ed6002244c3b1fcda7ba974786c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:30.959825 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad9097-de68-49b5-8688-5dd7757888c7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:30.961418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 592/1199] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Aug 9 06:58:30 2022] GET /identity/v3/projects/94029ed6002244c3b1fcda7ba974786c => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:30.967912 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cdc34-28f3-4312-823c-c28a555ec961 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:58:31.062537 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cdc34-28f3-4312-823c-c28a555ec961 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:58:31.095556 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306e8e9-1207-4a48-8b79-0e5ace1c7e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:58:31.096141 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306e8e9-1207-4a48-8b79-0e5ace1c7e4e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:58:31.096411 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306e8e9-1207-4a48-8b79-0e5ace1c7e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:58:31.096675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306e8e9-1207-4a48-8b79-0e5ace1c7e4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:58:31.097382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306e8e9-1207-4a48-8b79-0e5ace1c7e4e None admin] RBAC: Adding query filter params (role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.project.id=94029ed6002244c3b1fcda7ba974786c, user.id=f31486686b314448b719bcb3d2c6f5b5) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:58:31.097683 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306e8e9-1207-4a48-8b79-0e5ace1c7e4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:58:31.099116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306e8e9-1207-4a48-8b79-0e5ace1c7e4e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:58:31.104847 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 608/1200] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:58:30 2022] GET /identity/v3/role_assignments?user.id=f31486686b314448b719bcb3d2c6f5b5&scope.project.id=94029ed6002244c3b1fcda7ba974786c&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:58:40.952049 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=21 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:58:41.102033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:26.438074 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f7c5f-cdea-4701-843e-69e31362002d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:26.438694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f7c5f-cdea-4701-843e-69e31362002d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:26.438694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f7c5f-cdea-4701-843e-69e31362002d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:26.440114 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 593/1201] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:59:26.446414 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd88df8-32fa-4142-ae99-f7052dad67b3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:26.446913 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd88df8-32fa-4142-ae99-f7052dad67b3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:26.447013 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd88df8-32fa-4142-ae99-f7052dad67b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:26.468830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6fd88df8-32fa-4142-ae99-f7052dad67b3 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:59:26.470095 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6fd88df8-32fa-4142-ae99-f7052dad67b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:59:26.563128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 609/1202] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:59:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:59:26.587936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f7c5f-cdea-4701-843e-69e31362002d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:26.725952 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f7c5f-cdea-4701-843e-69e31362002d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:26.768515 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a73ad9-1312-4abf-a2e3-8eb86c2ceb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:26.769211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a73ad9-1312-4abf-a2e3-8eb86c2ceb63 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:26.769506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a73ad9-1312-4abf-a2e3-8eb86c2ceb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:26.769819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a73ad9-1312-4abf-a2e3-8eb86c2ceb63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:26.781436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a73ad9-1312-4abf-a2e3-8eb86c2ceb63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:26.782996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a73ad9-1312-4abf-a2e3-8eb86c2ceb63 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:26.799987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a6a73ad9-1312-4abf-a2e3-8eb86c2ceb63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:26.799987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:26.799987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:26.799987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:26.799987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:26.799987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:26.799987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:26.799987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:26.799987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:26.799987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:26.799987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:26.799987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:26.799987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:59:26.799987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:59:26.799987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:59:26.799987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:59:26.801451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:26.801451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:26.801451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:26.801451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:26.801451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:26.801451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:26.801451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:26.801451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:26.801451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:26.801451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:26.801451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:26.801451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:26.801451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:26.801451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:26.801451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:26.801451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:26.801451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:59:26.802412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:59:26.802412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:26.802412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:59:26.802412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 594/1203] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:26.807544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd88df8-32fa-4142-ae99-f7052dad67b3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:26.959777 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd88df8-32fa-4142-ae99-f7052dad67b3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:27.003372 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:27.011353 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd837f-fc6c-4247-9dd3-47c9154ed6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:27.013557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd837f-fc6c-4247-9dd3-47c9154ed6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:27.013874 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd837f-fc6c-4247-9dd3-47c9154ed6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:27.014212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd837f-fc6c-4247-9dd3-47c9154ed6e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:27.015096 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd837f-fc6c-4247-9dd3-47c9154ed6e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:27.016455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd837f-fc6c-4247-9dd3-47c9154ed6e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:27.018338 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd837f-fc6c-4247-9dd3-47c9154ed6e2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:27.039286 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 610/1204] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:27.042196 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a73ad9-1312-4abf-a2e3-8eb86c2ceb63 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:27.118251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:27.186024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a73ad9-1312-4abf-a2e3-8eb86c2ceb63 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:27.226244 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f5e14-9dab-4d62-914b-7176400400b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:27.226863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f5e14-9dab-4d62-914b-7176400400b2 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:27.227181 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f5e14-9dab-4d62-914b-7176400400b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:27.227491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f5e14-9dab-4d62-914b-7176400400b2 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:27.228210 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f5e14-9dab-4d62-914b-7176400400b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:27.229624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f5e14-9dab-4d62-914b-7176400400b2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:27.256580 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 595/1205] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Aug 9 06:59:27 2022] POST /identity/v3/users => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 06:59:29.482550 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973308-69b4-4965-9285-a0e7a49fdc88 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:29.482550 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973308-69b4-4965-9285-a0e7a49fdc88 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:29.482550 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973308-69b4-4965-9285-a0e7a49fdc88 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:29.483624 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 611/1206] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:59:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:59:29.488103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddfdd9-5765-4460-86d4-a834d05a32fa None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:29.488515 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddfdd9-5765-4460-86d4-a834d05a32fa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:29.488649 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddfdd9-5765-4460-86d4-a834d05a32fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:29.508656 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0fddfdd9-5765-4460-86d4-a834d05a32fa None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:59:29.509845 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0fddfdd9-5765-4460-86d4-a834d05a32fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:59:29.588568 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 596/1207] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:59:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:59:29.611913 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973308-69b4-4965-9285-a0e7a49fdc88 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:29.737374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973308-69b4-4965-9285-a0e7a49fdc88 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:29.780475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241df2c-0344-4e8b-8fe0-825816686ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:29.781109 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241df2c-0344-4e8b-8fe0-825816686ccf None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:29.781434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241df2c-0344-4e8b-8fe0-825816686ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:29.781644 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241df2c-0344-4e8b-8fe0-825816686ccf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:29.793586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241df2c-0344-4e8b-8fe0-825816686ccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:59:29.798975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-8241df2c-0344-4e8b-8fe0-825816686ccf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:59:29.798975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:29.798975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:29.798975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:29.798975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:29.798975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:29.798975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:29.798975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:29.798975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:29.798975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:29.798975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:29.798975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:29.798975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:59:29.798975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:59:29.798975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:59:29.798975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:59:29.800512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:59:29.800512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:59:29.800512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:59:29.800512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:59:29.800512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:29.800512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:29.800512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:29.800512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:29.800512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:29.800512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:29.800512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:29.800512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:29.800512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:29.800512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:29.800512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:29.800512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:29.801420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:29.801420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:29.801420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:29.801420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:29.801420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:59:29.801420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:59:29.801420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:59:29.801420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:59:29.801420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:59:29.801420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:59:29.801420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:59:29.801420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:59:29.801420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 612/1208] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:59:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:29.805563 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddfdd9-5765-4460-86d4-a834d05a32fa None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:29.846777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:29.917730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddfdd9-5765-4460-86d4-a834d05a32fa None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:29.957173 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3aa2c8-87f9-4169-88de-0295d6aa772f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:29.957846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aa2c8-87f9-4169-88de-0295d6aa772f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:29.958123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aa2c8-87f9-4169-88de-0295d6aa772f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:29.958387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aa2c8-87f9-4169-88de-0295d6aa772f None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:29.959103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3aa2c8-87f9-4169-88de-0295d6aa772f None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:29.959477 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3aa2c8-87f9-4169-88de-0295d6aa772f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:29.961151 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3aa2c8-87f9-4169-88de-0295d6aa772f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:29.976943 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 597/1209] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:59:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:29.977108 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241df2c-0344-4e8b-8fe0-825816686ccf None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:30.036198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:30.092961 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241df2c-0344-4e8b-8fe0-825816686ccf None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:30.130154 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581419c8-24cd-41ee-b679-97fa8277ed15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:30.131459 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581419c8-24cd-41ee-b679-97fa8277ed15 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:30.131813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581419c8-24cd-41ee-b679-97fa8277ed15 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:30.132089 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581419c8-24cd-41ee-b679-97fa8277ed15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:30.145252 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581419c8-24cd-41ee-b679-97fa8277ed15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:30.147162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581419c8-24cd-41ee-b679-97fa8277ed15 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:30.172336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-581419c8-24cd-41ee-b679-97fa8277ed15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:30.172336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:30.172336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:30.172336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:30.172336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:30.172336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:30.172336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:30.172336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:30.172336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:30.172336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:30.172336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:30.172336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:30.172336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:59:30.172336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:59:30.172336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:59:30.172336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:59:30.173385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:30.173385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:30.173385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:30.173385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:30.173385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:30.173385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:30.173385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:30.173385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:30.173385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:30.173385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:30.173385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:30.173385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:30.173385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:30.173385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:30.173385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:30.173385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:30.173385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:59:30.174831 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:59:30.174831 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:30.174831 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:59:30.178833 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 613/1210] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:59:30.180141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3aa2c8-87f9-4169-88de-0295d6aa772f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:30.294719 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:30.298509 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3aa2c8-87f9-4169-88de-0295d6aa772f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:30.344522 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590704f2-5066-4a3d-b8ad-29ba61a7e483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:30.345178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590704f2-5066-4a3d-b8ad-29ba61a7e483 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:30.345463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590704f2-5066-4a3d-b8ad-29ba61a7e483 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:30.345730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590704f2-5066-4a3d-b8ad-29ba61a7e483 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:30.346358 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590704f2-5066-4a3d-b8ad-29ba61a7e483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:30.346655 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590704f2-5066-4a3d-b8ad-29ba61a7e483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:30.348043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590704f2-5066-4a3d-b8ad-29ba61a7e483 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:30.362504 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 598/1211] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:30.368450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581419c8-24cd-41ee-b679-97fa8277ed15 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:30.493943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581419c8-24cd-41ee-b679-97fa8277ed15 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:30.495653 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:30.537779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb2511-42c8-412f-ab56-f20184bc2362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:30.538607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb2511-42c8-412f-ab56-f20184bc2362 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:30.538887 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb2511-42c8-412f-ab56-f20184bc2362 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:30.539224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb2511-42c8-412f-ab56-f20184bc2362 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:30.548196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb2511-42c8-412f-ab56-f20184bc2362 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:30.549908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb2511-42c8-412f-ab56-f20184bc2362 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:30.563918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-d9eb2511-42c8-412f-ab56-f20184bc2362 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 06:59:30.563918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:30.563918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:30.563918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:30.563918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:30.563918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:30.563918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:30.563918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:30.563918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:30.563918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:30.563918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:30.563918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:30.563918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:59:30.563918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:59:30.563918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:59:30.563918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:59:30.565128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:30.565128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:30.565128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:59:30.565128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:59:30.565128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:59:30.565128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:59:30.565128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:30.565128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:30.565128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:30.565128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:30.565128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:30.565128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:30.565128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:30.565128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:30.565128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:30.565128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:30.565128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:30.565128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:30.571669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:30.571669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:30.571669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:59:30.571669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:59:30.571669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:59:30.571669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:59:30.571669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:59:30.571669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:59:30.571669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 06:59:30.571669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:59:30.571669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 614/1212] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:59:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:59:30.572346 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590704f2-5066-4a3d-b8ad-29ba61a7e483 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:30.713418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590704f2-5066-4a3d-b8ad-29ba61a7e483 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:30.760727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e448cf9-9e8c-422e-aa2c-746e45f85f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:30.761460 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e448cf9-9e8c-422e-aa2c-746e45f85f65 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:30.761870 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e448cf9-9e8c-422e-aa2c-746e45f85f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:30.762147 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e448cf9-9e8c-422e-aa2c-746e45f85f65 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:30.762871 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e448cf9-9e8c-422e-aa2c-746e45f85f65 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:30.763207 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e448cf9-9e8c-422e-aa2c-746e45f85f65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:30.764881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e448cf9-9e8c-422e-aa2c-746e45f85f65 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:30.784287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 599/1213] 10.222.0.40 () {56 vars in 1143 bytes} [Tue Aug 9 06:59:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:30.790891 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb2511-42c8-412f-ab56-f20184bc2362 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:30.914767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb2511-42c8-412f-ab56-f20184bc2362 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:30.954305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820d638-9fa7-4cf0-a763-5c858ef2f2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:30.955226 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820d638-9fa7-4cf0-a763-5c858ef2f2df None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:30.955731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820d638-9fa7-4cf0-a763-5c858ef2f2df None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:30.956136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820d638-9fa7-4cf0-a763-5c858ef2f2df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:30.997160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:31.044109 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820d638-9fa7-4cf0-a763-5c858ef2f2df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:31.045574 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820d638-9fa7-4cf0-a763-5c858ef2f2df None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:31.157132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 615/1214] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:59:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 06:59:31.163127 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e448cf9-9e8c-422e-aa2c-746e45f85f65 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:31.184190 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:31.275446 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e448cf9-9e8c-422e-aa2c-746e45f85f65 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:31.320955 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaef86c-c55a-4d57-bf05-79ac7408d776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:31.321708 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaef86c-c55a-4d57-bf05-79ac7408d776 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:31.322050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaef86c-c55a-4d57-bf05-79ac7408d776 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:31.322400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaef86c-c55a-4d57-bf05-79ac7408d776 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:31.335855 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaef86c-c55a-4d57-bf05-79ac7408d776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:31.337769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaef86c-c55a-4d57-bf05-79ac7408d776 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:31.354427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-2eaef86c-c55a-4d57-bf05-79ac7408d776 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:31.354427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:31.354427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:31.354427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:31.354427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:31.354427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:31.354427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:31.354427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:31.354427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:31.354427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:31.354427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:31.354427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:31.354427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:59:31.354427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:59:31.354427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:59:31.354427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:59:31.356826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:31.356826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:31.356826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:31.356826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:31.356826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:31.356826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:31.356826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:31.356826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:31.356826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:31.356826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:31.356826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:31.356826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:31.356826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:31.356826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:31.356826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:31.356826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:31.356826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:59:31.357743 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:59:31.357743 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:31.357743 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:59:31.357743 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 600/1215] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:31.361416 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820d638-9fa7-4cf0-a763-5c858ef2f2df None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:31.432290 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:31.481800 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820d638-9fa7-4cf0-a763-5c858ef2f2df None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:31.520898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2f4a5-35b1-4315-bb43-8bf30466f865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:31.523608 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2f4a5-35b1-4315-bb43-8bf30466f865 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:31.524145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2f4a5-35b1-4315-bb43-8bf30466f865 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:31.524570 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2f4a5-35b1-4315-bb43-8bf30466f865 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:31.525624 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2f4a5-35b1-4315-bb43-8bf30466f865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:31.526107 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2f4a5-35b1-4315-bb43-8bf30466f865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:31.527624 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2f4a5-35b1-4315-bb43-8bf30466f865 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:31.549831 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 616/1216] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:59:31.551075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaef86c-c55a-4d57-bf05-79ac7408d776 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:31.640323 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:31.674489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaef86c-c55a-4d57-bf05-79ac7408d776 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:31.714266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec35efa-b090-4eb6-8e6c-f2fb0539a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:31.715344 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec35efa-b090-4eb6-8e6c-f2fb0539a2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:31.715869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec35efa-b090-4eb6-8e6c-f2fb0539a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:31.716372 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec35efa-b090-4eb6-8e6c-f2fb0539a2e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:31.727133 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec35efa-b090-4eb6-8e6c-f2fb0539a2e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:31.728890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec35efa-b090-4eb6-8e6c-f2fb0539a2e8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:31.742711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6ec35efa-b090-4eb6-8e6c-f2fb0539a2e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:59:31.742711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:31.742711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:31.742711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:31.742711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:31.742711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:31.742711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:31.742711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:31.742711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:31.742711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:31.742711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:31.742711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:31.742711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:59:31.742711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:59:31.742711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:59:31.743874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:59:31.743874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:31.743874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:31.743874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:31.743874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:31.743874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:31.743874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:31.743874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:31.743874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:31.743874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:31.743874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:31.743874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:31.743874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:31.743874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:31.743874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:31.743874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:31.743874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:31.744985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:59:31.744985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:59:31.744985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:59:31.744985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:59:31.744985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:59:31.744985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:59:31.744985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:59:31.744985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:59:31.746611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 601/1217] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:59:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:31.752878 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2f4a5-35b1-4315-bb43-8bf30466f865 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:31.882143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2f4a5-35b1-4315-bb43-8bf30466f865 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:31.906902 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:31.918907 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fef07-fc1b-4a35-a94a-9f9024e94837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:31.919594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fef07-fc1b-4a35-a94a-9f9024e94837 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:31.919869 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fef07-fc1b-4a35-a94a-9f9024e94837 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:31.920135 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fef07-fc1b-4a35-a94a-9f9024e94837 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:31.920823 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fef07-fc1b-4a35-a94a-9f9024e94837 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:31.921123 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fef07-fc1b-4a35-a94a-9f9024e94837 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:31.922564 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fef07-fc1b-4a35-a94a-9f9024e94837 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:31.940720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 617/1218] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:59:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:31.942035 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec35efa-b090-4eb6-8e6c-f2fb0539a2e8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:32.061985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec35efa-b090-4eb6-8e6c-f2fb0539a2e8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:32.097485 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:32.107444 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d604a5f-6fe1-47cb-a5a2-708d632a602e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:32.108312 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d604a5f-6fe1-47cb-a5a2-708d632a602e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:32.108618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d604a5f-6fe1-47cb-a5a2-708d632a602e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:32.109038 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d604a5f-6fe1-47cb-a5a2-708d632a602e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:32.110129 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d604a5f-6fe1-47cb-a5a2-708d632a602e None admin] RBAC: Adding query filter params (role.id=b93b6b2c6da44593a6b95db1309b8a58, scope.project.id=342524b45def418783374ff6733e94b9, user.id=07d2ee351e734fd09938cea9be3bb08a) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:32.110511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d604a5f-6fe1-47cb-a5a2-708d632a602e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:32.112254 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d604a5f-6fe1-47cb-a5a2-708d632a602e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:32.125008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 602/1219] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:59:31 2022] GET /identity/v3/role_assignments?user.id=07d2ee351e734fd09938cea9be3bb08a&scope.project.id=342524b45def418783374ff6733e94b9&role.id=b93b6b2c6da44593a6b95db1309b8a58 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:34.303274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170488c-3490-46ff-abe4-6adc300858c0 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:34.303969 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170488c-3490-46ff-abe4-6adc300858c0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:34.303969 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170488c-3490-46ff-abe4-6adc300858c0 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:34.305302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 618/1220] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 06:59:34.311105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803dd5b-868f-4aa0-9dc6-e9b8d155e3d4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:34.311585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803dd5b-868f-4aa0-9dc6-e9b8d155e3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:34.311669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803dd5b-868f-4aa0-9dc6-e9b8d155e3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:34.333103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e803dd5b-868f-4aa0-9dc6-e9b8d155e3d4 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:59:34.335018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e803dd5b-868f-4aa0-9dc6-e9b8d155e3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:59:34.415693 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 603/1221] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:59:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 06:59:34.441250 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170488c-3490-46ff-abe4-6adc300858c0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:34.551368 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170488c-3490-46ff-abe4-6adc300858c0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:34.586636 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740748c-ae8e-4afe-8d43-a4afa319e3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:34.587255 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740748c-ae8e-4afe-8d43-a4afa319e3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:34.587534 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740748c-ae8e-4afe-8d43-a4afa319e3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:34.587799 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740748c-ae8e-4afe-8d43-a4afa319e3a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:34.598365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740748c-ae8e-4afe-8d43-a4afa319e3a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:59:34.603762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-b740748c-ae8e-4afe-8d43-a4afa319e3a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:59:34.603762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:34.603762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:34.603762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:34.603762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:34.603762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:34.603762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:34.603762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:34.603762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:34.603762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:34.603762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:34.603762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:34.603762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:59:34.603762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:59:34.603762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:59:34.603762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:59:34.605088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:59:34.605088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:59:34.605088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:59:34.605088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:59:34.605088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:34.605088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:34.605088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:34.605088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:34.605088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:34.605088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:34.605088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:34.605088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:34.605088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:34.605088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:34.605088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:34.605088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:34.605994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:34.605994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:34.605994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:34.605994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:34.605994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:59:34.605994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:59:34.605994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:59:34.605994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:59:34.605994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:59:34.605994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:59:34.605994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:59:34.605994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:59:34.605994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 619/1222] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:59:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:34.610891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803dd5b-868f-4aa0-9dc6-e9b8d155e3d4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:34.716097 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803dd5b-868f-4aa0-9dc6-e9b8d155e3d4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:34.741609 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:34.754637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c10227-426a-43f4-a241-a9617a5e506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:34.755600 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c10227-426a-43f4-a241-a9617a5e506a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:34.755995 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c10227-426a-43f4-a241-a9617a5e506a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:34.756802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c10227-426a-43f4-a241-a9617a5e506a None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:34.757698 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c10227-426a-43f4-a241-a9617a5e506a None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:34.758047 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c10227-426a-43f4-a241-a9617a5e506a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:34.759805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c10227-426a-43f4-a241-a9617a5e506a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:34.769048 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 604/1223] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:59:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:34.775740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740748c-ae8e-4afe-8d43-a4afa319e3a3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:34.825301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:34.893771 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740748c-ae8e-4afe-8d43-a4afa319e3a3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:34.928682 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca0590-fdd8-417a-a6d5-ec70f06b2232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:34.929297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca0590-fdd8-417a-a6d5-ec70f06b2232 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:34.929570 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca0590-fdd8-417a-a6d5-ec70f06b2232 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:34.929890 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca0590-fdd8-417a-a6d5-ec70f06b2232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:34.940576 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca0590-fdd8-417a-a6d5-ec70f06b2232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:34.941991 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca0590-fdd8-417a-a6d5-ec70f06b2232 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:34.956876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-48ca0590-fdd8-417a-a6d5-ec70f06b2232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:34.956876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:34.956876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:34.956876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:34.956876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:34.956876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:34.956876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:34.956876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:34.956876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:34.956876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:34.956876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:34.956876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:34.956876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:59:34.956876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:59:34.956876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:59:34.956876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:59:34.958045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:34.958045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:34.958045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:34.958045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:34.958045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:34.958045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:34.958045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:34.958045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:34.958045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:34.958045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:34.958045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:34.958045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:34.958045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:34.958045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:34.958045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:34.958045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:34.958045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:59:34.959710 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:59:34.959710 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:34.959710 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:59:34.959710 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 620/1224] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:34.964712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c10227-426a-43f4-a241-a9617a5e506a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:35.075734 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c10227-426a-43f4-a241-a9617a5e506a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:35.111753 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57f44b-62ec-4183-904b-9c0325692009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:35.112360 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57f44b-62ec-4183-904b-9c0325692009 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:35.112637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57f44b-62ec-4183-904b-9c0325692009 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:35.112904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57f44b-62ec-4183-904b-9c0325692009 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:35.113530 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57f44b-62ec-4183-904b-9c0325692009 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:35.113869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57f44b-62ec-4183-904b-9c0325692009 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:35.115458 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57f44b-62ec-4183-904b-9c0325692009 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:35.127297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 605/1225] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:35.133168 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca0590-fdd8-417a-a6d5-ec70f06b2232 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:35.230743 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:35.241334 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca0590-fdd8-417a-a6d5-ec70f06b2232 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:35.278100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18500d15-0c27-43f2-916c-38336012bc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:35.278874 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18500d15-0c27-43f2-916c-38336012bc5e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:35.279325 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18500d15-0c27-43f2-916c-38336012bc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:35.279558 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18500d15-0c27-43f2-916c-38336012bc5e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:35.289234 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18500d15-0c27-43f2-916c-38336012bc5e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:35.290787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18500d15-0c27-43f2-916c-38336012bc5e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:35.305745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-18500d15-0c27-43f2-916c-38336012bc5e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 06:59:35.305745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:35.305745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:35.305745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:35.305745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:35.305745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:35.305745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:35.305745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:35.305745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:35.305745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:35.305745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:35.305745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:35.305745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:59:35.305745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:59:35.305745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:59:35.305745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:59:35.307247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:35.307247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:35.307247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:59:35.307247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:59:35.307247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:59:35.307247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:59:35.307247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:35.307247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:35.307247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:35.307247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:35.307247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:35.307247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:35.307247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:35.307247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:35.307247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:35.307247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:35.307247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:35.307247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:35.308302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:35.308302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:35.308302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:59:35.308302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:59:35.308302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:59:35.308302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:59:35.308302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:59:35.308302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:59:35.308302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 06:59:35.308302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:59:35.308302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 621/1226] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:59:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:35.313637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57f44b-62ec-4183-904b-9c0325692009 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:35.369146 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:35.423724 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57f44b-62ec-4183-904b-9c0325692009 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:35.459317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb307019-a57a-4f43-a0e9-e59f7d63d108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:35.459938 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb307019-a57a-4f43-a0e9-e59f7d63d108 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:35.460211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb307019-a57a-4f43-a0e9-e59f7d63d108 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:35.460494 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb307019-a57a-4f43-a0e9-e59f7d63d108 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:35.461239 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb307019-a57a-4f43-a0e9-e59f7d63d108 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:35.461537 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb307019-a57a-4f43-a0e9-e59f7d63d108 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:35.462950 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb307019-a57a-4f43-a0e9-e59f7d63d108 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:35.481307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 606/1227] 10.222.0.40 () {56 vars in 1143 bytes} [Tue Aug 9 06:59:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:35.487027 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18500d15-0c27-43f2-916c-38336012bc5e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:35.595815 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18500d15-0c27-43f2-916c-38336012bc5e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:35.633684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd84b6-68ca-4eaa-962e-8e5ce52aaf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:35.634760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd84b6-68ca-4eaa-962e-8e5ce52aaf4c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:35.635242 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd84b6-68ca-4eaa-962e-8e5ce52aaf4c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:35.635513 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd84b6-68ca-4eaa-962e-8e5ce52aaf4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:35.647211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd84b6-68ca-4eaa-962e-8e5ce52aaf4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:35.648664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd84b6-68ca-4eaa-962e-8e5ce52aaf4c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:35.664587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-75fd84b6-68ca-4eaa-962e-8e5ce52aaf4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:35.664587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:35.664587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:35.664587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:35.664587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:35.664587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:35.664587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:35.664587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:35.664587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:35.664587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:35.664587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:35.664587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:35.664587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:59:35.664587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:59:35.664587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:59:35.664587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:59:35.665736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:35.665736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:35.665736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:35.665736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:35.665736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:35.665736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:35.665736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:35.665736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:35.665736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:35.665736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:35.665736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:35.665736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:35.665736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:35.665736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:35.665736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:35.665736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:35.665736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:59:35.667266 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:59:35.667266 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:35.667266 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:59:35.667266 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 622/1228] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:35.672068 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb307019-a57a-4f43-a0e9-e59f7d63d108 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:35.784870 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb307019-a57a-4f43-a0e9-e59f7d63d108 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:35.788789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:35.828008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f8890-fd51-4437-8847-8c8a0bdd607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:35.828611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f8890-fd51-4437-8847-8c8a0bdd607b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:35.828891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f8890-fd51-4437-8847-8c8a0bdd607b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:35.829160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f8890-fd51-4437-8847-8c8a0bdd607b None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:35.829794 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f8890-fd51-4437-8847-8c8a0bdd607b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:35.830117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f8890-fd51-4437-8847-8c8a0bdd607b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:35.831489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f8890-fd51-4437-8847-8c8a0bdd607b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:35.850240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 607/1229] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:35.851681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd84b6-68ca-4eaa-962e-8e5ce52aaf4c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:35.861153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:35.958219 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd84b6-68ca-4eaa-962e-8e5ce52aaf4c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:35.996541 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422955b-ec17-45d1-9167-2f0e0a0e7631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:35.997175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422955b-ec17-45d1-9167-2f0e0a0e7631 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:35.997449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422955b-ec17-45d1-9167-2f0e0a0e7631 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:35.997716 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422955b-ec17-45d1-9167-2f0e0a0e7631 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:36.006083 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422955b-ec17-45d1-9167-2f0e0a0e7631 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:36.008000 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422955b-ec17-45d1-9167-2f0e0a0e7631 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:36.022464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-2422955b-ec17-45d1-9167-2f0e0a0e7631 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:59:36.022464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:36.022464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:36.022464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:36.022464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:36.022464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:36.022464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:36.022464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:36.022464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:36.022464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:36.022464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:36.022464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:36.022464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:59:36.022464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:59:36.022464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:59:36.023591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:59:36.023591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:36.023591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:36.023591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:36.023591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:36.023591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:36.023591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:36.023591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:36.023591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:36.023591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:36.023591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:36.023591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:36.023591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:36.023591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:36.023591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:36.023591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:36.023591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:36.024992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:59:36.024992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:59:36.024992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:59:36.024992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:59:36.024992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:59:36.024992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:59:36.024992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:59:36.024992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:59:36.024992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 623/1230] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:59:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:59:36.030654 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f8890-fd51-4437-8847-8c8a0bdd607b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:36.164120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f8890-fd51-4437-8847-8c8a0bdd607b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:36.206716 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb43c3-8a47-4fb2-b084-8c399942f65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:36.207359 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb43c3-8a47-4fb2-b084-8c399942f65f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:36.207774 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb43c3-8a47-4fb2-b084-8c399942f65f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:36.208184 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb43c3-8a47-4fb2-b084-8c399942f65f None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:36.209552 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb43c3-8a47-4fb2-b084-8c399942f65f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:36.209901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb43c3-8a47-4fb2-b084-8c399942f65f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:36.212107 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb43c3-8a47-4fb2-b084-8c399942f65f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:36.227513 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 608/1231] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:59:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:36.233761 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422955b-ec17-45d1-9167-2f0e0a0e7631 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:36.319310 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:36.358053 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422955b-ec17-45d1-9167-2f0e0a0e7631 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:36.393360 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea5507-93fd-4f18-83e1-6f938c14a150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:36.394016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea5507-93fd-4f18-83e1-6f938c14a150 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:36.394296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea5507-93fd-4f18-83e1-6f938c14a150 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:36.394569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea5507-93fd-4f18-83e1-6f938c14a150 None admin] PATH_INFO: `/v3/projects/342524b45def418783374ff6733e94b9/users/07d2ee351e734fd09938cea9be3bb08a/roles/b93b6b2c6da44593a6b95db1309b8a58` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:36.410909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea5507-93fd-4f18-83e1-6f938c14a150 None admin] RBAC: Authorizing `identity:create_grant(project_id=342524b45def418783374ff6733e94b9, user_id=07d2ee351e734fd09938cea9be3bb08a, role_id=b93b6b2c6da44593a6b95db1309b8a58)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:36.412995 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea5507-93fd-4f18-83e1-6f938c14a150 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:36.426577 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 624/1232] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:59:36 2022] PUT /identity/v3/projects/342524b45def418783374ff6733e94b9/users/07d2ee351e734fd09938cea9be3bb08a/roles/b93b6b2c6da44593a6b95db1309b8a58 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:59:38.439913 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5438-8ef6-4ffb-8849-ac0aeea476c6 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:38.440484 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5438-8ef6-4ffb-8849-ac0aeea476c6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:38.440484 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5438-8ef6-4ffb-8849-ac0aeea476c6 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:38.441962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 609/1233] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:59:38.447460 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7c3bc-ccb2-4908-8542-823237647dba None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:38.447939 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7c3bc-ccb2-4908-8542-823237647dba None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:38.448060 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7c3bc-ccb2-4908-8542-823237647dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:38.466530 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2fa7c3bc-ccb2-4908-8542-823237647dba None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:59:38.467754 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2fa7c3bc-ccb2-4908-8542-823237647dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:59:38.535762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 625/1234] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:59:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:59:38.561505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe5438-8ef6-4ffb-8849-ac0aeea476c6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:38.588462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:38.667525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe5438-8ef6-4ffb-8849-ac0aeea476c6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:38.700516 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5149b-4603-401a-b4e8-7aa1a6706b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:38.701058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5149b-4603-401a-b4e8-7aa1a6706b90 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:38.701329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5149b-4603-401a-b4e8-7aa1a6706b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:38.701597 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5149b-4603-401a-b4e8-7aa1a6706b90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:38.712616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5149b-4603-401a-b4e8-7aa1a6706b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:59:38.717308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-50a5149b-4603-401a-b4e8-7aa1a6706b90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:59:38.717308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:38.717308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:38.717308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:38.717308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:38.717308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:38.717308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:38.717308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:38.717308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:38.717308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:38.717308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:38.717308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:38.717308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:59:38.717308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:59:38.717308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:59:38.717308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:59:38.718422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:59:38.718422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:59:38.718422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:59:38.718422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:59:38.718422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:38.718422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:38.718422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:38.718422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:38.718422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:38.718422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:38.718422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:38.718422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:38.718422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:38.718422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:38.718422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:38.718422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:38.719781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:38.719781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:38.719781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:38.719781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:38.719781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:59:38.719781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:59:38.719781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:59:38.719781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:59:38.719781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:59:38.719781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:59:38.719781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 06:59:38.719781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:59:38.719781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 610/1235] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Aug 9 06:59:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:38.724731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7c3bc-ccb2-4908-8542-823237647dba None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:38.771338 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:38.830694 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7c3bc-ccb2-4908-8542-823237647dba None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:38.867909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd12d0-3234-4442-a261-8c179836d804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:38.868545 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd12d0-3234-4442-a261-8c179836d804 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:38.868824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd12d0-3234-4442-a261-8c179836d804 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:38.869094 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd12d0-3234-4442-a261-8c179836d804 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:38.869756 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd12d0-3234-4442-a261-8c179836d804 None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:38.870057 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd12d0-3234-4442-a261-8c179836d804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:38.871445 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd12d0-3234-4442-a261-8c179836d804 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:38.879364 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 626/1236] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Aug 9 06:59:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:38.885426 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5149b-4603-401a-b4e8-7aa1a6706b90 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:38.974410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:38.992169 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5149b-4603-401a-b4e8-7aa1a6706b90 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:39.027476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7728010-cedc-45dc-b711-3f6354139bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:39.028098 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7728010-cedc-45dc-b711-3f6354139bad None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:39.028378 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7728010-cedc-45dc-b711-3f6354139bad None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:39.028647 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7728010-cedc-45dc-b711-3f6354139bad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:39.039349 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7728010-cedc-45dc-b711-3f6354139bad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:39.040751 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7728010-cedc-45dc-b711-3f6354139bad None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:39.056577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a7728010-cedc-45dc-b711-3f6354139bad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:39.056577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:39.056577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:39.056577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:39.056577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:39.056577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:39.056577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:39.056577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:39.056577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:39.056577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:39.056577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:39.056577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:39.056577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:59:39.056577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:59:39.056577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:59:39.056577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:59:39.057711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:39.057711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:39.057711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:39.057711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:39.057711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:39.057711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:39.057711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:39.057711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:39.057711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:39.057711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:39.057711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:39.057711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:39.057711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:39.057711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:39.057711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:39.057711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:39.057711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:59:39.058609 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:59:39.058609 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:39.058609 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:59:39.058609 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 611/1237] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:39.064475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd12d0-3234-4442-a261-8c179836d804 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:39.181264 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd12d0-3234-4442-a261-8c179836d804 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:39.190846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:39.220356 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e2ddb-0e91-4e0c-a0e2-71f233f35264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:39.221678 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e2ddb-0e91-4e0c-a0e2-71f233f35264 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:39.221956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e2ddb-0e91-4e0c-a0e2-71f233f35264 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:39.222226 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e2ddb-0e91-4e0c-a0e2-71f233f35264 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:39.222865 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e2ddb-0e91-4e0c-a0e2-71f233f35264 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:39.223197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e2ddb-0e91-4e0c-a0e2-71f233f35264 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:39.225421 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e2ddb-0e91-4e0c-a0e2-71f233f35264 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:39.237488 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 627/1238] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:39.243423 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7728010-cedc-45dc-b711-3f6354139bad None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:39.363881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7728010-cedc-45dc-b711-3f6354139bad None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:39.399076 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257077c3-4bd3-4a5d-aad6-007da07ceac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:39.399726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257077c3-4bd3-4a5d-aad6-007da07ceac7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:39.400005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257077c3-4bd3-4a5d-aad6-007da07ceac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:39.400264 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257077c3-4bd3-4a5d-aad6-007da07ceac7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:39.402903 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:39.408511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257077c3-4bd3-4a5d-aad6-007da07ceac7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:39.409941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257077c3-4bd3-4a5d-aad6-007da07ceac7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:39.420949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-257077c3-4bd3-4a5d-aad6-007da07ceac7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 06:59:39.420949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:39.420949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:39.420949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:39.420949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:39.420949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:39.420949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:39.420949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:39.420949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:39.420949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:39.420949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:39.420949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:39.420949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:59:39.420949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:59:39.420949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:59:39.420949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:59:39.422180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:39.422180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:39.422180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:59:39.422180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:59:39.422180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:59:39.422180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:59:39.422180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:39.422180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:39.422180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:39.422180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:39.422180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:39.422180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:39.422180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:39.422180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:39.422180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:39.422180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:39.422180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:39.422180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:39.423408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:39.423408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:39.423408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:59:39.423408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:59:39.423408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:59:39.423408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:59:39.423408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:59:39.423408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:59:39.423408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 06:59:39.423408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:59:39.423408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 612/1239] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:59:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:39.428655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e2ddb-0e91-4e0c-a0e2-71f233f35264 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:39.538071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e2ddb-0e91-4e0c-a0e2-71f233f35264 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:39.574537 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb373235-41e5-48e0-85b3-4add47388e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:39.575163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb373235-41e5-48e0-85b3-4add47388e00 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:39.575440 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb373235-41e5-48e0-85b3-4add47388e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:39.575706 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb373235-41e5-48e0-85b3-4add47388e00 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:39.576441 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb373235-41e5-48e0-85b3-4add47388e00 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:39.576739 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb373235-41e5-48e0-85b3-4add47388e00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:39.578400 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb373235-41e5-48e0-85b3-4add47388e00 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:39.596359 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 628/1240] 10.222.0.40 () {56 vars in 1143 bytes} [Tue Aug 9 06:59:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:59:39.602688 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257077c3-4bd3-4a5d-aad6-007da07ceac7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:39.715371 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257077c3-4bd3-4a5d-aad6-007da07ceac7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:39.752390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e4718-2e6a-41d8-bbd3-3f1ef900d340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:39.752963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e4718-2e6a-41d8-bbd3-3f1ef900d340 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:39.753243 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e4718-2e6a-41d8-bbd3-3f1ef900d340 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:39.753512 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e4718-2e6a-41d8-bbd3-3f1ef900d340 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:39.818236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:39.825309 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e4718-2e6a-41d8-bbd3-3f1ef900d340 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:39.826752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e4718-2e6a-41d8-bbd3-3f1ef900d340 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:39.927892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 613/1241] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:59:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 06:59:39.933908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb373235-41e5-48e0-85b3-4add47388e00 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:39.964597 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:40.046807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb373235-41e5-48e0-85b3-4add47388e00 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:40.084286 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f48af-6c57-4e44-b09e-0bc0415630ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:40.084844 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f48af-6c57-4e44-b09e-0bc0415630ea None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:40.085116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f48af-6c57-4e44-b09e-0bc0415630ea None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:40.085381 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f48af-6c57-4e44-b09e-0bc0415630ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:40.095947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f48af-6c57-4e44-b09e-0bc0415630ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:40.097400 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f48af-6c57-4e44-b09e-0bc0415630ea None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:40.113491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-ee4f48af-6c57-4e44-b09e-0bc0415630ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:40.113491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:40.113491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:40.113491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:40.113491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:40.113491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:40.113491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:40.113491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:40.113491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:40.113491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:40.113491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:40.113491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:40.113491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:59:40.113491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:59:40.113491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:59:40.113491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:59:40.115160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:40.115160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:40.115160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:40.115160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:40.115160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:40.115160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:40.115160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:40.115160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:40.115160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:40.115160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:40.115160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:40.115160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:40.115160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:40.115160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:40.115160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:40.115160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:40.115160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:59:40.116081 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:59:40.116081 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:40.116081 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:59:40.116081 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 629/1242] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:40.121561 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e4718-2e6a-41d8-bbd3-3f1ef900d340 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:40.227868 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:40.234012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e4718-2e6a-41d8-bbd3-3f1ef900d340 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:40.270692 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059e52c-3599-41a9-a7da-8eb0a750116b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:40.271647 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059e52c-3599-41a9-a7da-8eb0a750116b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:40.271939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059e52c-3599-41a9-a7da-8eb0a750116b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:40.272070 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059e52c-3599-41a9-a7da-8eb0a750116b None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:40.272683 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059e52c-3599-41a9-a7da-8eb0a750116b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:40.273034 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059e52c-3599-41a9-a7da-8eb0a750116b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:40.274338 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059e52c-3599-41a9-a7da-8eb0a750116b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:40.286218 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 614/1243] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:40.293423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f48af-6c57-4e44-b09e-0bc0415630ea None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:40.388687 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:40.415557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f48af-6c57-4e44-b09e-0bc0415630ea None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:40.454307 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbe688-82bb-45ed-bcb2-2140576c685b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:40.454939 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbe688-82bb-45ed-bcb2-2140576c685b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:40.455249 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbe688-82bb-45ed-bcb2-2140576c685b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:40.455523 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbe688-82bb-45ed-bcb2-2140576c685b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:40.463704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbe688-82bb-45ed-bcb2-2140576c685b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:40.465533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbe688-82bb-45ed-bcb2-2140576c685b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:40.479975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3ebbe688-82bb-45ed-bcb2-2140576c685b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:59:40.479975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:40.479975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:40.479975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:40.479975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:40.479975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:40.479975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:40.479975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:40.479975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:40.479975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:40.479975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:40.479975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:40.479975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:59:40.479975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:59:40.479975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:59:40.481067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:59:40.481067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:40.481067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:40.481067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:40.481067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:40.481067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:40.481067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:40.481067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:40.481067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:40.481067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:40.481067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:40.481067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:40.481067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:40.481067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:40.481067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:40.481067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:40.481067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:40.482025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:59:40.482025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:59:40.482025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:59:40.482025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:59:40.482025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:59:40.482025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:59:40.482025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:59:40.482025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:59:40.482025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 630/1244] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:59:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:40.488224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059e52c-3599-41a9-a7da-8eb0a750116b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:40.603797 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059e52c-3599-41a9-a7da-8eb0a750116b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:40.642395 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c584f-2f7d-474f-a8fa-86866a29a159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:40.643241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c584f-2f7d-474f-a8fa-86866a29a159 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:40.643661 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c584f-2f7d-474f-a8fa-86866a29a159 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:40.644080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c584f-2f7d-474f-a8fa-86866a29a159 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:40.645082 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c584f-2f7d-474f-a8fa-86866a29a159 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:40.645474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c584f-2f7d-474f-a8fa-86866a29a159 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:40.648238 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c584f-2f7d-474f-a8fa-86866a29a159 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:40.662294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 615/1245] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:59:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:40.668692 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbe688-82bb-45ed-bcb2-2140576c685b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:40.780858 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbe688-82bb-45ed-bcb2-2140576c685b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:40.815588 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b0dab-3115-40dc-a523-8a997284bcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:40.816186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b0dab-3115-40dc-a523-8a997284bcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:40.816461 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b0dab-3115-40dc-a523-8a997284bcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:40.816728 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b0dab-3115-40dc-a523-8a997284bcf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:40.817442 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b0dab-3115-40dc-a523-8a997284bcf8 None admin] RBAC: Adding query filter params (role.id=b93b6b2c6da44593a6b95db1309b8a58, scope.project.id=342524b45def418783374ff6733e94b9, user.id=07d2ee351e734fd09938cea9be3bb08a) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:40.818235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b0dab-3115-40dc-a523-8a997284bcf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:40.819708 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b0dab-3115-40dc-a523-8a997284bcf8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:40.839112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 631/1246] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:59:40 2022] GET /identity/v3/role_assignments?user.id=07d2ee351e734fd09938cea9be3bb08a&scope.project.id=342524b45def418783374ff6733e94b9&role.id=b93b6b2c6da44593a6b95db1309b8a58 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:59:42.975770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7928c-eeed-4c0a-918a-364bac577aba None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:42.976331 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7928c-eeed-4c0a-918a-364bac577aba None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:42.976331 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7928c-eeed-4c0a-918a-364bac577aba None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:42.977839 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 616/1247] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:59:42.983753 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fedb6-d6f6-4115-a0d9-8b5610a88b3c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:42.984262 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fedb6-d6f6-4115-a0d9-8b5610a88b3c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:42.984495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fedb6-d6f6-4115-a0d9-8b5610a88b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:42.992024 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:43.006859 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5b5fedb6-d6f6-4115-a0d9-8b5610a88b3c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:59:43.008253 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5b5fedb6-d6f6-4115-a0d9-8b5610a88b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:59:43.094391 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 632/1248] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:59:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:59:43.120649 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7928c-eeed-4c0a-918a-364bac577aba None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:43.145374 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:43.243125 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7928c-eeed-4c0a-918a-364bac577aba None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:43.283772 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f91834-d517-4467-9d3c-ed77862fea9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:43.284648 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f91834-d517-4467-9d3c-ed77862fea9c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:43.285026 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f91834-d517-4467-9d3c-ed77862fea9c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:43.285351 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f91834-d517-4467-9d3c-ed77862fea9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:43.301315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f91834-d517-4467-9d3c-ed77862fea9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:59:43.309641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b8f91834-d517-4467-9d3c-ed77862fea9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:59:43.309641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:43.309641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:43.309641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:43.309641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:43.309641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:43.309641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:43.309641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:43.309641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:43.309641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:43.309641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:43.309641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:43.309641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:59:43.309641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:59:43.309641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:59:43.309641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:59:43.310629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:59:43.310629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:59:43.310629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:59:43.310629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:59:43.310629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:43.310629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:43.310629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:43.310629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:43.310629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:43.310629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:43.310629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:43.310629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:43.310629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:43.310629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:43.310629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:43.310629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:43.311618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:43.311618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:43.311618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:43.311618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:43.311618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:59:43.311618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:59:43.311618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:59:43.311618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:59:43.311618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:59:43.311618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:59:43.311618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:59:43.311618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:59:43.311618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 617/1249] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:59:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:43.318371 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fedb6-d6f6-4115-a0d9-8b5610a88b3c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:43.438360 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fedb6-d6f6-4115-a0d9-8b5610a88b3c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:43.470906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:43.477110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0780c8-0a73-4219-824d-9676047bb1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:43.477715 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0780c8-0a73-4219-824d-9676047bb1ae None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:43.477991 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0780c8-0a73-4219-824d-9676047bb1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:43.478263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0780c8-0a73-4219-824d-9676047bb1ae None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:43.478974 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0780c8-0a73-4219-824d-9676047bb1ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:43.479303 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0780c8-0a73-4219-824d-9676047bb1ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:43.480707 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0780c8-0a73-4219-824d-9676047bb1ae None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:43.490158 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 633/1250] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:59:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:43.496690 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f91834-d517-4467-9d3c-ed77862fea9c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:43.586454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:43.613066 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f91834-d517-4467-9d3c-ed77862fea9c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:43.662127 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ac99b-2959-464c-bc3c-2f909b8ade4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:43.662603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ac99b-2959-464c-bc3c-2f909b8ade4d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:43.662875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ac99b-2959-464c-bc3c-2f909b8ade4d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:43.663168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ac99b-2959-464c-bc3c-2f909b8ade4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:43.674195 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ac99b-2959-464c-bc3c-2f909b8ade4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:43.675670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ac99b-2959-464c-bc3c-2f909b8ade4d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:43.693674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-024ac99b-2959-464c-bc3c-2f909b8ade4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:43.693674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:43.693674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:43.693674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:43.693674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:43.693674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:43.693674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:43.693674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:43.693674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:43.693674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:43.693674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:43.693674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:43.693674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:59:43.693674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:59:43.693674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:59:43.693674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:59:43.694863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:43.694863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:43.694863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:43.694863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:43.694863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:43.694863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:43.694863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:43.694863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:43.694863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:43.694863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:43.694863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:43.694863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:43.694863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:43.694863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:43.694863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:43.694863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:43.694863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:59:43.695827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:59:43.695827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:43.695827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:59:43.695827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 618/1251] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:43.700770 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0780c8-0a73-4219-824d-9676047bb1ae None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:43.809672 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0780c8-0a73-4219-824d-9676047bb1ae None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:43.848039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e739a5-60e5-4756-bd5b-8e37405053fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:43.849380 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e739a5-60e5-4756-bd5b-8e37405053fc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:43.849842 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e739a5-60e5-4756-bd5b-8e37405053fc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:43.850299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e739a5-60e5-4756-bd5b-8e37405053fc None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:43.851267 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e739a5-60e5-4756-bd5b-8e37405053fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:43.851580 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e739a5-60e5-4756-bd5b-8e37405053fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:43.853385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e739a5-60e5-4756-bd5b-8e37405053fc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:43.868481 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 634/1252] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:43.875113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ac99b-2959-464c-bc3c-2f909b8ade4d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:43.991071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ac99b-2959-464c-bc3c-2f909b8ade4d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:44.021363 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:44.030291 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb4122-b515-44a1-8727-ac50d86aae21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:44.030921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb4122-b515-44a1-8727-ac50d86aae21 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:44.031242 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb4122-b515-44a1-8727-ac50d86aae21 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:44.031526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb4122-b515-44a1-8727-ac50d86aae21 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:44.039727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb4122-b515-44a1-8727-ac50d86aae21 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:44.041183 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb4122-b515-44a1-8727-ac50d86aae21 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:44.053873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a2fb4122-b515-44a1-8727-ac50d86aae21 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 06:59:44.053873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:44.053873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:44.053873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:44.053873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:44.053873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:44.053873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:44.053873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:44.053873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:44.053873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:44.053873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:44.053873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:44.053873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:59:44.053873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:59:44.053873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:59:44.053873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:59:44.055105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:44.055105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:44.055105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:59:44.055105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:59:44.055105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:59:44.055105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:59:44.055105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:44.055105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:44.055105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:44.055105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:44.055105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:44.055105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:44.055105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:44.055105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:44.055105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:44.055105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:44.055105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:44.055105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:44.056204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:44.056204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:44.056204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:59:44.056204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:59:44.056204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:59:44.056204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:59:44.056204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:59:44.056204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:59:44.056204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 06:59:44.056204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:59:44.056204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 619/1253] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:59:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:44.061508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e739a5-60e5-4756-bd5b-8e37405053fc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:44.127767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:44.177093 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e739a5-60e5-4756-bd5b-8e37405053fc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:44.216591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a39e53-5ad8-46af-a7d5-689b5e73f743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:44.217207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a39e53-5ad8-46af-a7d5-689b5e73f743 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:44.217485 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a39e53-5ad8-46af-a7d5-689b5e73f743 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:44.217757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a39e53-5ad8-46af-a7d5-689b5e73f743 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:44.218487 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a39e53-5ad8-46af-a7d5-689b5e73f743 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:44.218793 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a39e53-5ad8-46af-a7d5-689b5e73f743 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:44.220283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a39e53-5ad8-46af-a7d5-689b5e73f743 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:44.243138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 635/1254] 10.222.0.40 () {56 vars in 1143 bytes} [Tue Aug 9 06:59:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:44.249486 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb4122-b515-44a1-8727-ac50d86aae21 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:44.378446 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb4122-b515-44a1-8727-ac50d86aae21 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:44.414571 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29117d5a-643d-4030-baf9-03b39b3f1019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:44.415235 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29117d5a-643d-4030-baf9-03b39b3f1019 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:44.415519 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29117d5a-643d-4030-baf9-03b39b3f1019 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:44.415828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29117d5a-643d-4030-baf9-03b39b3f1019 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:44.478970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:44.493218 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29117d5a-643d-4030-baf9-03b39b3f1019 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:44.494701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29117d5a-643d-4030-baf9-03b39b3f1019 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:44.599677 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 620/1255] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:59:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 06:59:44.605402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a39e53-5ad8-46af-a7d5-689b5e73f743 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:44.719863 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a39e53-5ad8-46af-a7d5-689b5e73f743 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:44.733140 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:44.757239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cc07f-a3a9-4f63-8a06-9d0e668c42ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:44.757859 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cc07f-a3a9-4f63-8a06-9d0e668c42ae None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:44.758134 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cc07f-a3a9-4f63-8a06-9d0e668c42ae None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:44.758416 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cc07f-a3a9-4f63-8a06-9d0e668c42ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:44.768174 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cc07f-a3a9-4f63-8a06-9d0e668c42ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:44.769593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cc07f-a3a9-4f63-8a06-9d0e668c42ae None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:44.783322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f67cc07f-a3a9-4f63-8a06-9d0e668c42ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:44.783322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:44.783322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:44.783322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:44.783322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:44.783322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:44.783322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:44.783322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:44.783322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:44.783322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:44.783322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:44.783322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:44.783322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:59:44.783322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:59:44.783322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:59:44.783322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:59:44.784448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:44.784448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:44.784448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:44.784448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:44.784448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:44.784448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:44.784448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:44.784448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:44.784448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:44.784448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:44.784448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:44.784448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:44.784448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:44.784448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:44.784448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:44.784448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:44.784448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:59:44.785544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:59:44.785544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:44.785544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:59:44.787411 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 636/1256] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:44.790914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29117d5a-643d-4030-baf9-03b39b3f1019 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:44.882160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:44.895432 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29117d5a-643d-4030-baf9-03b39b3f1019 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:44.935314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f2aa4-2a19-4d42-b562-792eb9bf12c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:44.936000 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f2aa4-2a19-4d42-b562-792eb9bf12c6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:44.936309 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f2aa4-2a19-4d42-b562-792eb9bf12c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:44.936614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f2aa4-2a19-4d42-b562-792eb9bf12c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:44.937342 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f2aa4-2a19-4d42-b562-792eb9bf12c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:44.937642 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f2aa4-2a19-4d42-b562-792eb9bf12c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:44.938987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f2aa4-2a19-4d42-b562-792eb9bf12c6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:44.951683 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 621/1257] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:44.957655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cc07f-a3a9-4f63-8a06-9d0e668c42ae None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:45.078511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cc07f-a3a9-4f63-8a06-9d0e668c42ae None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:45.117051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58cd110-088a-48eb-8e98-ba833221c241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:45.117713 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cd110-088a-48eb-8e98-ba833221c241 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:45.117994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cd110-088a-48eb-8e98-ba833221c241 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:45.118308 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cd110-088a-48eb-8e98-ba833221c241 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:45.125017 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58cd110-088a-48eb-8e98-ba833221c241 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:45.126452 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58cd110-088a-48eb-8e98-ba833221c241 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:45.138100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f58cd110-088a-48eb-8e98-ba833221c241 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:59:45.138100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:45.138100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:45.138100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:45.138100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:45.138100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:45.138100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:45.138100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:45.138100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:45.138100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:45.138100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:45.138100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:45.138100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:59:45.138100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:59:45.138100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:59:45.139213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:59:45.139213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:45.139213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:45.139213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:45.139213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:45.139213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:45.139213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:45.139213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:45.139213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:45.139213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:45.139213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:45.139213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:45.139213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:45.139213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:45.139213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:45.139213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:45.139213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:45.140300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:59:45.140300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:59:45.140300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:59:45.140300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:59:45.140300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:59:45.140300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:59:45.140300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:59:45.140300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:59:45.140300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 637/1258] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:59:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:45.145149 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f2aa4-2a19-4d42-b562-792eb9bf12c6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:45.256069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f2aa4-2a19-4d42-b562-792eb9bf12c6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:45.298277 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fae8e-a111-4cf5-b3db-d4c0692d183b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:45.299003 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fae8e-a111-4cf5-b3db-d4c0692d183b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:45.299435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fae8e-a111-4cf5-b3db-d4c0692d183b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:45.299721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fae8e-a111-4cf5-b3db-d4c0692d183b None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:45.300517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5fae8e-a111-4cf5-b3db-d4c0692d183b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:45.300834 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5fae8e-a111-4cf5-b3db-d4c0692d183b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:45.303047 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5fae8e-a111-4cf5-b3db-d4c0692d183b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:45.317693 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 622/1259] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:59:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:45.323979 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58cd110-088a-48eb-8e98-ba833221c241 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:45.352700 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:45.434017 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58cd110-088a-48eb-8e98-ba833221c241 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:45.471521 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf61b83-3a90-4834-aaa7-517f1695ae36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:45.472132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf61b83-3a90-4834-aaa7-517f1695ae36 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:45.472394 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf61b83-3a90-4834-aaa7-517f1695ae36 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:45.472659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf61b83-3a90-4834-aaa7-517f1695ae36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:45.473378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf61b83-3a90-4834-aaa7-517f1695ae36 None admin] RBAC: Adding query filter params (role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.project.id=342524b45def418783374ff6733e94b9, user.id=07d2ee351e734fd09938cea9be3bb08a) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:45.474298 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf61b83-3a90-4834-aaa7-517f1695ae36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:45.476019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf61b83-3a90-4834-aaa7-517f1695ae36 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:45.481414 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 638/1260] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:59:45 2022] GET /identity/v3/role_assignments?user.id=07d2ee351e734fd09938cea9be3bb08a&scope.project.id=342524b45def418783374ff6733e94b9&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:47.488681 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fc8df-ade3-424a-8895-0769bba49238 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:47.489283 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fc8df-ade3-424a-8895-0769bba49238 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:47.489283 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fc8df-ade3-424a-8895-0769bba49238 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:47.490855 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 623/1261] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:59:47.496100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c490059-c43a-472d-bacb-bb5f94c6243c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:47.496484 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c490059-c43a-472d-bacb-bb5f94c6243c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:47.496641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c490059-c43a-472d-bacb-bb5f94c6243c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:47.513902 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1c490059-c43a-472d-bacb-bb5f94c6243c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:59:47.515066 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1c490059-c43a-472d-bacb-bb5f94c6243c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:59:47.577989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 639/1262] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:59:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:59:47.605468 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fc8df-ade3-424a-8895-0769bba49238 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:47.616218 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:47.704288 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fc8df-ade3-424a-8895-0769bba49238 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:47.737660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e5e0a-d3b3-4cf6-9fcf-c009eb4d8ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:47.738272 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e5e0a-d3b3-4cf6-9fcf-c009eb4d8ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:47.738550 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e5e0a-d3b3-4cf6-9fcf-c009eb4d8ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:47.738870 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e5e0a-d3b3-4cf6-9fcf-c009eb4d8ea4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:47.748609 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e5e0a-d3b3-4cf6-9fcf-c009eb4d8ea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:59:47.753233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b84e5e0a-d3b3-4cf6-9fcf-c009eb4d8ea4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:59:47.753233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:47.753233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:47.753233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:47.753233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:47.753233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:47.753233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:47.753233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:47.753233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:47.753233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:47.753233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:47.753233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:47.753233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:59:47.753233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:59:47.753233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:59:47.753233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:59:47.754321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:59:47.754321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:59:47.754321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:59:47.754321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:59:47.754321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:47.754321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:47.754321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:47.754321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:47.754321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:47.754321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:47.754321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:47.754321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:47.754321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:47.754321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:47.754321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:47.754321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:47.756425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:47.756425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:47.756425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:47.756425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:47.756425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:59:47.756425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:59:47.756425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:59:47.756425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:59:47.756425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:59:47.756425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:59:47.756425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:59:47.756425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:59:47.756425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 624/1263] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:59:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:47.760913 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c490059-c43a-472d-bacb-bb5f94c6243c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:47.779045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:47.856509 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c490059-c43a-472d-bacb-bb5f94c6243c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:47.890633 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397abfd4-fe8c-4caf-8680-1799ed614c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:47.891255 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397abfd4-fe8c-4caf-8680-1799ed614c13 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:47.891535 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397abfd4-fe8c-4caf-8680-1799ed614c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:47.891806 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397abfd4-fe8c-4caf-8680-1799ed614c13 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:47.892459 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397abfd4-fe8c-4caf-8680-1799ed614c13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:47.892761 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397abfd4-fe8c-4caf-8680-1799ed614c13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:47.894103 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397abfd4-fe8c-4caf-8680-1799ed614c13 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:47.902387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 640/1264] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:59:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:47.908366 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e5e0a-d3b3-4cf6-9fcf-c009eb4d8ea4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:47.972694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:48.004255 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e5e0a-d3b3-4cf6-9fcf-c009eb4d8ea4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:48.037207 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcddb5-1d12-470a-869d-90b39122a7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:48.037809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcddb5-1d12-470a-869d-90b39122a7ac None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:48.038087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcddb5-1d12-470a-869d-90b39122a7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:48.038358 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcddb5-1d12-470a-869d-90b39122a7ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:48.047796 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdcddb5-1d12-470a-869d-90b39122a7ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:48.049219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdcddb5-1d12-470a-869d-90b39122a7ac None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:48.062907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-4bdcddb5-1d12-470a-869d-90b39122a7ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:48.062907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:48.062907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:48.062907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:48.062907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:48.062907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:48.062907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:48.062907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:48.062907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:48.062907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:48.062907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:48.062907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:48.062907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:59:48.062907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:59:48.062907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:59:48.062907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:59:48.064117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:48.064117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:48.064117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:48.064117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:48.064117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:48.064117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:48.064117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:48.064117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:48.064117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:48.064117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:48.064117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:48.064117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:48.064117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:48.064117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:48.064117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:48.064117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:48.064117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:59:48.065297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:59:48.065297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:48.065297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:59:48.065297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 625/1265] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:48.070207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397abfd4-fe8c-4caf-8680-1799ed614c13 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:48.147880 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:48.168977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397abfd4-fe8c-4caf-8680-1799ed614c13 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:48.201862 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048a465-1211-4f3a-b40d-992bd75254d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:48.202705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048a465-1211-4f3a-b40d-992bd75254d3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:48.202976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048a465-1211-4f3a-b40d-992bd75254d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:48.203273 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048a465-1211-4f3a-b40d-992bd75254d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:48.203908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048a465-1211-4f3a-b40d-992bd75254d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:48.204211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048a465-1211-4f3a-b40d-992bd75254d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:48.205546 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048a465-1211-4f3a-b40d-992bd75254d3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:48.216730 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 641/1266] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:48.222351 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcddb5-1d12-470a-869d-90b39122a7ac None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:48.323438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcddb5-1d12-470a-869d-90b39122a7ac None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:48.344566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:48.359433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3235ec-ac57-4265-b350-b728257bfe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:48.360061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3235ec-ac57-4265-b350-b728257bfe40 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:48.360341 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3235ec-ac57-4265-b350-b728257bfe40 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:48.360612 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3235ec-ac57-4265-b350-b728257bfe40 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:48.368433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3235ec-ac57-4265-b350-b728257bfe40 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:48.369869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3235ec-ac57-4265-b350-b728257bfe40 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:48.381119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ad3235ec-ac57-4265-b350-b728257bfe40 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 06:59:48.381119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:48.381119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:48.381119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:48.381119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:48.381119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:48.381119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:48.381119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:48.381119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:48.381119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:48.381119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:48.381119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:48.381119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:59:48.381119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:59:48.381119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:59:48.381119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:59:48.382214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:48.382214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:48.382214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:59:48.382214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:59:48.382214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:59:48.382214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:59:48.382214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:48.382214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:48.382214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:48.382214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:48.382214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:48.382214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:48.382214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:48.382214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:48.382214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:48.382214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:48.382214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:48.382214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:48.383236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:48.383236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:48.383236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:59:48.383236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:59:48.383236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:59:48.383236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:59:48.383236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:59:48.383236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:59:48.383236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 06:59:48.383236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:59:48.383236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 626/1267] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:59:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:48.388152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048a465-1211-4f3a-b40d-992bd75254d3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:48.485144 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048a465-1211-4f3a-b40d-992bd75254d3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:48.529604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7742b-d5bd-4e6f-bf01-25413b6def06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:48.530304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7742b-d5bd-4e6f-bf01-25413b6def06 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:48.530462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7742b-d5bd-4e6f-bf01-25413b6def06 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:48.530727 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7742b-d5bd-4e6f-bf01-25413b6def06 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:48.531474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7742b-d5bd-4e6f-bf01-25413b6def06 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:48.531771 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7742b-d5bd-4e6f-bf01-25413b6def06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:48.533157 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7742b-d5bd-4e6f-bf01-25413b6def06 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:48.542238 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:48.551176 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 642/1268] 10.222.0.40 () {56 vars in 1143 bytes} [Tue Aug 9 06:59:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 06:59:48.557517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3235ec-ac57-4265-b350-b728257bfe40 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:48.654926 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3235ec-ac57-4265-b350-b728257bfe40 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:48.687385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354d1d6-8200-45ca-85bf-240c79055dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:48.687994 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354d1d6-8200-45ca-85bf-240c79055dbe None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:48.688266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354d1d6-8200-45ca-85bf-240c79055dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:48.688528 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354d1d6-8200-45ca-85bf-240c79055dbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:48.698489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354d1d6-8200-45ca-85bf-240c79055dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:48.699926 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354d1d6-8200-45ca-85bf-240c79055dbe None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:48.713410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d354d1d6-8200-45ca-85bf-240c79055dbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:48.713410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:48.713410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:48.713410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:48.713410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:48.713410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:48.713410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:48.713410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:48.713410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:48.713410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:48.713410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:48.713410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:48.713410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:59:48.713410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:59:48.713410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:59:48.713410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:59:48.714525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:48.714525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:48.714525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:48.714525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:48.714525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:48.714525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:48.714525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:48.714525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:48.714525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:48.714525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:48.714525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:48.714525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:48.714525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:48.714525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:48.714525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:48.714525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:48.714525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:59:48.715672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:59:48.715672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:48.715672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:59:48.715672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 627/1269] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:48.720187 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7742b-d5bd-4e6f-bf01-25413b6def06 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:48.815131 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7742b-d5bd-4e6f-bf01-25413b6def06 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:48.858159 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d6d72-ee56-475d-a66e-d63fafe34d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:48.858751 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d6d72-ee56-475d-a66e-d63fafe34d81 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:48.859027 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d6d72-ee56-475d-a66e-d63fafe34d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:48.859324 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d6d72-ee56-475d-a66e-d63fafe34d81 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:48.859957 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d6d72-ee56-475d-a66e-d63fafe34d81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:48.860257 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d6d72-ee56-475d-a66e-d63fafe34d81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:48.861653 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d6d72-ee56-475d-a66e-d63fafe34d81 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:48.875115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 643/1270] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:48.880951 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354d1d6-8200-45ca-85bf-240c79055dbe None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:48.911914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:48.977857 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354d1d6-8200-45ca-85bf-240c79055dbe None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:49.009134 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b487262-eed2-4160-baf0-aa15ba8bdcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:49.009734 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487262-eed2-4160-baf0-aa15ba8bdcab None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:49.010007 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487262-eed2-4160-baf0-aa15ba8bdcab None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:49.010273 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487262-eed2-4160-baf0-aa15ba8bdcab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:49.016480 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b487262-eed2-4160-baf0-aa15ba8bdcab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:49.017890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b487262-eed2-4160-baf0-aa15ba8bdcab None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:49.029053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-9b487262-eed2-4160-baf0-aa15ba8bdcab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:59:49.029053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:49.029053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:49.029053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:49.029053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:49.029053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:49.029053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:49.029053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:49.029053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:49.029053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:49.029053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:49.029053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:49.029053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:59:49.029053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:59:49.029053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:59:49.030058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:59:49.030058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:49.030058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:49.030058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:49.030058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:49.030058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:49.030058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:49.030058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:49.030058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:49.030058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:49.030058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:49.030058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:49.030058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:49.030058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:49.030058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:49.030058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:49.030058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:49.030968 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:59:49.030968 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:59:49.030968 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:59:49.030968 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:59:49.030968 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:59:49.030968 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:59:49.030968 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:59:49.030968 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:59:49.030968 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 628/1271] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:59:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 06:59:49.036688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d6d72-ee56-475d-a66e-d63fafe34d81 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:49.092768 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:49.133286 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d6d72-ee56-475d-a66e-d63fafe34d81 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:49.170601 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b61e5-1cbb-4e27-abe6-7d64d48e9842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:49.171148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b61e5-1cbb-4e27-abe6-7d64d48e9842 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:49.171430 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b61e5-1cbb-4e27-abe6-7d64d48e9842 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:49.171699 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b61e5-1cbb-4e27-abe6-7d64d48e9842 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:49.172379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b61e5-1cbb-4e27-abe6-7d64d48e9842 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:49.172679 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b61e5-1cbb-4e27-abe6-7d64d48e9842 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:49.174097 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b61e5-1cbb-4e27-abe6-7d64d48e9842 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:49.185991 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 644/1272] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:59:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:49.191985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b487262-eed2-4160-baf0-aa15ba8bdcab None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:49.279725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:49.289487 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b487262-eed2-4160-baf0-aa15ba8bdcab None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:49.325299 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c771bb6-45fd-41a9-9251-8e06e7ad90f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:49.325943 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c771bb6-45fd-41a9-9251-8e06e7ad90f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:49.326220 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c771bb6-45fd-41a9-9251-8e06e7ad90f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:49.326487 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c771bb6-45fd-41a9-9251-8e06e7ad90f5 None admin] PATH_INFO: `/v3/projects/342524b45def418783374ff6733e94b9/users/07d2ee351e734fd09938cea9be3bb08a/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:49.328604 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c771bb6-45fd-41a9-9251-8e06e7ad90f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=342524b45def418783374ff6733e94b9, user_id=07d2ee351e734fd09938cea9be3bb08a, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:49.330008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c771bb6-45fd-41a9-9251-8e06e7ad90f5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:49.342365 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 629/1273] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Aug 9 06:59:49 2022] PUT /identity/v3/projects/342524b45def418783374ff6733e94b9/users/07d2ee351e734fd09938cea9be3bb08a/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 06:59:51.331839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b83b7-2a41-4a0e-9136-963304691329 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:51.332375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b83b7-2a41-4a0e-9136-963304691329 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:51.332375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b83b7-2a41-4a0e-9136-963304691329 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:51.334217 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 645/1274] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:59:51.339319 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3971958-d629-4f31-9a36-d1c5778caf44 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:51.339731 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3971958-d629-4f31-9a36-d1c5778caf44 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:51.339866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3971958-d629-4f31-9a36-d1c5778caf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:51.357914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b3971958-d629-4f31-9a36-d1c5778caf44 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:59:51.359104 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b3971958-d629-4f31-9a36-d1c5778caf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:59:51.423041 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 630/1275] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:59:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:59:51.446112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b83b7-2a41-4a0e-9136-963304691329 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:51.544746 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b83b7-2a41-4a0e-9136-963304691329 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:51.561281 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:51.577755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e5046-2f5a-46d8-8330-46e74d7ef4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:51.578367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e5046-2f5a-46d8-8330-46e74d7ef4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:51.578643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e5046-2f5a-46d8-8330-46e74d7ef4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:51.578910 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e5046-2f5a-46d8-8330-46e74d7ef4d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:51.588930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e5046-2f5a-46d8-8330-46e74d7ef4d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 06:59:51.593444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-1e6e5046-2f5a-46d8-8330-46e74d7ef4d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:59:51.593444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:51.593444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:51.593444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:51.593444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:51.593444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:51.593444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:51.593444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:51.593444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:51.593444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:51.593444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:51.593444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:51.593444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 06:59:51.593444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 06:59:51.593444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 06:59:51.593444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 06:59:51.594531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 06:59:51.594531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 06:59:51.594531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 06:59:51.594531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 06:59:51.594531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:51.594531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:51.594531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:51.594531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:51.594531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:51.594531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:51.594531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:51.594531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:51.594531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:51.594531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:51.594531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:51.594531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:51.595785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:51.595785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:51.595785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:51.595785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:51.595785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 06:59:51.595785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 06:59:51.595785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 06:59:51.595785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 06:59:51.595785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 06:59:51.595785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 06:59:51.595785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 06:59:51.595785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:59:51.595785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 646/1276] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Aug 9 06:59:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:51.601506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3971958-d629-4f31-9a36-d1c5778caf44 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:51.678897 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:51.697473 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3971958-d629-4f31-9a36-d1c5778caf44 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:51.729959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4b24d-5e5d-4218-8f44-e0d32b6f6f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:51.730553 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4b24d-5e5d-4218-8f44-e0d32b6f6f45 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:51.730831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4b24d-5e5d-4218-8f44-e0d32b6f6f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:51.731129 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4b24d-5e5d-4218-8f44-e0d32b6f6f45 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:51.731783 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4b24d-5e5d-4218-8f44-e0d32b6f6f45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:51.732083 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4b24d-5e5d-4218-8f44-e0d32b6f6f45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:51.733437 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4b24d-5e5d-4218-8f44-e0d32b6f6f45 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:51.741168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 631/1277] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Aug 9 06:59:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:51.746927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e5046-2f5a-46d8-8330-46e74d7ef4d5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:51.843032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e5046-2f5a-46d8-8330-46e74d7ef4d5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:51.874579 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebea163-e153-4431-872a-7e947f70e4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:51.875211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebea163-e153-4431-872a-7e947f70e4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:51.875488 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebea163-e153-4431-872a-7e947f70e4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:51.875756 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebea163-e153-4431-872a-7e947f70e4f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:51.886301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebea163-e153-4431-872a-7e947f70e4f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:51.887752 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebea163-e153-4431-872a-7e947f70e4f0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:51.901594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-cebea163-e153-4431-872a-7e947f70e4f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:51.901594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:51.901594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:51.901594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:51.901594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:51.901594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:51.901594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:51.901594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:51.901594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:51.901594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:51.901594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:51.901594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:51.901594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:59:51.901594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:59:51.901594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:59:51.901594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:59:51.902720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:51.902720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:51.902720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:51.902720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:51.902720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:51.902720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:51.902720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:51.902720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:51.902720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:51.902720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:51.902720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:51.902720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:51.902720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:51.902720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:51.902720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:51.902720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:51.902720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:59:51.903989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:59:51.903989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:51.903989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:59:51.903989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 647/1278] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:51.908325 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4b24d-5e5d-4218-8f44-e0d32b6f6f45 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:52.006033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4b24d-5e5d-4218-8f44-e0d32b6f6f45 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:52.039171 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9a266-10e0-4e43-b7b3-41d75b6b7078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:52.039757 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9a266-10e0-4e43-b7b3-41d75b6b7078 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:52.040033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9a266-10e0-4e43-b7b3-41d75b6b7078 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:52.040302 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9a266-10e0-4e43-b7b3-41d75b6b7078 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:52.040926 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9a266-10e0-4e43-b7b3-41d75b6b7078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:52.041225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9a266-10e0-4e43-b7b3-41d75b6b7078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:52.042566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9a266-10e0-4e43-b7b3-41d75b6b7078 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:52.053992 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 632/1279] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:52.059483 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebea163-e153-4431-872a-7e947f70e4f0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:52.089460 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:52.155118 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebea163-e153-4431-872a-7e947f70e4f0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:52.186650 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e4eb7-0593-4599-adf6-be94d81653f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:52.187279 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e4eb7-0593-4599-adf6-be94d81653f3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:52.187552 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e4eb7-0593-4599-adf6-be94d81653f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:52.187814 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e4eb7-0593-4599-adf6-be94d81653f3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:52.194827 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e4eb7-0593-4599-adf6-be94d81653f3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:52.196247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e4eb7-0593-4599-adf6-be94d81653f3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:52.206930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-bb4e4eb7-0593-4599-adf6-be94d81653f3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 06:59:52.206930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:52.206930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:52.206930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:52.206930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:52.206930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:52.206930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:52.206930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:52.206930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:52.206930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:52.206930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:52.206930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:52.206930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 06:59:52.206930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 06:59:52.206930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 06:59:52.206930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 06:59:52.208613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:52.208613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:52.208613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 06:59:52.208613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:59:52.208613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 06:59:52.208613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 06:59:52.208613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:52.208613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:52.208613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:52.208613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:52.208613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:52.208613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:52.208613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:52.208613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:52.208613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:52.208613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:52.208613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:52.208613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:52.209998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:52.209998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:52.209998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 06:59:52.209998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 06:59:52.209998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 06:59:52.209998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 06:59:52.209998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 06:59:52.209998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 06:59:52.209998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 06:59:52.209998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:59:52.209998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 648/1280] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:59:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:52.214724 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9a266-10e0-4e43-b7b3-41d75b6b7078 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:52.218347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:52.312666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9a266-10e0-4e43-b7b3-41d75b6b7078 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:52.346426 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456d918-5d5c-4e7a-b671-518fd83b4aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:52.347011 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456d918-5d5c-4e7a-b671-518fd83b4aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:52.347308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456d918-5d5c-4e7a-b671-518fd83b4aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:52.347577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456d918-5d5c-4e7a-b671-518fd83b4aa6 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:52.348363 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456d918-5d5c-4e7a-b671-518fd83b4aa6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:52.348962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456d918-5d5c-4e7a-b671-518fd83b4aa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:52.350111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456d918-5d5c-4e7a-b671-518fd83b4aa6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:52.366129 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 633/1281] 10.222.0.40 () {56 vars in 1143 bytes} [Tue Aug 9 06:59:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:52.371983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e4eb7-0593-4599-adf6-be94d81653f3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:52.460133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:52.469500 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e4eb7-0593-4599-adf6-be94d81653f3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:52.501650 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacde115-6651-432b-a039-f7f7cf9bd2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:52.502250 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacde115-6651-432b-a039-f7f7cf9bd2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:52.502528 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacde115-6651-432b-a039-f7f7cf9bd2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:52.502796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacde115-6651-432b-a039-f7f7cf9bd2c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:52.566320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacde115-6651-432b-a039-f7f7cf9bd2c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:52.568290 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacde115-6651-432b-a039-f7f7cf9bd2c6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:52.654937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:52.665851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 649/1282] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Aug 9 06:59:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 06:59:52.671776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456d918-5d5c-4e7a-b671-518fd83b4aa6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:52.731758 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:52.768706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456d918-5d5c-4e7a-b671-518fd83b4aa6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:52.802314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f9379-c3b7-4a3f-8d60-efb93656586e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:52.802929 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f9379-c3b7-4a3f-8d60-efb93656586e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:52.803239 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f9379-c3b7-4a3f-8d60-efb93656586e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:52.803513 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f9379-c3b7-4a3f-8d60-efb93656586e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:52.813128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f9379-c3b7-4a3f-8d60-efb93656586e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:52.814550 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f9379-c3b7-4a3f-8d60-efb93656586e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:52.828882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-575f9379-c3b7-4a3f-8d60-efb93656586e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:52.828882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:52.828882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:52.828882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:52.828882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:52.828882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:52.828882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:52.828882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:52.828882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:52.828882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:52.828882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:52.828882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:52.828882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 06:59:52.828882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 06:59:52.828882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 06:59:52.828882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 06:59:52.830020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:52.830020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:52.830020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:52.830020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:52.830020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:52.830020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:52.830020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:52.830020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:52.830020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:52.830020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:52.830020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:52.830020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:52.830020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:52.830020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:52.830020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:52.830020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:52.830020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 06:59:52.831165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 06:59:52.831165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 06:59:52.831165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:59:52.831165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 634/1283] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 06:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:52.836386 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacde115-6651-432b-a039-f7f7cf9bd2c6 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:52.930623 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacde115-6651-432b-a039-f7f7cf9bd2c6 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:52.963510 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08ca19-326e-4581-812f-6f6df5ba5b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:52.964101 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08ca19-326e-4581-812f-6f6df5ba5b86 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:52.964378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08ca19-326e-4581-812f-6f6df5ba5b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:52.964648 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08ca19-326e-4581-812f-6f6df5ba5b86 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:52.965280 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08ca19-326e-4581-812f-6f6df5ba5b86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:52.965582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08ca19-326e-4581-812f-6f6df5ba5b86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:52.966943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08ca19-326e-4581-812f-6f6df5ba5b86 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:52.978927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 650/1284] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Aug 9 06:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:52.984633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f9379-c3b7-4a3f-8d60-efb93656586e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:53.079290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f9379-c3b7-4a3f-8d60-efb93656586e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:53.092747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:53.112194 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dacfb-4916-4a87-9cf5-e096eb6457ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:53.112801 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dacfb-4916-4a87-9cf5-e096eb6457ba None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:53.113077 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dacfb-4916-4a87-9cf5-e096eb6457ba None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:53.113347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dacfb-4916-4a87-9cf5-e096eb6457ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:53.119996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dacfb-4916-4a87-9cf5-e096eb6457ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:53.121411 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dacfb-4916-4a87-9cf5-e096eb6457ba None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:53.132755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c39dacfb-4916-4a87-9cf5-e096eb6457ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:59:53.132755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:53.132755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:53.132755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:53.132755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:53.132755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:53.132755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:53.132755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:53.132755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:53.132755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:53.132755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:53.132755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:53.132755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 06:59:53.132755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 06:59:53.132755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 06:59:53.133789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 06:59:53.133789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:53.133789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:53.133789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:53.133789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:53.133789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:53.133789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:53.133789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:53.133789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:53.133789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:53.133789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:53.133789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:53.133789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:53.133789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:53.133789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:53.133789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:53.133789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:53.135154 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 06:59:53.135154 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 06:59:53.135154 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 06:59:53.135154 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 06:59:53.135154 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 06:59:53.135154 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 06:59:53.135154 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 06:59:53.135154 dv-cinder-852514-1-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Aug 09 06:59:53.135154 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 635/1285] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Aug 9 06:59:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:53.139659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08ca19-326e-4581-812f-6f6df5ba5b86 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:53.189266 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:53.237218 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08ca19-326e-4581-812f-6f6df5ba5b86 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:53.270381 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5edd5-8dfd-419f-8512-f218c86646e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:53.270990 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5edd5-8dfd-419f-8512-f218c86646e0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:53.271298 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5edd5-8dfd-419f-8512-f218c86646e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:53.271571 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5edd5-8dfd-419f-8512-f218c86646e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:53.272263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5edd5-8dfd-419f-8512-f218c86646e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:53.272568 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5edd5-8dfd-419f-8512-f218c86646e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:53.273974 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5edd5-8dfd-419f-8512-f218c86646e0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:53.291126 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 651/1286] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Aug 9 06:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:53.294347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dacfb-4916-4a87-9cf5-e096eb6457ba None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:53.401127 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dacfb-4916-4a87-9cf5-e096eb6457ba None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:53.434620 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5189a-12bc-4fb5-860c-4d84a8f6b74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:53.435260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5189a-12bc-4fb5-860c-4d84a8f6b74f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:53.435538 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5189a-12bc-4fb5-860c-4d84a8f6b74f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:53.435898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5189a-12bc-4fb5-860c-4d84a8f6b74f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:53.436850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5189a-12bc-4fb5-860c-4d84a8f6b74f None admin] RBAC: Adding query filter params (role.id=9e31b186d8d94a4abeb35be6dfd4ab24, scope.project.id=342524b45def418783374ff6733e94b9, user.id=07d2ee351e734fd09938cea9be3bb08a) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:53.437162 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5189a-12bc-4fb5-860c-4d84a8f6b74f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:53.438580 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5189a-12bc-4fb5-860c-4d84a8f6b74f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:53.444825 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 636/1287] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Aug 9 06:59:53 2022] GET /identity/v3/role_assignments?user.id=07d2ee351e734fd09938cea9be3bb08a&scope.project.id=342524b45def418783374ff6733e94b9&role.id=9e31b186d8d94a4abeb35be6dfd4ab24 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:55.437598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570ed13-201b-4f11-b212-ff5116564a67 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:55.438248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570ed13-201b-4f11-b212-ff5116564a67 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:55.438248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570ed13-201b-4f11-b212-ff5116564a67 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:55.439488 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 652/1288] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:59:55.445274 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc95041-55aa-4695-9924-57a05c4bd923 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:55.445713 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc95041-55aa-4695-9924-57a05c4bd923 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:55.445821 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc95041-55aa-4695-9924-57a05c4bd923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:55.464157 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bdc95041-55aa-4695-9924-57a05c4bd923 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:59:55.465316 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bdc95041-55aa-4695-9924-57a05c4bd923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:59:55.493131 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:55.528995 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 637/1289] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:59:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 06:59:55.550819 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570ed13-201b-4f11-b212-ff5116564a67 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:55.649653 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570ed13-201b-4f11-b212-ff5116564a67 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:55.659853 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:55.682857 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207e554-49fb-4718-a54b-c4933d53a1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:55.683545 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207e554-49fb-4718-a54b-c4933d53a1ce None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:55.683822 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207e554-49fb-4718-a54b-c4933d53a1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:55.684091 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207e554-49fb-4718-a54b-c4933d53a1ce None admin] PATH_INFO: `/v3/services/placement` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:55.684665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207e554-49fb-4718-a54b-c4933d53a1ce None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:55.685999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207e554-49fb-4718-a54b-c4933d53a1ce None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:55.695047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-e207e554-49fb-4718-a54b-c4933d53a1ce None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 06:59:55.695047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:55.695047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 06:59:55.695047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 06:59:55.695047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 06:59:55.695047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 06:59:55.695047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 06:59:55.695047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:59:55.695047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 06:59:55.695047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:59:55.695047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 06:59:55.695047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:59:55.695047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 06:59:55.695047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 06:59:55.695047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 06:59:55.695047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 06:59:55.695047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 06:59:55.696389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 06:59:55.696389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 06:59:55.696389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 06:59:55.696389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 06:59:55.696389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 06:59:55.696389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 06:59:55.696389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 06:59:55.696389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 06:59:55.696389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 06:59:55.696389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 06:59:55.696389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 06:59:55.696389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 06:59:55.696389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 06:59:55.696389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 06:59:55.696389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 06:59:55.696389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 06:59:55.697586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 06:59:55.697586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 06:59:55.697586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 06:59:55.697586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 06:59:55.697586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 06:59:55.697586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 06:59:55.697586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 06:59:55.697586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 06:59:55.697586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 06:59:55.697586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 06:59:55.697586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 06:59:55.697586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 06:59:55.697586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 06:59:55.697586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 06:59:55.697586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 653/1290] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Aug 9 06:59:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 06:59:55.702113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc95041-55aa-4695-9924-57a05c4bd923 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:55.796742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc95041-55aa-4695-9924-57a05c4bd923 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:55.829510 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df657c47-58aa-4ba5-b6ab-ef9a20681792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:55.830101 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df657c47-58aa-4ba5-b6ab-ef9a20681792 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:55.830374 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df657c47-58aa-4ba5-b6ab-ef9a20681792 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:55.830642 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df657c47-58aa-4ba5-b6ab-ef9a20681792 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:55.831287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df657c47-58aa-4ba5-b6ab-ef9a20681792 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:55.831589 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df657c47-58aa-4ba5-b6ab-ef9a20681792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:55.833091 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df657c47-58aa-4ba5-b6ab-ef9a20681792 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:55.837657 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 638/1291] 10.222.0.40 () {56 vars in 1116 bytes} [Tue Aug 9 06:59:55 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:55.843270 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207e554-49fb-4718-a54b-c4933d53a1ce None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:55.958273 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207e554-49fb-4718-a54b-c4933d53a1ce None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:55.990895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436b71d-5f98-4a6d-b0b9-d54fecf29266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:55.991506 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436b71d-5f98-4a6d-b0b9-d54fecf29266 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:55.991782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436b71d-5f98-4a6d-b0b9-d54fecf29266 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:55.992049 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436b71d-5f98-4a6d-b0b9-d54fecf29266 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:55.992663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436b71d-5f98-4a6d-b0b9-d54fecf29266 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 06:59:55.992960 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436b71d-5f98-4a6d-b0b9-d54fecf29266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:55.994284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436b71d-5f98-4a6d-b0b9-d54fecf29266 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:55.998436 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 654/1292] 10.222.0.40 () {56 vars in 1116 bytes} [Tue Aug 9 06:59:55 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 06:59:57.983057 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d794-0aaf-42cf-86e2-4a784ead3cba None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:57.983636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d794-0aaf-42cf-86e2-4a784ead3cba None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:57.983636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d794-0aaf-42cf-86e2-4a784ead3cba None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:57.984980 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 639/1293] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 06:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 06:59:57.990170 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab26771-b7ab-4a37-a7d7-265dee6124fd None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:57.990609 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab26771-b7ab-4a37-a7d7-265dee6124fd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:57.990725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab26771-b7ab-4a37-a7d7-265dee6124fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:58.010192 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4ab26771-b7ab-4a37-a7d7-265dee6124fd None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 06:59:58.011419 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4ab26771-b7ab-4a37-a7d7-265dee6124fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 06:59:58.041772 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:58.080291 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 655/1294] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 06:59:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 06:59:58.105771 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d794-0aaf-42cf-86e2-4a784ead3cba None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 06:59:58.138927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:59:58.220419 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d794-0aaf-42cf-86e2-4a784ead3cba None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 06:59:58.259310 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56befad-c677-4460-81f9-7bbd88549ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 06:59:58.259914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56befad-c677-4460-81f9-7bbd88549ad0 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 06:59:58.260192 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56befad-c677-4460-81f9-7bbd88549ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 06:59:58.260462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56befad-c677-4460-81f9-7bbd88549ad0 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 06:59:58.261221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56befad-c677-4460-81f9-7bbd88549ad0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 06:59:58.262580 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56befad-c677-4460-81f9-7bbd88549ad0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 06:59:58.279702 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 640/1295] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Aug 9 06:59:58 2022] POST /identity/v3/services => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:00:00.324504 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77a7ee-dff6-4475-b49a-a09233b47364 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:00:00.325056 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77a7ee-dff6-4475-b49a-a09233b47364 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:00:00.325056 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77a7ee-dff6-4475-b49a-a09233b47364 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:00:00.326403 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 656/1296] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:00:00.334076 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f73df-b76d-47c9-bce6-327194a92964 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:00:00.334524 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f73df-b76d-47c9-bce6-327194a92964 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:00:00.334620 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f73df-b76d-47c9-bce6-327194a92964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:00:00.353716 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-573f73df-b76d-47c9-bce6-327194a92964 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:00:00.354883 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-573f73df-b76d-47c9-bce6-327194a92964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:00:00.425953 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 641/1297] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:00:00 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 07:00:00.448462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77a7ee-dff6-4475-b49a-a09233b47364 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:00:00.548091 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77a7ee-dff6-4475-b49a-a09233b47364 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:00:00.580518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550373c5-43e6-40ee-81ee-1b645a0f0b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:00:00.581066 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550373c5-43e6-40ee-81ee-1b645a0f0b9e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:00:00.581340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550373c5-43e6-40ee-81ee-1b645a0f0b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:00:00.581603 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550373c5-43e6-40ee-81ee-1b645a0f0b9e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:00:00.582171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550373c5-43e6-40ee-81ee-1b645a0f0b9e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:00:00.584128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550373c5-43e6-40ee-81ee-1b645a0f0b9e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:00:00.592402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-550373c5-43e6-40ee-81ee-1b645a0f0b9e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 07:00:00.592402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 07:00:00.592402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 07:00:00.592402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 07:00:00.592402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 07:00:00.592402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 07:00:00.592402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 07:00:00.592402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 07:00:00.592402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 07:00:00.592402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 07:00:00.592402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 07:00:00.592402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 07:00:00.592402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 07:00:00.592402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 07:00:00.592402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 07:00:00.592402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 07:00:00.592402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 07:00:00.593557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 07:00:00.593557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 07:00:00.593557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 07:00:00.593557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 07:00:00.593557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 07:00:00.593557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 07:00:00.593557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 07:00:00.593557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 07:00:00.593557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 07:00:00.593557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 07:00:00.593557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 07:00:00.593557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 07:00:00.593557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 07:00:00.593557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 07:00:00.593557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 07:00:00.593557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 07:00:00.594666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 07:00:00.594666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 07:00:00.594666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 07:00:00.594666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 07:00:00.594666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 07:00:00.594666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 07:00:00.594666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 07:00:00.594666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 07:00:00.594666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 07:00:00.594666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 07:00:00.594666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 07:00:00.594666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 07:00:00.594666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 07:00:00.594666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 07:00:00.594666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 657/1298] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Aug 9 07:00:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 07:00:00.599985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f73df-b76d-47c9-bce6-327194a92964 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:00:00.617973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:00:00.697836 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f73df-b76d-47c9-bce6-327194a92964 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:00:00.731127 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9139f-fe6d-488e-8716-b7ae9863b8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:00:00.731727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9139f-fe6d-488e-8716-b7ae9863b8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:00:00.732003 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9139f-fe6d-488e-8716-b7ae9863b8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:00:00.732272 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9139f-fe6d-488e-8716-b7ae9863b8f4 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:00:00.732888 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9139f-fe6d-488e-8716-b7ae9863b8f4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:00:00.733188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9139f-fe6d-488e-8716-b7ae9863b8f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:00:00.734528 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9139f-fe6d-488e-8716-b7ae9863b8f4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:00:00.740016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 642/1299] 10.222.0.40 () {56 vars in 1116 bytes} [Tue Aug 9 07:00:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:00:00.746170 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550373c5-43e6-40ee-81ee-1b645a0f0b9e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:00:00.777082 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:00:00.842866 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550373c5-43e6-40ee-81ee-1b645a0f0b9e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:00:00.873949 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f375188-2023-4a5f-9869-049484291294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:00:00.874555 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f375188-2023-4a5f-9869-049484291294 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:00:00.874829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f375188-2023-4a5f-9869-049484291294 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:00:00.875107 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f375188-2023-4a5f-9869-049484291294 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:00:00.875797 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f375188-2023-4a5f-9869-049484291294 None admin] RBAC: Adding query filter params (interface=public, service_id=f00efbccce7f49d5b1b10a666e4e8370, region_id=RegionOne) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:00:00.876097 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f375188-2023-4a5f-9869-049484291294 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:00:00.877421 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f375188-2023-4a5f-9869-049484291294 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:00:00.882784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 658/1300] 10.222.0.40 () {56 vars in 1251 bytes} [Tue Aug 9 07:00:00 2022] GET /identity/v3/endpoints?service_id=f00efbccce7f49d5b1b10a666e4e8370&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:00:00.888540 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9139f-fe6d-488e-8716-b7ae9863b8f4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:00:00.969677 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:00:00.987245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9139f-fe6d-488e-8716-b7ae9863b8f4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:00:01.020887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3c1d1-371c-4459-a3d0-789a83f6a05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:00:01.021485 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3c1d1-371c-4459-a3d0-789a83f6a05b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:00:01.021764 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3c1d1-371c-4459-a3d0-789a83f6a05b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:00:01.022033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3c1d1-371c-4459-a3d0-789a83f6a05b None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:00:01.022628 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3c1d1-371c-4459-a3d0-789a83f6a05b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:00:01.024015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3c1d1-371c-4459-a3d0-789a83f6a05b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:00:01.030552 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 643/1301] 10.222.0.40 () {56 vars in 1087 bytes} [Tue Aug 9 07:00:00 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:00:03.008950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf501ca-5f7f-440c-83e1-65a0c7e227b6 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:00:03.009474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf501ca-5f7f-440c-83e1-65a0c7e227b6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:00:03.009474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf501ca-5f7f-440c-83e1-65a0c7e227b6 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:00:03.010910 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 659/1302] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:00:03.016282 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d78433-fb1b-4836-bbae-63085a6c4e6a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:00:03.016688 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d78433-fb1b-4836-bbae-63085a6c4e6a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:00:03.016830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d78433-fb1b-4836-bbae-63085a6c4e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:00:03.035314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b2d78433-fb1b-4836-bbae-63085a6c4e6a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:00:03.036942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b2d78433-fb1b-4836-bbae-63085a6c4e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:00:03.101614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 644/1303] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:00:03 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 07:00:03.123495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf501ca-5f7f-440c-83e1-65a0c7e227b6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:00:03.216459 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:00:03.223356 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf501ca-5f7f-440c-83e1-65a0c7e227b6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:00:03.255711 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13441fad-8b47-4da5-80dc-0b3023436a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:00:03.256312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13441fad-8b47-4da5-80dc-0b3023436a98 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:00:03.256583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13441fad-8b47-4da5-80dc-0b3023436a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:00:03.256848 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13441fad-8b47-4da5-80dc-0b3023436a98 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:00:03.257415 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13441fad-8b47-4da5-80dc-0b3023436a98 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:00:03.258740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13441fad-8b47-4da5-80dc-0b3023436a98 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:00:03.266997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-13441fad-8b47-4da5-80dc-0b3023436a98 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 07:00:03.266997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 07:00:03.266997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 07:00:03.266997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 07:00:03.266997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 07:00:03.266997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 07:00:03.266997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 07:00:03.266997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 07:00:03.266997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 07:00:03.266997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 07:00:03.266997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 07:00:03.266997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 07:00:03.266997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 07:00:03.266997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 07:00:03.266997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 07:00:03.266997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 07:00:03.266997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 07:00:03.268199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 07:00:03.268199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 07:00:03.268199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 07:00:03.268199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 07:00:03.268199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 07:00:03.268199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 07:00:03.268199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 07:00:03.268199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 07:00:03.268199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 07:00:03.268199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 07:00:03.268199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 07:00:03.268199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 07:00:03.268199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 07:00:03.268199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 07:00:03.268199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 07:00:03.268199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 07:00:03.269078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 07:00:03.269078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Aug 09 07:00:03.269078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 07:00:03.269078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Aug 09 07:00:03.269078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 07:00:03.269078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 07:00:03.269078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 07:00:03.269078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Aug 09 07:00:03.269078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 07:00:03.269078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Aug 09 07:00:03.269078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 07:00:03.269078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 07:00:03.269078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 07:00:03.269078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Aug 09 07:00:03.269078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 660/1304] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Aug 9 07:00:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 07:00:03.274106 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d78433-fb1b-4836-bbae-63085a6c4e6a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:00:03.362139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:00:03.384608 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d78433-fb1b-4836-bbae-63085a6c4e6a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:00:03.416165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189b1f3-a22b-4f73-99c8-67ecfe7bc419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:00:03.416757 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189b1f3-a22b-4f73-99c8-67ecfe7bc419 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:00:03.417028 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189b1f3-a22b-4f73-99c8-67ecfe7bc419 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:00:03.417292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189b1f3-a22b-4f73-99c8-67ecfe7bc419 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:00:03.417905 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189b1f3-a22b-4f73-99c8-67ecfe7bc419 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:00:03.418199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189b1f3-a22b-4f73-99c8-67ecfe7bc419 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:00:03.419566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189b1f3-a22b-4f73-99c8-67ecfe7bc419 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:00:03.424400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 645/1305] 10.222.0.40 () {56 vars in 1116 bytes} [Tue Aug 9 07:00:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:00:03.430869 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13441fad-8b47-4da5-80dc-0b3023436a98 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:00:03.528369 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13441fad-8b47-4da5-80dc-0b3023436a98 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:00:03.561379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f3e10-4782-4cf7-87b5-bfef21cf2b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:00:03.561980 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f3e10-4782-4cf7-87b5-bfef21cf2b83 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:00:03.562258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f3e10-4782-4cf7-87b5-bfef21cf2b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:00:03.562531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f3e10-4782-4cf7-87b5-bfef21cf2b83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:00:03.563227 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f3e10-4782-4cf7-87b5-bfef21cf2b83 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:00:03.564575 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f3e10-4782-4cf7-87b5-bfef21cf2b83 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:00:03.584118 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 661/1306] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:00:03 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:00:13.421570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=30 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:00:13.579484 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:06.510769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99cc42-a41e-4bbd-a0cf-fb9fd04e5113 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:06.511414 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99cc42-a41e-4bbd-a0cf-fb9fd04e5113 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:06.511414 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99cc42-a41e-4bbd-a0cf-fb9fd04e5113 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:06.518644 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d12549-ff46-4a8d-a4fa-615ac4cd3355 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:06.519166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d12549-ff46-4a8d-a4fa-615ac4cd3355 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:06.519252 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d12549-ff46-4a8d-a4fa-615ac4cd3355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:06.524718 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 646/1307] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:01:06 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:01:06.632528 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-10d12549-ff46-4a8d-a4fa-615ac4cd3355 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:01:06.633994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-10d12549-ff46-4a8d-a4fa-615ac4cd3355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:06.831825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 662/1308] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:01:06.886261 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dcfdf-84c2-466c-bc86-1f327d0a7a00 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:06.886648 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dcfdf-84c2-466c-bc86-1f327d0a7a00 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:06.887113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dcfdf-84c2-466c-bc86-1f327d0a7a00 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:06.889097 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 647/1309] 10.222.0.40 () {54 vars in 965 bytes} [Tue Aug 9 07:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:01:06.895476 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f67e1-b71c-4c90-8f7f-7e80402cf11d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:06.895779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f67e1-b71c-4c90-8f7f-7e80402cf11d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:06.896061 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f67e1-b71c-4c90-8f7f-7e80402cf11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:06.974627 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b65f67e1-b71c-4c90-8f7f-7e80402cf11d None None] MFA Rules not processed for user `8d75da9360ef490f910fabc3920c8ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:01:06.975985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b65f67e1-b71c-4c90-8f7f-7e80402cf11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:06.997730 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:07.058383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 663/1310] 10.222.0.40 () {58 vars in 1062 bytes} [Tue Aug 9 07:01:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:01:07.068393 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596dcfdf-84c2-466c-bc86-1f327d0a7a00 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:01:07.070142 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-596dcfdf-84c2-466c-bc86-1f327d0a7a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:07.183299 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596dcfdf-84c2-466c-bc86-1f327d0a7a00 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:01:07.261865 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17007a48-305f-4844-88d7-e5368e378e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:01:07.262729 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17007a48-305f-4844-88d7-e5368e378e42 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:07.263189 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17007a48-305f-4844-88d7-e5368e378e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:07.263637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17007a48-305f-4844-88d7-e5368e378e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:07.265509 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-17007a48-305f-4844-88d7-e5368e378e42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:07.327747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:07.386516 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17007a48-305f-4844-88d7-e5368e378e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:01:07.388113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17007a48-305f-4844-88d7-e5368e378e42 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:01:07.411785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 648/1311] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:01:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:01:09.727673 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b8ae2-d97d-4a98-afdc-9f0d530283cd None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:09.728293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b8ae2-d97d-4a98-afdc-9f0d530283cd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:09.728293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b8ae2-d97d-4a98-afdc-9f0d530283cd None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:09.731482 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 664/1312] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:01:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:01:09.735563 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37fa9c-5415-4a96-aac5-d9618276bbe8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:09.736439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37fa9c-5415-4a96-aac5-d9618276bbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:09.736727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37fa9c-5415-4a96-aac5-d9618276bbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:09.820511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ed37fa9c-5415-4a96-aac5-d9618276bbe8 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:01:09.821873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ed37fa9c-5415-4a96-aac5-d9618276bbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:09.931383 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 649/1313] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:01:09.970609 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b8ae2-d97d-4a98-afdc-9f0d530283cd None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:01:09.972285 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5f0b8ae2-d97d-4a98-afdc-9f0d530283cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:10.083660 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b8ae2-d97d-4a98-afdc-9f0d530283cd None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:01:10.163487 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:10.167000 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e4cf8-ae84-4d50-b197-9e0baac9231c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:01:10.167876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e4cf8-ae84-4d50-b197-9e0baac9231c service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:10.168437 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e4cf8-ae84-4d50-b197-9e0baac9231c service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:10.168936 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e4cf8-ae84-4d50-b197-9e0baac9231c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:10.170835 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-be0e4cf8-ae84-4d50-b197-9e0baac9231c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:10.287792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e4cf8-ae84-4d50-b197-9e0baac9231c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:01:10.289204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e4cf8-ae84-4d50-b197-9e0baac9231c service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:01:10.307968 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 665/1314] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:01:12.663772 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0d2a3-1e8e-4fba-8712-4524f0d910ee None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:12.664210 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0d2a3-1e8e-4fba-8712-4524f0d910ee None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:12.664302 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0d2a3-1e8e-4fba-8712-4524f0d910ee None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:12.665629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 650/1315] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:01:12.670621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809741df-deb8-4806-9ec0-cd52dc8d547b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:12.671105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809741df-deb8-4806-9ec0-cd52dc8d547b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:12.671198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809741df-deb8-4806-9ec0-cd52dc8d547b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:12.736708 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-809741df-deb8-4806-9ec0-cd52dc8d547b None None] MFA Rules not processed for user `b2506581a1e24052a065de1a855734fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:01:12.737917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-809741df-deb8-4806-9ec0-cd52dc8d547b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:12.788967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:12.833058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 666/1316] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:01:12 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:01:12.873432 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0d2a3-1e8e-4fba-8712-4524f0d910ee None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:01:12.874941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-47b0d2a3-1e8e-4fba-8712-4524f0d910ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:12.884610 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:12.976630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0d2a3-1e8e-4fba-8712-4524f0d910ee None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:01:13.048015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc7f5e-f41c-4a43-956e-99f895d3e9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:01:13.048618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc7f5e-f41c-4a43-956e-99f895d3e9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:13.048896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc7f5e-f41c-4a43-956e-99f895d3e9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:13.049165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc7f5e-f41c-4a43-956e-99f895d3e9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:13.050749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-98fc7f5e-f41c-4a43-956e-99f895d3e9e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:13.111490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:13.156042 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc7f5e-f41c-4a43-956e-99f895d3e9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:01:13.158111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc7f5e-f41c-4a43-956e-99f895d3e9e7 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:01:13.177426 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 651/1317] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:01:12 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:01:15.755917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63981609-029e-4d2e-afd7-94817e858a32 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:15.756535 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63981609-029e-4d2e-afd7-94817e858a32 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:15.756535 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63981609-029e-4d2e-afd7-94817e858a32 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:15.757950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 667/1318] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:01:15.763221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c33a07-ac4d-4703-b3ae-369f9c81376e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:15.763636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c33a07-ac4d-4703-b3ae-369f9c81376e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:15.763772 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c33a07-ac4d-4703-b3ae-369f9c81376e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:15.827750 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-69c33a07-ac4d-4703-b3ae-369f9c81376e None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:01:15.829007 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-69c33a07-ac4d-4703-b3ae-369f9c81376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:15.923628 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 652/1319] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:01:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:01:15.961701 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63981609-029e-4d2e-afd7-94817e858a32 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:01:15.963241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-63981609-029e-4d2e-afd7-94817e858a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:16.062578 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63981609-029e-4d2e-afd7-94817e858a32 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:01:16.132655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853a996-19fe-45e6-9f4e-9ea69861af3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:01:16.133245 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853a996-19fe-45e6-9f4e-9ea69861af3a service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:16.133518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853a996-19fe-45e6-9f4e-9ea69861af3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:16.133777 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853a996-19fe-45e6-9f4e-9ea69861af3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:16.135368 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8853a996-19fe-45e6-9f4e-9ea69861af3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:16.142469 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:16.241867 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853a996-19fe-45e6-9f4e-9ea69861af3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:01:16.243312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853a996-19fe-45e6-9f4e-9ea69861af3a service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:01:16.261469 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 668/1320] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:01:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:01:18.939351 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4294530-8273-4b47-b16f-fb9430b26c3d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:18.939863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4294530-8273-4b47-b16f-fb9430b26c3d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:18.939863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4294530-8273-4b47-b16f-fb9430b26c3d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:18.941156 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 653/1321] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:01:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:01:18.946228 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b4021-8d15-487d-b929-f03e934ed3db None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:18.946639 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b4021-8d15-487d-b929-f03e934ed3db None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:18.946753 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b4021-8d15-487d-b929-f03e934ed3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:19.012305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b05b4021-8d15-487d-b929-f03e934ed3db None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:01:19.013501 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b05b4021-8d15-487d-b929-f03e934ed3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:19.071640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:19.114588 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 669/1322] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:01:19.151875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4294530-8273-4b47-b16f-fb9430b26c3d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:01:19.153395 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a4294530-8273-4b47-b16f-fb9430b26c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:19.173672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:19.264627 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4294530-8273-4b47-b16f-fb9430b26c3d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:01:19.338112 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d083c0e-b078-49ac-b2dd-2aa68a571513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:01:19.338734 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d083c0e-b078-49ac-b2dd-2aa68a571513 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:19.338989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d083c0e-b078-49ac-b2dd-2aa68a571513 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:19.339278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d083c0e-b078-49ac-b2dd-2aa68a571513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:19.340845 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5d083c0e-b078-49ac-b2dd-2aa68a571513 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:19.413649 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:19.454444 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d083c0e-b078-49ac-b2dd-2aa68a571513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:01:19.455890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d083c0e-b078-49ac-b2dd-2aa68a571513 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:01:19.473545 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 654/1323] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:01:21.550282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bb307-4a60-46d0-8145-4a21c015784b None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:21.550796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bb307-4a60-46d0-8145-4a21c015784b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:21.550796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bb307-4a60-46d0-8145-4a21c015784b None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:21.552087 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 670/1324] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:01:21.557283 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668154be-acd4-4d14-9781-a536bebd493f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:21.557728 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668154be-acd4-4d14-9781-a536bebd493f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:21.557823 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668154be-acd4-4d14-9781-a536bebd493f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:21.623330 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-668154be-acd4-4d14-9781-a536bebd493f None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:01:21.624527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-668154be-acd4-4d14-9781-a536bebd493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:21.725455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 655/1325] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:01:21.761068 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bb307-4a60-46d0-8145-4a21c015784b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:01:21.762674 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c62bb307-4a60-46d0-8145-4a21c015784b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:21.865692 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bb307-4a60-46d0-8145-4a21c015784b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:01:21.939368 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66975e8-d494-43a5-97f4-f09caa435df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:01:21.939988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66975e8-d494-43a5-97f4-f09caa435df3 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:21.940269 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66975e8-d494-43a5-97f4-f09caa435df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:21.940541 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66975e8-d494-43a5-97f4-f09caa435df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:21.942166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a66975e8-d494-43a5-97f4-f09caa435df3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:21.961555 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:22.055949 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66975e8-d494-43a5-97f4-f09caa435df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:01:22.057377 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66975e8-d494-43a5-97f4-f09caa435df3 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:01:22.075544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 671/1326] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:01:24.171997 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9626897-ef5e-4a65-adbf-581ad685e9fa None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:24.172525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9626897-ef5e-4a65-adbf-581ad685e9fa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:24.172525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9626897-ef5e-4a65-adbf-581ad685e9fa None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:24.173860 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 656/1327] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:01:24.179164 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e96be-be0d-4bef-8d5d-4ca1b626d0fd None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:24.179575 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e96be-be0d-4bef-8d5d-4ca1b626d0fd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:24.179707 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e96be-be0d-4bef-8d5d-4ca1b626d0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:24.247966 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b61e96be-be0d-4bef-8d5d-4ca1b626d0fd None None] MFA Rules not processed for user `b2506581a1e24052a065de1a855734fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:01:24.249181 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b61e96be-be0d-4bef-8d5d-4ca1b626d0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:24.317124 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:24.351924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 672/1328] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:01:24 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:01:24.405518 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374fa7c-aa90-4d7e-b6a4-8c7ef2fdb97d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:24.405804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374fa7c-aa90-4d7e-b6a4-8c7ef2fdb97d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:24.406109 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374fa7c-aa90-4d7e-b6a4-8c7ef2fdb97d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:24.408045 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 657/1329] 10.222.0.40 () {54 vars in 965 bytes} [Tue Aug 9 07:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:01:24.413935 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb81b8-4a0f-4a86-945a-bbec727b17fd None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:24.414220 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb81b8-4a0f-4a86-945a-bbec727b17fd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:24.414490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb81b8-4a0f-4a86-945a-bbec727b17fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:24.490558 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-69eb81b8-4a0f-4a86-945a-bbec727b17fd None None] MFA Rules not processed for user `8d75da9360ef490f910fabc3920c8ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:01:24.491794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-69eb81b8-4a0f-4a86-945a-bbec727b17fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:24.566777 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 673/1330] 10.222.0.40 () {58 vars in 1062 bytes} [Tue Aug 9 07:01:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:01:24.576211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374fa7c-aa90-4d7e-b6a4-8c7ef2fdb97d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:01:24.577888 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5374fa7c-aa90-4d7e-b6a4-8c7ef2fdb97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:24.610070 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:24.684395 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374fa7c-aa90-4d7e-b6a4-8c7ef2fdb97d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:01:24.764844 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86a45d-3d3a-4463-8dbd-c088bd6d875a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:01:24.765460 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86a45d-3d3a-4463-8dbd-c088bd6d875a service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:24.765737 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86a45d-3d3a-4463-8dbd-c088bd6d875a service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:24.766026 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86a45d-3d3a-4463-8dbd-c088bd6d875a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:24.767928 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3b86a45d-3d3a-4463-8dbd-c088bd6d875a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:24.850554 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:24.886872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86a45d-3d3a-4463-8dbd-c088bd6d875a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:01:24.888374 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86a45d-3d3a-4463-8dbd-c088bd6d875a service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:01:24.907577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 658/1331] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:01:24 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:01:27.529054 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981cc5d-b5cc-4368-87f3-50cba64a7dda None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:27.529734 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981cc5d-b5cc-4368-87f3-50cba64a7dda None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:27.529734 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981cc5d-b5cc-4368-87f3-50cba64a7dda None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:27.530955 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 674/1332] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:01:27.535987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9174d-32ad-4f93-83fa-e96038b581e6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:27.536397 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9174d-32ad-4f93-83fa-e96038b581e6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:27.536546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9174d-32ad-4f93-83fa-e96038b581e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:27.600597 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-26d9174d-32ad-4f93-83fa-e96038b581e6 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:01:27.601778 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-26d9174d-32ad-4f93-83fa-e96038b581e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:27.696051 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 659/1333] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:01:27.731457 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981cc5d-b5cc-4368-87f3-50cba64a7dda None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:01:27.732966 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f981cc5d-b5cc-4368-87f3-50cba64a7dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:27.800929 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:27.835449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981cc5d-b5cc-4368-87f3-50cba64a7dda None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:01:27.906068 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592325f-a7ac-4fe5-b1ba-35d796ae695f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:01:27.907212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592325f-a7ac-4fe5-b1ba-35d796ae695f service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:27.907491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592325f-a7ac-4fe5-b1ba-35d796ae695f service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:27.907755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592325f-a7ac-4fe5-b1ba-35d796ae695f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:27.909318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2592325f-a7ac-4fe5-b1ba-35d796ae695f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:28.014357 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592325f-a7ac-4fe5-b1ba-35d796ae695f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:01:28.016398 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592325f-a7ac-4fe5-b1ba-35d796ae695f service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:01:28.026086 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:28.034677 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 675/1334] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:01:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:01:30.069272 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015b20b-c5ed-4253-b25a-45e20e626beb None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:30.069835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015b20b-c5ed-4253-b25a-45e20e626beb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:30.069835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015b20b-c5ed-4253-b25a-45e20e626beb None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:30.071146 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 660/1335] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:01:30.076436 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4496-0a50-4917-9ea8-af1cbd19f5db None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:30.076873 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4496-0a50-4917-9ea8-af1cbd19f5db None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:30.077006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4496-0a50-4917-9ea8-af1cbd19f5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:30.142123 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-710a4496-0a50-4917-9ea8-af1cbd19f5db None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:01:30.143336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-710a4496-0a50-4917-9ea8-af1cbd19f5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:30.237590 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 676/1336] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:01:30.278155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015b20b-c5ed-4253-b25a-45e20e626beb None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:01:30.279702 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c015b20b-c5ed-4253-b25a-45e20e626beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:30.319164 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:30.381797 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015b20b-c5ed-4253-b25a-45e20e626beb None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:01:30.452669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c61f1-123f-48c5-82a5-733d47f96500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:01:30.453898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c61f1-123f-48c5-82a5-733d47f96500 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:30.454171 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c61f1-123f-48c5-82a5-733d47f96500 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:30.454437 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c61f1-123f-48c5-82a5-733d47f96500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:30.456041 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3f5c61f1-123f-48c5-82a5-733d47f96500 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:30.539138 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:30.565945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c61f1-123f-48c5-82a5-733d47f96500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:01:30.567410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c61f1-123f-48c5-82a5-733d47f96500 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:01:30.585927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 661/1337] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:01:32.925015 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec1af7-dc33-4ed8-bd0d-48e25eb17fb6 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:32.925545 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec1af7-dc33-4ed8-bd0d-48e25eb17fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:32.925545 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec1af7-dc33-4ed8-bd0d-48e25eb17fb6 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:32.926833 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 677/1338] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:01:32.932107 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d4320-bc0e-46da-8f9e-f97df07d1dc2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:32.932533 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d4320-bc0e-46da-8f9e-f97df07d1dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:32.932680 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d4320-bc0e-46da-8f9e-f97df07d1dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:32.996714 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-264d4320-bc0e-46da-8f9e-f97df07d1dc2 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:01:32.997897 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-264d4320-bc0e-46da-8f9e-f97df07d1dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:33.091478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 662/1339] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:01:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:01:33.127929 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec1af7-dc33-4ed8-bd0d-48e25eb17fb6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:01:33.129444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a4ec1af7-dc33-4ed8-bd0d-48e25eb17fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:33.204185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:33.233832 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec1af7-dc33-4ed8-bd0d-48e25eb17fb6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:01:33.310184 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e1a63-4ef8-487f-af58-0becd6c7aba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:01:33.310786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e1a63-4ef8-487f-af58-0becd6c7aba8 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:33.311059 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e1a63-4ef8-487f-af58-0becd6c7aba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:33.311355 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e1a63-4ef8-487f-af58-0becd6c7aba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:33.312994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-293e1a63-4ef8-487f-af58-0becd6c7aba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:33.427552 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e1a63-4ef8-487f-af58-0becd6c7aba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:01:33.428977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e1a63-4ef8-487f-af58-0becd6c7aba8 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:01:33.446458 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 678/1340] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:01:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:01:37.361785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d3917-d885-428b-97c0-791f40f9acea None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:37.362350 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d3917-d885-428b-97c0-791f40f9acea None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:37.362350 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d3917-d885-428b-97c0-791f40f9acea None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:37.363691 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 663/1341] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:01:37.368840 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eecbac-ceea-44fc-b746-bef10ddc0b58 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:37.369321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eecbac-ceea-44fc-b746-bef10ddc0b58 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:37.369432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eecbac-ceea-44fc-b746-bef10ddc0b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:37.375129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:37.438855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d3eecbac-ceea-44fc-b746-bef10ddc0b58 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:01:37.440055 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d3eecbac-ceea-44fc-b746-bef10ddc0b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:37.540660 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 679/1342] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:01:37.579025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d3917-d885-428b-97c0-791f40f9acea None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:01:37.580670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-752d3917-d885-428b-97c0-791f40f9acea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:37.628014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:37.699455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d3917-d885-428b-97c0-791f40f9acea None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:01:37.773323 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d491ba-bc4a-4d53-ba0a-75853f0bc921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:01:37.773928 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d491ba-bc4a-4d53-ba0a-75853f0bc921 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:37.774203 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d491ba-bc4a-4d53-ba0a-75853f0bc921 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:37.774469 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d491ba-bc4a-4d53-ba0a-75853f0bc921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:37.776092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-21d491ba-bc4a-4d53-ba0a-75853f0bc921 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:37.870542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:37.887547 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d491ba-bc4a-4d53-ba0a-75853f0bc921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:01:37.888966 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d491ba-bc4a-4d53-ba0a-75853f0bc921 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:01:37.907775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 664/1343] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:01:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:01:40.755247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5e1c7-3024-4b1d-8d22-584bf6c25fa6 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:40.755799 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5e1c7-3024-4b1d-8d22-584bf6c25fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:40.755799 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5e1c7-3024-4b1d-8d22-584bf6c25fa6 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:40.757162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 680/1344] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:01:40.762477 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e3b9d-f283-4be2-92d0-89bb12f75fe5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:40.762891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e3b9d-f283-4be2-92d0-89bb12f75fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:40.763176 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e3b9d-f283-4be2-92d0-89bb12f75fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:40.828723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2d8e3b9d-f283-4be2-92d0-89bb12f75fe5 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:01:40.830054 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2d8e3b9d-f283-4be2-92d0-89bb12f75fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:40.927539 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 665/1345] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:01:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:01:40.964356 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5e1c7-3024-4b1d-8d22-584bf6c25fa6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:01:40.965865 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-56f5e1c7-3024-4b1d-8d22-584bf6c25fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:41.053909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:41.071339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5e1c7-3024-4b1d-8d22-584bf6c25fa6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:01:41.145160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f7189-cf21-4ae2-bf15-affeaf348ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:01:41.145757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f7189-cf21-4ae2-bf15-affeaf348ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:41.146029 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f7189-cf21-4ae2-bf15-affeaf348ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:41.146295 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f7189-cf21-4ae2-bf15-affeaf348ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:41.147891 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4a5f7189-cf21-4ae2-bf15-affeaf348ba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:41.258505 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f7189-cf21-4ae2-bf15-affeaf348ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:01:41.259992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f7189-cf21-4ae2-bf15-affeaf348ba1 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:01:41.280649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 681/1346] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:01:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:01:45.326010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339252a-bcf6-4a8d-b5a0-7945a9f9e28d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:45.326528 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339252a-bcf6-4a8d-b5a0-7945a9f9e28d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:45.326528 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339252a-bcf6-4a8d-b5a0-7945a9f9e28d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:45.327966 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 666/1347] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:01:45.333227 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49aa6d-ade9-4096-b0bd-38531c3a0748 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:45.333635 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49aa6d-ade9-4096-b0bd-38531c3a0748 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:45.333771 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49aa6d-ade9-4096-b0bd-38531c3a0748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:45.354596 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:45.410087 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ac49aa6d-ade9-4096-b0bd-38531c3a0748 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:01:45.411578 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ac49aa6d-ade9-4096-b0bd-38531c3a0748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:45.514439 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 682/1348] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:01:45.553779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339252a-bcf6-4a8d-b5a0-7945a9f9e28d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:01:45.555389 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b339252a-bcf6-4a8d-b5a0-7945a9f9e28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:45.617305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:45.666616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339252a-bcf6-4a8d-b5a0-7945a9f9e28d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:01:45.743016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0291c-2af0-4120-bcf0-252fb26ab793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:01:45.743661 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0291c-2af0-4120-bcf0-252fb26ab793 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:45.743938 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0291c-2af0-4120-bcf0-252fb26ab793 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:45.744207 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0291c-2af0-4120-bcf0-252fb26ab793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:45.745837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c0d0291c-2af0-4120-bcf0-252fb26ab793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:45.854395 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:45.859110 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0291c-2af0-4120-bcf0-252fb26ab793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:01:45.860729 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0291c-2af0-4120-bcf0-252fb26ab793 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:01:45.880284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 667/1349] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:01:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:01:50.807800 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac12de-ab67-4eb3-be8c-4626216d6228 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:50.809393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac12de-ab67-4eb3-be8c-4626216d6228 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:50.809921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac12de-ab67-4eb3-be8c-4626216d6228 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:50.814190 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 683/1350] 10.222.0.40 () {54 vars in 921 bytes} [Tue Aug 9 07:01:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:01:50.823166 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569df171-4a23-4b68-bd19-11d54cfb5249 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:50.824028 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569df171-4a23-4b68-bd19-11d54cfb5249 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:50.824520 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569df171-4a23-4b68-bd19-11d54cfb5249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:50.959056 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-569df171-4a23-4b68-bd19-11d54cfb5249 None None] MFA Rules not processed for user `07d2ee351e734fd09938cea9be3bb08a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:01:50.960334 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-569df171-4a23-4b68-bd19-11d54cfb5249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:51.079340 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 668/1351] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Aug 9 07:01:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:01:55.338221 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f156b07-13fb-43a4-89ee-63aa0e75a325 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:55.339499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f156b07-13fb-43a4-89ee-63aa0e75a325 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:55.339924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f156b07-13fb-43a4-89ee-63aa0e75a325 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:55.341380 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 684/1352] 10.222.0.40 () {54 vars in 921 bytes} [Tue Aug 9 07:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:01:55.346404 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214a55f-ab60-4fd1-ae15-047ecc3b7121 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:55.346832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214a55f-ab60-4fd1-ae15-047ecc3b7121 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:55.346942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214a55f-ab60-4fd1-ae15-047ecc3b7121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:55.400997 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:55.425011 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8214a55f-ab60-4fd1-ae15-047ecc3b7121 None None] MFA Rules not processed for user `07d2ee351e734fd09938cea9be3bb08a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:01:55.426263 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8214a55f-ab60-4fd1-ae15-047ecc3b7121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:55.512526 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=59 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:55.538637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 669/1353] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Aug 9 07:01:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:01:57.073538 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6145564-dc41-4623-95c5-e5a09615b1ea None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:57.074068 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6145564-dc41-4623-95c5-e5a09615b1ea None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:57.074068 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6145564-dc41-4623-95c5-e5a09615b1ea None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:57.075694 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 685/1354] 10.222.0.40 () {54 vars in 921 bytes} [Tue Aug 9 07:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:01:57.081259 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dc26a-6e77-4a66-ad1d-f6bbf012584e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:01:57.081677 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dc26a-6e77-4a66-ad1d-f6bbf012584e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:01:57.081804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dc26a-6e77-4a66-ad1d-f6bbf012584e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:01:57.156333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-774dc26a-6e77-4a66-ad1d-f6bbf012584e None None] MFA Rules not processed for user `07d2ee351e734fd09938cea9be3bb08a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:01:57.157519 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-774dc26a-6e77-4a66-ad1d-f6bbf012584e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:01:57.202367 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:01:57.268465 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 670/1355] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Aug 9 07:01:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:00.518769 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfabfda-93b5-4420-81d1-ee94109023ff None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:00.519345 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfabfda-93b5-4420-81d1-ee94109023ff None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:00.520300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfabfda-93b5-4420-81d1-ee94109023ff None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:00.525849 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 686/1356] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:02:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:00.528767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373193be-9258-4395-b991-660aa9c9a248 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:00.531042 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373193be-9258-4395-b991-660aa9c9a248 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:00.531579 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373193be-9258-4395-b991-660aa9c9a248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:00.606458 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-373193be-9258-4395-b991-660aa9c9a248 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:00.607766 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-373193be-9258-4395-b991-660aa9c9a248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:00.720959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 671/1357] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:00.777788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71278f-3587-44ff-98f0-6847fbd35828 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:00.779016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71278f-3587-44ff-98f0-6847fbd35828 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:00.780325 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71278f-3587-44ff-98f0-6847fbd35828 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:00.782479 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 687/1358] 10.222.0.40 () {54 vars in 962 bytes} [Tue Aug 9 07:02:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:00.792021 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac975c5e-81c0-4896-bbea-06a4855af16f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:00.792744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac975c5e-81c0-4896-bbea-06a4855af16f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:00.793389 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac975c5e-81c0-4896-bbea-06a4855af16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:00.811850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:00.878643 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ac975c5e-81c0-4896-bbea-06a4855af16f None None] MFA Rules not processed for user `6e949d9666be44a0b6122d510168c7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:00.879847 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ac975c5e-81c0-4896-bbea-06a4855af16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:01.000723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 672/1359] 10.222.0.40 () {58 vars in 1059 bytes} [Tue Aug 9 07:02:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:01.008254 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71278f-3587-44ff-98f0-6847fbd35828 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:01.009760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7e71278f-3587-44ff-98f0-6847fbd35828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:01.165631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71278f-3587-44ff-98f0-6847fbd35828 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:01.242960 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:01.286865 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f9609-8af3-4515-8a3a-f2e7a21593ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:01.287453 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f9609-8af3-4515-8a3a-f2e7a21593ae service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:01.287740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f9609-8af3-4515-8a3a-f2e7a21593ae service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:01.288016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f9609-8af3-4515-8a3a-f2e7a21593ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:01.289830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ff2f9609-8af3-4515-8a3a-f2e7a21593ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:01.388729 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f9609-8af3-4515-8a3a-f2e7a21593ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:01.391078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f9609-8af3-4515-8a3a-f2e7a21593ae service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:01.411411 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 688/1360] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:02:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:02:03.722051 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908b73d-5f79-4313-81fd-0d59cf56e630 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:03.722614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908b73d-5f79-4313-81fd-0d59cf56e630 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:03.722614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908b73d-5f79-4313-81fd-0d59cf56e630 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:03.724113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 673/1361] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:03.729246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6744b-0fc2-41a7-a19d-9a3209c3ca31 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:03.729690 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6744b-0fc2-41a7-a19d-9a3209c3ca31 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:03.729776 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6744b-0fc2-41a7-a19d-9a3209c3ca31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:03.805460 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9aa6744b-0fc2-41a7-a19d-9a3209c3ca31 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:03.806574 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9aa6744b-0fc2-41a7-a19d-9a3209c3ca31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:03.846206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:03.911317 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 689/1362] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:03.959719 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908b73d-5f79-4313-81fd-0d59cf56e630 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:03.961332 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e908b73d-5f79-4313-81fd-0d59cf56e630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:04.042219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:04.139648 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908b73d-5f79-4313-81fd-0d59cf56e630 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:04.304431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d04964-03d3-4ca4-81a8-df0e27ab6ed1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:04.305123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d04964-03d3-4ca4-81a8-df0e27ab6ed1 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:04.305467 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d04964-03d3-4ca4-81a8-df0e27ab6ed1 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:04.305866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d04964-03d3-4ca4-81a8-df0e27ab6ed1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:04.307496 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f7d04964-03d3-4ca4-81a8-df0e27ab6ed1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:04.333323 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:04.407337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d04964-03d3-4ca4-81a8-df0e27ab6ed1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:04.409039 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d04964-03d3-4ca4-81a8-df0e27ab6ed1 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:04.427399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 674/1363] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:02:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:02:06.860441 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b2686-128b-478f-a5a6-eecc5c76d123 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:06.861005 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b2686-128b-478f-a5a6-eecc5c76d123 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:06.861005 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b2686-128b-478f-a5a6-eecc5c76d123 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:06.862557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 690/1364] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 07:02:06.868271 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b96c9-d24a-4bc7-8dfe-4c4185b1b46a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:06.868755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b96c9-d24a-4bc7-8dfe-4c4185b1b46a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:06.868855 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b96c9-d24a-4bc7-8dfe-4c4185b1b46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:06.958273 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a48b96c9-d24a-4bc7-8dfe-4c4185b1b46a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:06.959902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a48b96c9-d24a-4bc7-8dfe-4c4185b1b46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:07.065457 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:07.068595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 675/1365] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:02:07.114550 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c995987-6952-4295-b32a-0e1f73083687 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:07.114829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c995987-6952-4295-b32a-0e1f73083687 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:07.115153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c995987-6952-4295-b32a-0e1f73083687 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:07.116667 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 691/1366] 10.222.0.40 () {54 vars in 962 bytes} [Tue Aug 9 07:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:07.121906 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15868d8d-f488-49b6-a374-d53f294d154b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:07.122193 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15868d8d-f488-49b6-a374-d53f294d154b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:07.122468 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15868d8d-f488-49b6-a374-d53f294d154b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:07.203126 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-15868d8d-f488-49b6-a374-d53f294d154b None None] MFA Rules not processed for user `6e949d9666be44a0b6122d510168c7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:07.204313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-15868d8d-f488-49b6-a374-d53f294d154b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:07.328725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 676/1367] 10.222.0.40 () {58 vars in 1059 bytes} [Tue Aug 9 07:02:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:07.334595 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c995987-6952-4295-b32a-0e1f73083687 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:07.336251 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2c995987-6952-4295-b32a-0e1f73083687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:07.497834 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c995987-6952-4295-b32a-0e1f73083687 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:07.520325 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:07.626607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091849ee-3067-4833-95d1-8b55b4c3075e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:07.627182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091849ee-3067-4833-95d1-8b55b4c3075e service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:07.630684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091849ee-3067-4833-95d1-8b55b4c3075e service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:07.630684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091849ee-3067-4833-95d1-8b55b4c3075e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:07.630684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-091849ee-3067-4833-95d1-8b55b4c3075e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:07.730186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091849ee-3067-4833-95d1-8b55b4c3075e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:07.731840 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091849ee-3067-4833-95d1-8b55b4c3075e service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:07.751606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 692/1368] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:02:08.779946 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef97a2-82c7-434c-94e3-19676d4456d8 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:08.780472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef97a2-82c7-434c-94e3-19676d4456d8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:08.780472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef97a2-82c7-434c-94e3-19676d4456d8 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:08.782013 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 677/1369] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:08.786942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc0658-9c10-4198-a79a-eaf033f74217 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:08.787431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc0658-9c10-4198-a79a-eaf033f74217 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:08.787515 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc0658-9c10-4198-a79a-eaf033f74217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:08.825207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:08.865119 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1bdc0658-9c10-4198-a79a-eaf033f74217 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:08.866333 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1bdc0658-9c10-4198-a79a-eaf033f74217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:08.969228 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 693/1370] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:09.315341 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171879fe-6226-4d98-b62b-7866c5d961dc None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:09.315341 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171879fe-6226-4d98-b62b-7866c5d961dc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:09.315341 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171879fe-6226-4d98-b62b-7866c5d961dc None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:09.318138 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 678/1371] 10.222.0.40 () {54 vars in 964 bytes} [Tue Aug 9 07:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:09.321364 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2999bca-4724-4cc5-802e-1e9bbf700a00 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:09.321767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2999bca-4724-4cc5-802e-1e9bbf700a00 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:09.322135 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2999bca-4724-4cc5-802e-1e9bbf700a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:09.406114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b2999bca-4724-4cc5-802e-1e9bbf700a00 None None] MFA Rules not processed for user `8977d7479b3e405c976fa1a570987704`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:09.407530 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b2999bca-4724-4cc5-802e-1e9bbf700a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:09.456317 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:09.491561 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 694/1372] 10.222.0.40 () {58 vars in 1061 bytes} [Tue Aug 9 07:02:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:09.499792 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171879fe-6226-4d98-b62b-7866c5d961dc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:09.501415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-171879fe-6226-4d98-b62b-7866c5d961dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:09.557312 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:09.620695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171879fe-6226-4d98-b62b-7866c5d961dc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:09.702818 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16819e08-45c9-4d19-aad9-0fc8d925518e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:09.703712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16819e08-45c9-4d19-aad9-0fc8d925518e service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:09.704195 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16819e08-45c9-4d19-aad9-0fc8d925518e service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:09.704565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16819e08-45c9-4d19-aad9-0fc8d925518e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:09.706371 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-16819e08-45c9-4d19-aad9-0fc8d925518e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:09.814195 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:09.831426 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16819e08-45c9-4d19-aad9-0fc8d925518e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:09.832806 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16819e08-45c9-4d19-aad9-0fc8d925518e service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:09.853198 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 679/1373] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:02:09.897179 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31005f-d891-4753-8fef-3e4dd7b4b4a6 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:09.897699 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31005f-d891-4753-8fef-3e4dd7b4b4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:09.897699 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31005f-d891-4753-8fef-3e4dd7b4b4a6 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:09.899044 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 695/1374] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:09.904666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652643c-fd88-4f63-831a-b36e2cdea424 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:09.904971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652643c-fd88-4f63-831a-b36e2cdea424 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:09.905260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652643c-fd88-4f63-831a-b36e2cdea424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:09.986826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e652643c-fd88-4f63-831a-b36e2cdea424 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:09.988303 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e652643c-fd88-4f63-831a-b36e2cdea424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:10.091675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 680/1375] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:10.139120 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31005f-d891-4753-8fef-3e4dd7b4b4a6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:10.140075 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-db31005f-d891-4753-8fef-3e4dd7b4b4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:10.303922 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31005f-d891-4753-8fef-3e4dd7b4b4a6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:10.355600 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:10.416652 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a94f4-7ca2-4814-970c-ab40f81c9652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:10.417252 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a94f4-7ca2-4814-970c-ab40f81c9652 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:10.417523 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a94f4-7ca2-4814-970c-ab40f81c9652 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:10.417789 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a94f4-7ca2-4814-970c-ab40f81c9652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:10.419384 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-895a94f4-7ca2-4814-970c-ab40f81c9652 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:10.506611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a94f4-7ca2-4814-970c-ab40f81c9652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:10.508211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a94f4-7ca2-4814-970c-ab40f81c9652 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:10.526222 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 696/1376] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:02:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:02:12.571759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa95d50-d7ac-4d71-8bf0-0ad2b0eec568 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:12.572265 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa95d50-d7ac-4d71-8bf0-0ad2b0eec568 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:12.572265 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa95d50-d7ac-4d71-8bf0-0ad2b0eec568 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:12.573542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 681/1377] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 07:02:12.579364 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490157c-78b8-43aa-9bd9-7e6fa4086624 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:12.579810 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490157c-78b8-43aa-9bd9-7e6fa4086624 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:12.579925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490157c-78b8-43aa-9bd9-7e6fa4086624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:12.656456 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f490157c-78b8-43aa-9bd9-7e6fa4086624 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:12.657762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f490157c-78b8-43aa-9bd9-7e6fa4086624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:12.665731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:12.757876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 697/1378] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:12.805948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa95d50-d7ac-4d71-8bf0-0ad2b0eec568 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:12.807713 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2aa95d50-d7ac-4d71-8bf0-0ad2b0eec568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:12.885403 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:12.977050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa95d50-d7ac-4d71-8bf0-0ad2b0eec568 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:13.090148 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69791495-088f-43f2-a3dc-1e62dc2bb217 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:13.090748 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69791495-088f-43f2-a3dc-1e62dc2bb217 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:13.091019 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69791495-088f-43f2-a3dc-1e62dc2bb217 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:13.091308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69791495-088f-43f2-a3dc-1e62dc2bb217 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:13.092917 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-69791495-088f-43f2-a3dc-1e62dc2bb217 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:13.111749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:13.183823 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69791495-088f-43f2-a3dc-1e62dc2bb217 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:13.186286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69791495-088f-43f2-a3dc-1e62dc2bb217 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:13.208699 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 682/1379] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:02:15.312079 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33359eec-c56f-43b3-8484-2aac9b88c6f3 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:15.312606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33359eec-c56f-43b3-8484-2aac9b88c6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:15.312606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33359eec-c56f-43b3-8484-2aac9b88c6f3 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:15.314014 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 698/1380] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:15.319209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c894b1-4989-4435-8299-8d4b509eafa3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:15.319638 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c894b1-4989-4435-8299-8d4b509eafa3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:15.319824 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c894b1-4989-4435-8299-8d4b509eafa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:15.396731 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-44c894b1-4989-4435-8299-8d4b509eafa3 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:15.397922 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-44c894b1-4989-4435-8299-8d4b509eafa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:15.492752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:15.500384 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 683/1381] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:15.545834 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33359eec-c56f-43b3-8484-2aac9b88c6f3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:15.547594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-33359eec-c56f-43b3-8484-2aac9b88c6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:15.717713 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:15.729407 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33359eec-c56f-43b3-8484-2aac9b88c6f3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:15.847764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69205e3-0b5a-4b47-b9d0-9afa39ce9d81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:15.848285 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69205e3-0b5a-4b47-b9d0-9afa39ce9d81 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:15.848561 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69205e3-0b5a-4b47-b9d0-9afa39ce9d81 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:15.848828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69205e3-0b5a-4b47-b9d0-9afa39ce9d81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:15.850409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f69205e3-0b5a-4b47-b9d0-9afa39ce9d81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:15.947903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69205e3-0b5a-4b47-b9d0-9afa39ce9d81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:15.950326 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69205e3-0b5a-4b47-b9d0-9afa39ce9d81 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:15.961841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:15.971654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 699/1382] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:02:18.283683 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7637e93-9396-42e7-86fb-89d32a25129a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:18.284272 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7637e93-9396-42e7-86fb-89d32a25129a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:18.284272 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7637e93-9396-42e7-86fb-89d32a25129a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:18.285595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 684/1383] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:18.291929 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c05373-1fa5-47c2-b17d-8dbd328a7f52 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:18.292477 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c05373-1fa5-47c2-b17d-8dbd328a7f52 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:18.292726 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c05373-1fa5-47c2-b17d-8dbd328a7f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:18.360560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b2c05373-1fa5-47c2-b17d-8dbd328a7f52 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:18.361775 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b2c05373-1fa5-47c2-b17d-8dbd328a7f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:18.457785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 700/1384] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:18.515261 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7637e93-9396-42e7-86fb-89d32a25129a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:18.516849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d7637e93-9396-42e7-86fb-89d32a25129a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:18.827736 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7637e93-9396-42e7-86fb-89d32a25129a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:18.910316 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:18.967617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8e7a3-39d4-4ebd-b5cf-eb255d8299c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:18.968276 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8e7a3-39d4-4ebd-b5cf-eb255d8299c1 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:18.968574 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8e7a3-39d4-4ebd-b5cf-eb255d8299c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:18.968846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8e7a3-39d4-4ebd-b5cf-eb255d8299c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:18.970579 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d6f8e7a3-39d4-4ebd-b5cf-eb255d8299c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:19.067093 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8e7a3-39d4-4ebd-b5cf-eb255d8299c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:19.068733 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8e7a3-39d4-4ebd-b5cf-eb255d8299c1 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:19.088061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 685/1385] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:02:21.078326 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c2a9d-2ff5-45a6-b3a7-37f3a709c358 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:21.078862 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c2a9d-2ff5-45a6-b3a7-37f3a709c358 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:21.078974 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c2a9d-2ff5-45a6-b3a7-37f3a709c358 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:21.080337 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 701/1386] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:21.085930 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a1c6d-bd0b-4361-b4b8-ea7179ffafee None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:21.086347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a1c6d-bd0b-4361-b4b8-ea7179ffafee None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:21.086632 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a1c6d-bd0b-4361-b4b8-ea7179ffafee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:21.160873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-856a1c6d-bd0b-4361-b4b8-ea7179ffafee None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:21.162011 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-856a1c6d-bd0b-4361-b4b8-ea7179ffafee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:21.194651 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:21.258480 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 686/1387] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:21.304990 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c2a9d-2ff5-45a6-b3a7-37f3a709c358 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:21.306513 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e27c2a9d-2ff5-45a6-b3a7-37f3a709c358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:21.385065 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:21.457322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c2a9d-2ff5-45a6-b3a7-37f3a709c358 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:21.569887 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cda630-93de-46af-be32-4bff44b4e3d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:21.570498 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cda630-93de-46af-be32-4bff44b4e3d2 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:21.570777 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cda630-93de-46af-be32-4bff44b4e3d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:21.571048 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cda630-93de-46af-be32-4bff44b4e3d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:21.572678 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-96cda630-93de-46af-be32-4bff44b4e3d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:21.612890 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:21.674695 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cda630-93de-46af-be32-4bff44b4e3d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:21.676445 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cda630-93de-46af-be32-4bff44b4e3d2 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:21.696846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 702/1388] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:02:23.768481 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168bf32-abf7-4043-afc9-edf51a73464b None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:23.769087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168bf32-abf7-4043-afc9-edf51a73464b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:23.769087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168bf32-abf7-4043-afc9-edf51a73464b None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:23.770337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 687/1389] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:23.775482 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55aab03-f380-4612-a89a-800c9786292e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:23.775926 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55aab03-f380-4612-a89a-800c9786292e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:23.776042 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55aab03-f380-4612-a89a-800c9786292e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:23.841863 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f55aab03-f380-4612-a89a-800c9786292e None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:23.843036 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f55aab03-f380-4612-a89a-800c9786292e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:23.938996 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 703/1390] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:23.984377 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168bf32-abf7-4043-afc9-edf51a73464b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:23.985882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7168bf32-abf7-4043-afc9-edf51a73464b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:24.132343 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168bf32-abf7-4043-afc9-edf51a73464b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:24.148628 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:24.246030 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34934e15-505c-463d-bd2b-4265d5ab9699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:24.246632 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34934e15-505c-463d-bd2b-4265d5ab9699 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:24.246909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34934e15-505c-463d-bd2b-4265d5ab9699 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:24.247746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34934e15-505c-463d-bd2b-4265d5ab9699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:24.249497 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-34934e15-505c-463d-bd2b-4265d5ab9699 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:24.336862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34934e15-505c-463d-bd2b-4265d5ab9699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:24.338451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34934e15-505c-463d-bd2b-4265d5ab9699 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:24.356288 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 688/1391] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:02:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:02:24.921600 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8624f-30e8-424a-9143-fce92b386551 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:24.922144 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8624f-30e8-424a-9143-fce92b386551 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:24.922144 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8624f-30e8-424a-9143-fce92b386551 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:24.923633 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 704/1392] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:24.928652 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14ec63-993e-4ab0-ad5e-a5cf5b959091 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:24.929097 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14ec63-993e-4ab0-ad5e-a5cf5b959091 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:24.929215 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14ec63-993e-4ab0-ad5e-a5cf5b959091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:24.955562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:24.996655 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3b14ec63-993e-4ab0-ad5e-a5cf5b959091 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:24.998376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3b14ec63-993e-4ab0-ad5e-a5cf5b959091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:25.093595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 689/1393] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:25.150630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a215a7-7d3e-42ef-93a4-cd29b9a3d4f6 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:25.150985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a215a7-7d3e-42ef-93a4-cd29b9a3d4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:25.151378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a215a7-7d3e-42ef-93a4-cd29b9a3d4f6 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:25.152843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 705/1394] 10.222.0.40 () {54 vars in 967 bytes} [Tue Aug 9 07:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:25.158097 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c567c-7a89-44da-b1d9-f4d32edd0466 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:25.158382 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c567c-7a89-44da-b1d9-f4d32edd0466 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:25.158652 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c567c-7a89-44da-b1d9-f4d32edd0466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:25.234477 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-da2c567c-7a89-44da-b1d9-f4d32edd0466 None None] MFA Rules not processed for user `e44c764958784616b8bdbf59e5692ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:25.235711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-da2c567c-7a89-44da-b1d9-f4d32edd0466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:25.275945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:25.312982 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 690/1395] 10.222.0.40 () {58 vars in 1064 bytes} [Tue Aug 9 07:02:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:25.320423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a215a7-7d3e-42ef-93a4-cd29b9a3d4f6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:25.321911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-02a215a7-7d3e-42ef-93a4-cd29b9a3d4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:25.335619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:25.426505 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a215a7-7d3e-42ef-93a4-cd29b9a3d4f6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:25.503994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32016a86-cb95-4140-9350-c4cd843c3cda service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44c764958784616b8bdbf59e5692ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:25.504509 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32016a86-cb95-4140-9350-c4cd843c3cda service glance] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:25.504783 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32016a86-cb95-4140-9350-c4cd843c3cda service glance] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:25.505048 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32016a86-cb95-4140-9350-c4cd843c3cda service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:25.506632 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-32016a86-cb95-4140-9350-c4cd843c3cda service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:25.575358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:25.619640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32016a86-cb95-4140-9350-c4cd843c3cda service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:25.621278 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32016a86-cb95-4140-9350-c4cd843c3cda service glance] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:25.644252 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 706/1396] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:02:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:02:26.392932 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f22876-3635-4e79-ab95-42c0eba2cec6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:26.393500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f22876-3635-4e79-ab95-42c0eba2cec6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:26.393500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f22876-3635-4e79-ab95-42c0eba2cec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:26.401618 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ade804-0282-42d5-95e9-394d1be90844 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:26.402118 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ade804-0282-42d5-95e9-394d1be90844 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:26.402228 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ade804-0282-42d5-95e9-394d1be90844 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:26.404554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 707/1397] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:02:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 07:02:26.409559 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e1265-c008-4db8-b737-7dc64a3a3d58 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:26.409847 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e1265-c008-4db8-b737-7dc64a3a3d58 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:26.410123 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e1265-c008-4db8-b737-7dc64a3a3d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:26.460360 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-90f22876-3635-4e79-ab95-42c0eba2cec6 None None] MFA Rules not processed for user `664e4353726c42c9bfb80b1701d35aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:26.461564 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-90f22876-3635-4e79-ab95-42c0eba2cec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:26.476402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-bf6e1265-c008-4db8-b737-7dc64a3a3d58 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:26.477578 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bf6e1265-c008-4db8-b737-7dc64a3a3d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:26.548766 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 691/1398] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Aug 9 07:02:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:26.577496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 708/1399] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:02:26.601795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699e143-2063-4e0e-a5c7-3b36b09fee44 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:26.602224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699e143-2063-4e0e-a5c7-3b36b09fee44 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:26.602558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699e143-2063-4e0e-a5c7-3b36b09fee44 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:26.604006 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 692/1400] 10.222.0.40 () {54 vars in 943 bytes} [Tue Aug 9 07:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:26.612273 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a152f0f-e485-496d-b85b-66e377c26c8f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:26.612418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a152f0f-e485-496d-b85b-66e377c26c8f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:26.612697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a152f0f-e485-496d-b85b-66e377c26c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:26.631662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699e143-2063-4e0e-a5c7-3b36b09fee44 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:26.633364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7699e143-2063-4e0e-a5c7-3b36b09fee44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:26.641866 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:26.698434 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:26.790669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699e143-2063-4e0e-a5c7-3b36b09fee44 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:26.820530 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3a152f0f-e485-496d-b85b-66e377c26c8f None None] MFA Rules not processed for user `92f19a17424c44eea58efb957246cb48`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:26.821756 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3a152f0f-e485-496d-b85b-66e377c26c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:26.907372 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa708a-11e4-4269-a8e7-e7903c4e97e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:26.908053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa708a-11e4-4269-a8e7-e7903c4e97e1 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:26.908355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa708a-11e4-4269-a8e7-e7903c4e97e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:26.908624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa708a-11e4-4269-a8e7-e7903c4e97e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:26.910216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-93fa708a-11e4-4269-a8e7-e7903c4e97e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:26.929910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:26.931825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 709/1401] 10.222.0.40 () {58 vars in 1040 bytes} [Tue Aug 9 07:02:26 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:26.941765 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a152f0f-e485-496d-b85b-66e377c26c8f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:26.951954 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a152f0f-e485-496d-b85b-66e377c26c8f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:27.005492 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa708a-11e4-4269-a8e7-e7903c4e97e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:27.007106 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa708a-11e4-4269-a8e7-e7903c4e97e1 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:27.023245 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:27.025842 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 693/1402] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:02:27.061750 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f711b86-3cd7-43a6-a3f5-6e2d2a21ecf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f19a17424c44eea58efb957246cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:27.062340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f711b86-3cd7-43a6-a3f5-6e2d2a21ecf6 service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:27.062663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f711b86-3cd7-43a6-a3f5-6e2d2a21ecf6 service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:27.062874 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f711b86-3cd7-43a6-a3f5-6e2d2a21ecf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:27.064543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7f711b86-3cd7-43a6-a3f5-6e2d2a21ecf6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:27.153144 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f711b86-3cd7-43a6-a3f5-6e2d2a21ecf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:27.155200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f711b86-3cd7-43a6-a3f5-6e2d2a21ecf6 service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:27.164113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 710/1403] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Aug 9 07:02:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 07:02:29.087030 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e818c7f-361d-4cf6-b102-9af6e862cb27 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:29.087637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e818c7f-361d-4cf6-b102-9af6e862cb27 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:29.087637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e818c7f-361d-4cf6-b102-9af6e862cb27 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:29.091214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 694/1404] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:29.094831 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433789b-c0cd-4192-a799-857dddf7a857 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:29.095287 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433789b-c0cd-4192-a799-857dddf7a857 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:29.095401 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433789b-c0cd-4192-a799-857dddf7a857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:29.165479 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7433789b-c0cd-4192-a799-857dddf7a857 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:29.166799 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7433789b-c0cd-4192-a799-857dddf7a857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:29.225780 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:29.274039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 711/1405] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:02:29.320425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e818c7f-361d-4cf6-b102-9af6e862cb27 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:29.321941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9e818c7f-361d-4cf6-b102-9af6e862cb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:29.480295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:29.485110 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e818c7f-361d-4cf6-b102-9af6e862cb27 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:29.620250 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818da50-7535-46f1-b3b1-594481440ba8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:29.620939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818da50-7535-46f1-b3b1-594481440ba8 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:29.621241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818da50-7535-46f1-b3b1-594481440ba8 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:29.621510 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818da50-7535-46f1-b3b1-594481440ba8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:29.625809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1818da50-7535-46f1-b3b1-594481440ba8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:29.724763 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818da50-7535-46f1-b3b1-594481440ba8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:29.726388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818da50-7535-46f1-b3b1-594481440ba8 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:29.745881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 695/1406] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:02:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:02:31.807014 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8ae74-3429-4063-b8ba-31105c8b5950 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:31.807612 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8ae74-3429-4063-b8ba-31105c8b5950 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:31.807612 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8ae74-3429-4063-b8ba-31105c8b5950 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:31.808919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 712/1407] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:31.814835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048934b-1954-4364-a6e9-10840955825d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:31.815293 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048934b-1954-4364-a6e9-10840955825d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:31.815567 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048934b-1954-4364-a6e9-10840955825d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:31.820017 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:31.890664 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d048934b-1954-4364-a6e9-10840955825d None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:31.891221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d048934b-1954-4364-a6e9-10840955825d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:31.994245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 696/1408] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:32.039741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8ae74-3429-4063-b8ba-31105c8b5950 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:32.040270 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c3f8ae74-3429-4063-b8ba-31105c8b5950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:32.205489 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8ae74-3429-4063-b8ba-31105c8b5950 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:32.251069 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:32.458300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbdcfd-5051-435f-91b1-9dec9723a45b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:32.459495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbdcfd-5051-435f-91b1-9dec9723a45b service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:32.460347 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbdcfd-5051-435f-91b1-9dec9723a45b service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:32.460730 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbdcfd-5051-435f-91b1-9dec9723a45b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:32.463888 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a1fbdcfd-5051-435f-91b1-9dec9723a45b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:32.594729 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbdcfd-5051-435f-91b1-9dec9723a45b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:32.597607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbdcfd-5051-435f-91b1-9dec9723a45b service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:32.625113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 713/1409] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:02:41.992206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=64 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:42.620968 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=79 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:49.438179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700681b-c603-4267-89df-e61043d40fa2 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:49.438771 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700681b-c603-4267-89df-e61043d40fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:49.438771 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700681b-c603-4267-89df-e61043d40fa2 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:49.440082 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 697/1410] 10.222.0.40 () {54 vars in 918 bytes} [Tue Aug 9 07:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:49.445045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285485dc-6d71-4c07-84ea-334c1d4d0713 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:49.445491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285485dc-6d71-4c07-84ea-334c1d4d0713 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:49.445589 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285485dc-6d71-4c07-84ea-334c1d4d0713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:49.520180 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-285485dc-6d71-4c07-84ea-334c1d4d0713 None None] MFA Rules not processed for user `07d2ee351e734fd09938cea9be3bb08a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:49.521482 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-285485dc-6d71-4c07-84ea-334c1d4d0713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:49.625976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 714/1411] 10.222.0.40 () {58 vars in 1015 bytes} [Tue Aug 9 07:02:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:49.641015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20642536-5b6c-41a0-b583-9024915e52d0 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:49.641315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20642536-5b6c-41a0-b583-9024915e52d0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:49.641583 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20642536-5b6c-41a0-b583-9024915e52d0 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:49.642940 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 698/1412] 10.222.0.40 () {54 vars in 918 bytes} [Tue Aug 9 07:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:49.647598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fa507-9e59-469a-bf63-e1d9d8a15050 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:49.647887 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fa507-9e59-469a-bf63-e1d9d8a15050 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:49.648160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fa507-9e59-469a-bf63-e1d9d8a15050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:49.720843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:49.723954 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b99fa507-9e59-469a-bf63-e1d9d8a15050 None None] MFA Rules not processed for user `6e949d9666be44a0b6122d510168c7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:49.725834 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b99fa507-9e59-469a-bf63-e1d9d8a15050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:49.837634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 715/1413] 10.222.0.40 () {58 vars in 1015 bytes} [Tue Aug 9 07:02:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:52.299077 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f85e6-30cd-4785-ac59-2b154c256b63 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:52.299633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f85e6-30cd-4785-ac59-2b154c256b63 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:52.299633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f85e6-30cd-4785-ac59-2b154c256b63 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:52.300891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 699/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 07:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:52.306022 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939adb79-3c36-47a2-abee-2bc61c22798f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:52.306449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939adb79-3c36-47a2-abee-2bc61c22798f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:52.306577 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939adb79-3c36-47a2-abee-2bc61c22798f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:52.371976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-939adb79-3c36-47a2-abee-2bc61c22798f None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:52.373154 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-939adb79-3c36-47a2-abee-2bc61c22798f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:52.426196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:52.467983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 716/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 07:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:52.509663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f85e6-30cd-4785-ac59-2b154c256b63 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:52.511198 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4c8f85e6-30cd-4785-ac59-2b154c256b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:52.677500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f85e6-30cd-4785-ac59-2b154c256b63 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:52.750147 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:52.789843 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2b048-fffa-4b4f-86cf-cf949046263c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:52.790469 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2b048-fffa-4b4f-86cf-cf949046263c service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:52.790746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2b048-fffa-4b4f-86cf-cf949046263c service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:52.791013 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2b048-fffa-4b4f-86cf-cf949046263c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:52.792631 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cdc2b048-fffa-4b4f-86cf-cf949046263c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:52.879533 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2b048-fffa-4b4f-86cf-cf949046263c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:52.881043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2b048-fffa-4b4f-86cf-cf949046263c service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:52.899177 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 700/1416] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:02:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:02:53.831863 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8c6a9-88eb-46e2-9770-648b502ef37c None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:53.832424 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8c6a9-88eb-46e2-9770-648b502ef37c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:53.832424 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8c6a9-88eb-46e2-9770-648b502ef37c None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:53.833746 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 717/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 07:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:53.838892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff3214-7381-445a-b24d-7d2b12a52ed4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:53.839339 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff3214-7381-445a-b24d-7d2b12a52ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:53.839434 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff3214-7381-445a-b24d-7d2b12a52ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:53.912715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-70ff3214-7381-445a-b24d-7d2b12a52ed4 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:53.913825 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-70ff3214-7381-445a-b24d-7d2b12a52ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:53.941589 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:54.011477 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 701/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 07:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:54.164069 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8c6a9-88eb-46e2-9770-648b502ef37c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:54.165492 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3ef8c6a9-88eb-46e2-9770-648b502ef37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:54.309574 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8c6a9-88eb-46e2-9770-648b502ef37c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:54.348477 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:54.420290 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1233c54-11bc-4e1c-b6c3-686923bcbe4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:54.420940 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1233c54-11bc-4e1c-b6c3-686923bcbe4b service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:54.421214 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1233c54-11bc-4e1c-b6c3-686923bcbe4b service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:54.421481 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1233c54-11bc-4e1c-b6c3-686923bcbe4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:54.423400 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b1233c54-11bc-4e1c-b6c3-686923bcbe4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:54.515677 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1233c54-11bc-4e1c-b6c3-686923bcbe4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:54.517260 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1233c54-11bc-4e1c-b6c3-686923bcbe4b service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:54.535612 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 718/1419] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:02:55.474225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ec7cc-99a3-4bf1-8ae2-85e7a6fd4e35 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:55.474806 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ec7cc-99a3-4bf1-8ae2-85e7a6fd4e35 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:55.474806 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ec7cc-99a3-4bf1-8ae2-85e7a6fd4e35 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:55.476131 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 702/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 07:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:55.481511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd022d-8b3c-403b-a3bf-29653689913d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:55.481949 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd022d-8b3c-403b-a3bf-29653689913d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:55.482045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd022d-8b3c-403b-a3bf-29653689913d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:55.537751 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:55.562098 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b9fd022d-8b3c-403b-a3bf-29653689913d None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:55.563365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b9fd022d-8b3c-403b-a3bf-29653689913d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:55.662232 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 719/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 07:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:55.816976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ec7cc-99a3-4bf1-8ae2-85e7a6fd4e35 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:55.818385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0b4ec7cc-99a3-4bf1-8ae2-85e7a6fd4e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:55.958451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ec7cc-99a3-4bf1-8ae2-85e7a6fd4e35 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:55.970969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:56.068507 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef20847-4882-43c9-b972-2541bf60b137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:56.069018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef20847-4882-43c9-b972-2541bf60b137 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:56.069289 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef20847-4882-43c9-b972-2541bf60b137 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:56.069552 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef20847-4882-43c9-b972-2541bf60b137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:56.071132 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fef20847-4882-43c9-b972-2541bf60b137 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:56.158838 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef20847-4882-43c9-b972-2541bf60b137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:56.160448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef20847-4882-43c9-b972-2541bf60b137 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:56.178308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 703/1422] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:02:57.035645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2363209-8e78-4c29-8c8a-d9ee9d0c6521 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:57.036222 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2363209-8e78-4c29-8c8a-d9ee9d0c6521 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:57.036222 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2363209-8e78-4c29-8c8a-d9ee9d0c6521 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:57.037531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 720/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 07:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:57.042388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3e7ff-c05e-4ba3-86f1-5ce2f818e467 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:57.043329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3e7ff-c05e-4ba3-86f1-5ce2f818e467 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:57.043465 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3e7ff-c05e-4ba3-86f1-5ce2f818e467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:57.063466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:57.117952 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3cd3e7ff-c05e-4ba3-86f1-5ce2f818e467 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:57.119182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3cd3e7ff-c05e-4ba3-86f1-5ce2f818e467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:57.215585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 704/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 07:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:57.367164 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2363209-8e78-4c29-8c8a-d9ee9d0c6521 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:57.368608 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a2363209-8e78-4c29-8c8a-d9ee9d0c6521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:57.477105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:57.513902 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2363209-8e78-4c29-8c8a-d9ee9d0c6521 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:57.627314 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0e91d-8153-4e02-b38b-3e6b2c344d5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:57.627839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0e91d-8153-4e02-b38b-3e6b2c344d5c service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:57.628114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0e91d-8153-4e02-b38b-3e6b2c344d5c service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:57.628381 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0e91d-8153-4e02-b38b-3e6b2c344d5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:57.629973 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bff0e91d-8153-4e02-b38b-3e6b2c344d5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:57.705122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:57.718710 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0e91d-8153-4e02-b38b-3e6b2c344d5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:57.720354 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0e91d-8153-4e02-b38b-3e6b2c344d5c service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:57.739112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 721/1425] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:02:58.597278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3c5be-f87e-4725-87fa-abb429867e65 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:58.597857 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3c5be-f87e-4725-87fa-abb429867e65 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:58.597857 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3c5be-f87e-4725-87fa-abb429867e65 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:58.599510 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 705/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 07:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:02:58.604506 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc84fb-99df-4d1a-87b6-6d4d37e126f1 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:58.604938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc84fb-99df-4d1a-87b6-6d4d37e126f1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:58.605032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc84fb-99df-4d1a-87b6-6d4d37e126f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:58.679396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-80fc84fb-99df-4d1a-87b6-6d4d37e126f1 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:02:58.680584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-80fc84fb-99df-4d1a-87b6-6d4d37e126f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:58.774790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 722/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 07:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:02:58.929050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3c5be-f87e-4725-87fa-abb429867e65 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:02:58.930543 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-31b3c5be-f87e-4725-87fa-abb429867e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:59.012459 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:59.073043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3c5be-f87e-4725-87fa-abb429867e65 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:02:59.181041 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d77b16-ad65-479c-a816-9ef26397277b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:02:59.181557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d77b16-ad65-479c-a816-9ef26397277b service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:02:59.181828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d77b16-ad65-479c-a816-9ef26397277b service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:02:59.182089 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d77b16-ad65-479c-a816-9ef26397277b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:02:59.184371 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-75d77b16-ad65-479c-a816-9ef26397277b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:02:59.229493 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:59.270781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d77b16-ad65-479c-a816-9ef26397277b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:02:59.272373 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d77b16-ad65-479c-a816-9ef26397277b service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:02:59.289667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 706/1428] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:02:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:03:00.088313 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fef9cb-297d-4a75-a205-c4f188dc7a69 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:00.088884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fef9cb-297d-4a75-a205-c4f188dc7a69 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:00.088884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fef9cb-297d-4a75-a205-c4f188dc7a69 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:00.091013 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 723/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 07:03:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:03:00.095902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fd20f-c452-4ebf-8a07-4657643612f6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:00.096329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fd20f-c452-4ebf-8a07-4657643612f6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:00.096447 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fd20f-c452-4ebf-8a07-4657643612f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:00.171014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-050fd20f-c452-4ebf-8a07-4657643612f6 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:03:00.172240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-050fd20f-c452-4ebf-8a07-4657643612f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:00.269137 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 707/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 07:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:03:00.421217 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fef9cb-297d-4a75-a205-c4f188dc7a69 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:03:00.422637 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-04fef9cb-297d-4a75-a205-c4f188dc7a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:00.471354 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:00.568373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fef9cb-297d-4a75-a205-c4f188dc7a69 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:03:00.681450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2d7dd-a8e6-427f-beae-dd1c8df56007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:03:00.681984 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2d7dd-a8e6-427f-beae-dd1c8df56007 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:00.682260 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2d7dd-a8e6-427f-beae-dd1c8df56007 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:00.682528 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2d7dd-a8e6-427f-beae-dd1c8df56007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:00.684147 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cbb2d7dd-a8e6-427f-beae-dd1c8df56007 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:00.690912 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:00.772089 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2d7dd-a8e6-427f-beae-dd1c8df56007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:03:00.773642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2d7dd-a8e6-427f-beae-dd1c8df56007 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:03:00.791451 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 724/1431] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:03:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:03:01.613474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c13e66-8aa7-4122-a5d3-80f59e31b721 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:01.614031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c13e66-8aa7-4122-a5d3-80f59e31b721 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:01.614031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c13e66-8aa7-4122-a5d3-80f59e31b721 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:01.615515 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 708/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 07:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:03:01.620605 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73eba5-3a66-4521-a861-c6fa718fe133 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:01.621210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73eba5-3a66-4521-a861-c6fa718fe133 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:01.621762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73eba5-3a66-4521-a861-c6fa718fe133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:01.694710 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-dd73eba5-3a66-4521-a861-c6fa718fe133 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:03:01.695916 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-dd73eba5-3a66-4521-a861-c6fa718fe133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:01.768810 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:01.801753 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 725/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 07:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:03:01.954445 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c13e66-8aa7-4122-a5d3-80f59e31b721 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:03:01.955984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-45c13e66-8aa7-4122-a5d3-80f59e31b721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:01.972951 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:02.098689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c13e66-8aa7-4122-a5d3-80f59e31b721 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:03:02.182229 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:02.208461 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c38ef0-f437-45d7-9d3a-8750295b28fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:03:02.209065 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c38ef0-f437-45d7-9d3a-8750295b28fd service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:02.209341 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c38ef0-f437-45d7-9d3a-8750295b28fd service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:02.210104 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c38ef0-f437-45d7-9d3a-8750295b28fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:02.211224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c8c38ef0-f437-45d7-9d3a-8750295b28fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:02.299242 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c38ef0-f437-45d7-9d3a-8750295b28fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:03:02.300820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c38ef0-f437-45d7-9d3a-8750295b28fd service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:03:02.318706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 709/1434] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:03:03.190559 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294057a0-c7b0-4358-8658-2e66ae1103c7 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:03.191186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294057a0-c7b0-4358-8658-2e66ae1103c7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:03.191186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294057a0-c7b0-4358-8658-2e66ae1103c7 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:03.192537 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 726/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 07:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:03:03.197531 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b7adf-b4b9-4fed-a986-efb0ac9b7c31 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:03.198029 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b7adf-b4b9-4fed-a986-efb0ac9b7c31 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:03.198628 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b7adf-b4b9-4fed-a986-efb0ac9b7c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:03.284478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a27b7adf-b4b9-4fed-a986-efb0ac9b7c31 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:03:03.285704 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a27b7adf-b4b9-4fed-a986-efb0ac9b7c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:03.331680 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:03.392180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 710/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 07:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:03:03.548616 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294057a0-c7b0-4358-8658-2e66ae1103c7 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:03:03.550161 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-294057a0-c7b0-4358-8658-2e66ae1103c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:03.697255 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294057a0-c7b0-4358-8658-2e66ae1103c7 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:03:03.750805 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:03.812197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d05cfa-7c35-4d76-a804-93b75ab36e6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:03:03.812718 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d05cfa-7c35-4d76-a804-93b75ab36e6e service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:03.812996 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d05cfa-7c35-4d76-a804-93b75ab36e6e service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:03.813269 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d05cfa-7c35-4d76-a804-93b75ab36e6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:03.814860 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-18d05cfa-7c35-4d76-a804-93b75ab36e6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:03.903863 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d05cfa-7c35-4d76-a804-93b75ab36e6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:03:03.905445 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d05cfa-7c35-4d76-a804-93b75ab36e6e service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:03:03.923687 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 727/1437] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:03:04.727601 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d48351-a691-4d75-9a19-a442ac31a06b None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:04.728155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d48351-a691-4d75-9a19-a442ac31a06b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:04.728155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d48351-a691-4d75-9a19-a442ac31a06b None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:04.729508 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 711/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 07:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:03:04.734472 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2958a-d134-4938-851e-dee89f38357e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:04.734885 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2958a-d134-4938-851e-dee89f38357e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:04.735004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2958a-d134-4938-851e-dee89f38357e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:04.809437 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9aa2958a-d134-4938-851e-dee89f38357e None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:03:04.810627 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9aa2958a-d134-4938-851e-dee89f38357e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:04.812597 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:04.905352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 728/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 07:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:03:05.055786 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d48351-a691-4d75-9a19-a442ac31a06b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:03:05.057283 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d4d48351-a691-4d75-9a19-a442ac31a06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:05.198707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d48351-a691-4d75-9a19-a442ac31a06b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:03:05.224495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:05.314207 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316c4f8-50af-4deb-9e78-1d987174759e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:03:05.314818 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c4f8-50af-4deb-9e78-1d987174759e service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:05.315107 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c4f8-50af-4deb-9e78-1d987174759e service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:05.315401 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c4f8-50af-4deb-9e78-1d987174759e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:05.316989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6316c4f8-50af-4deb-9e78-1d987174759e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:05.403172 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316c4f8-50af-4deb-9e78-1d987174759e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:03:05.404745 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316c4f8-50af-4deb-9e78-1d987174759e service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:03:05.422518 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 712/1440] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:03:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:03:07.336824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7a32-cdc0-4982-8bcd-be6129561776 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:07.337342 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7a32-cdc0-4982-8bcd-be6129561776 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:07.337342 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7a32-cdc0-4982-8bcd-be6129561776 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:07.338682 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 729/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 07:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:03:07.344801 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041b8d1-06e6-4bca-ac63-3ccdc8dbad6a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:07.345233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041b8d1-06e6-4bca-ac63-3ccdc8dbad6a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:07.345331 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041b8d1-06e6-4bca-ac63-3ccdc8dbad6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:07.384789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:07.410576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d041b8d1-06e6-4bca-ac63-3ccdc8dbad6a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:03:07.411798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d041b8d1-06e6-4bca-ac63-3ccdc8dbad6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:07.505217 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 713/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 07:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:03:07.544945 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd7a32-cdc0-4982-8bcd-be6129561776 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:03:07.546483 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-51dd7a32-cdc0-4982-8bcd-be6129561776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:07.650289 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd7a32-cdc0-4982-8bcd-be6129561776 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:03:07.682054 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:07.723445 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12c62f-67c0-41a1-9564-00976bc79072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:03:07.724031 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12c62f-67c0-41a1-9564-00976bc79072 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:07.724312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12c62f-67c0-41a1-9564-00976bc79072 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:07.724583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12c62f-67c0-41a1-9564-00976bc79072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:07.726169 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0c12c62f-67c0-41a1-9564-00976bc79072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:07.835467 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12c62f-67c0-41a1-9564-00976bc79072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:03:07.836883 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12c62f-67c0-41a1-9564-00976bc79072 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:03:07.854610 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 730/1443] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:03:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:03:10.012926 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818909-27eb-49cd-b44b-86a50bbaed2c None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:10.013581 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818909-27eb-49cd-b44b-86a50bbaed2c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:10.013581 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818909-27eb-49cd-b44b-86a50bbaed2c None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:10.014811 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 714/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 07:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:03:10.020051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64957adb-c75e-4d54-bb3d-5af134a7caf8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:10.020474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64957adb-c75e-4d54-bb3d-5af134a7caf8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:10.020583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64957adb-c75e-4d54-bb3d-5af134a7caf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:10.087459 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-64957adb-c75e-4d54-bb3d-5af134a7caf8 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:03:10.088658 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-64957adb-c75e-4d54-bb3d-5af134a7caf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:10.102011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:10.188053 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 731/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 07:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:03:10.227570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818909-27eb-49cd-b44b-86a50bbaed2c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:03:10.229095 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c3818909-27eb-49cd-b44b-86a50bbaed2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:10.335074 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818909-27eb-49cd-b44b-86a50bbaed2c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:03:10.347350 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:10.406388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592c90e-1b21-4632-a9e6-503024b14ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:03:10.406988 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592c90e-1b21-4632-a9e6-503024b14ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:10.407291 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592c90e-1b21-4632-a9e6-503024b14ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:10.407560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592c90e-1b21-4632-a9e6-503024b14ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:10.409140 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6592c90e-1b21-4632-a9e6-503024b14ed6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:10.514166 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592c90e-1b21-4632-a9e6-503024b14ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:03:10.515632 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592c90e-1b21-4632-a9e6-503024b14ed6 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:03:10.536482 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 715/1446] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:03:12.826598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56282b-8828-45bf-827f-4c05e7aa4ade None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:12.827204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56282b-8828-45bf-827f-4c05e7aa4ade None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:12.827204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56282b-8828-45bf-827f-4c05e7aa4ade None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:12.828507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 732/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 07:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:03:12.833780 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f8c03-3c0d-427c-95bd-c00683d8de19 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:12.834213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f8c03-3c0d-427c-95bd-c00683d8de19 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:12.834317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f8c03-3c0d-427c-95bd-c00683d8de19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:12.881104 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:12.898829 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c23f8c03-3c0d-427c-95bd-c00683d8de19 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:03:12.899953 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c23f8c03-3c0d-427c-95bd-c00683d8de19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:12.993851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 716/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 07:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:03:13.034045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56282b-8828-45bf-827f-4c05e7aa4ade None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:03:13.035590 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1c56282b-8828-45bf-827f-4c05e7aa4ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:13.135828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56282b-8828-45bf-827f-4c05e7aa4ade None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:03:13.174284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:13.207949 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489d548-d5c3-4c6c-93f9-7f3c9935a1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:03:13.208570 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489d548-d5c3-4c6c-93f9-7f3c9935a1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:13.208842 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489d548-d5c3-4c6c-93f9-7f3c9935a1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:13.209103 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489d548-d5c3-4c6c-93f9-7f3c9935a1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:13.210652 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5489d548-d5c3-4c6c-93f9-7f3c9935a1e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:13.317010 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489d548-d5c3-4c6c-93f9-7f3c9935a1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:03:13.318477 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489d548-d5c3-4c6c-93f9-7f3c9935a1e1 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:03:13.336454 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 733/1449] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:03:15.482565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff5a82-f4c8-4798-97c3-55384fb1be62 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:15.483173 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff5a82-f4c8-4798-97c3-55384fb1be62 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:15.483173 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff5a82-f4c8-4798-97c3-55384fb1be62 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:15.484467 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 717/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 07:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:03:15.489715 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e1d44-93aa-43aa-b071-78d675c962cf None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:15.490152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e1d44-93aa-43aa-b071-78d675c962cf None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:15.490262 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e1d44-93aa-43aa-b071-78d675c962cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:15.554567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7f7e1d44-93aa-43aa-b071-78d675c962cf None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:03:15.555804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7f7e1d44-93aa-43aa-b071-78d675c962cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:15.577233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:15.653477 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 734/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 07:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:03:15.693102 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff5a82-f4c8-4798-97c3-55384fb1be62 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:03:15.694662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-72ff5a82-f4c8-4798-97c3-55384fb1be62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:15.797347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff5a82-f4c8-4798-97c3-55384fb1be62 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:03:15.819980 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:15.873327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcad22-b148-4824-8313-fdf8d388a242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:03:15.873931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcad22-b148-4824-8313-fdf8d388a242 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:15.874209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcad22-b148-4824-8313-fdf8d388a242 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:15.874589 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcad22-b148-4824-8313-fdf8d388a242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:15.876098 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8cbcad22-b148-4824-8313-fdf8d388a242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:15.982027 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcad22-b148-4824-8313-fdf8d388a242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:03:15.983490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcad22-b148-4824-8313-fdf8d388a242 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:03:16.001826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 718/1452] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:03:18.065121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4c17d-0a40-4866-824a-395deabeede6 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:18.065691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4c17d-0a40-4866-824a-395deabeede6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:18.065691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4c17d-0a40-4866-824a-395deabeede6 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:18.067026 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 735/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 07:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:03:18.072274 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55605af3-40b1-4ad5-b9fc-3080767372fa None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:18.072731 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55605af3-40b1-4ad5-b9fc-3080767372fa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:18.072838 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55605af3-40b1-4ad5-b9fc-3080767372fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:18.134321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:18.137593 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-55605af3-40b1-4ad5-b9fc-3080767372fa None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:03:18.139178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-55605af3-40b1-4ad5-b9fc-3080767372fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:18.233246 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 719/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 07:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:03:18.270824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4c17d-0a40-4866-824a-395deabeede6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:03:18.272376 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d5d4c17d-0a40-4866-824a-395deabeede6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:18.374605 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4c17d-0a40-4866-824a-395deabeede6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:03:18.422352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:18.446248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5c8af-2fc4-47ac-9a0d-b715a060e3d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:03:18.446840 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5c8af-2fc4-47ac-9a0d-b715a060e3d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:18.447139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5c8af-2fc4-47ac-9a0d-b715a060e3d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:18.447408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5c8af-2fc4-47ac-9a0d-b715a060e3d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:18.449402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8bb5c8af-2fc4-47ac-9a0d-b715a060e3d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:18.556335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5c8af-2fc4-47ac-9a0d-b715a060e3d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:03:18.557745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5c8af-2fc4-47ac-9a0d-b715a060e3d4 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:03:18.575930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 736/1455] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:03:20.636696 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a420bb-a46d-4149-a2d7-529e636e8dd5 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:20.637158 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a420bb-a46d-4149-a2d7-529e636e8dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:20.637267 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a420bb-a46d-4149-a2d7-529e636e8dd5 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:20.638604 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 720/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 07:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:03:20.643701 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d605c8-039a-448e-97dc-5eb77006b896 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:20.644084 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d605c8-039a-448e-97dc-5eb77006b896 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:20.644237 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d605c8-039a-448e-97dc-5eb77006b896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:20.708356 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-84d605c8-039a-448e-97dc-5eb77006b896 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:03:20.709567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-84d605c8-039a-448e-97dc-5eb77006b896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:20.738316 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:20.805694 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 737/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 07:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:03:20.845211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a420bb-a46d-4149-a2d7-529e636e8dd5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:03:20.846791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f9a420bb-a46d-4149-a2d7-529e636e8dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:20.949831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a420bb-a46d-4149-a2d7-529e636e8dd5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:03:20.977816 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:21.021504 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965da87f-6fc2-46aa-ab8d-61410c3fa901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:03:21.022102 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965da87f-6fc2-46aa-ab8d-61410c3fa901 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:21.022376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965da87f-6fc2-46aa-ab8d-61410c3fa901 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:21.022653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965da87f-6fc2-46aa-ab8d-61410c3fa901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:21.024264 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-965da87f-6fc2-46aa-ab8d-61410c3fa901 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:21.130548 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965da87f-6fc2-46aa-ab8d-61410c3fa901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:03:21.132006 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965da87f-6fc2-46aa-ab8d-61410c3fa901 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:03:21.150475 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 721/1458] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:03:23.214207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422b2bc-0169-4793-8570-f06a58a4c950 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:23.215503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422b2bc-0169-4793-8570-f06a58a4c950 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:23.215605 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422b2bc-0169-4793-8570-f06a58a4c950 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:23.216948 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 738/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 07:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:03:23.222549 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe5cd4-5816-4f9c-8438-87ff9f69b888 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:23.222944 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe5cd4-5816-4f9c-8438-87ff9f69b888 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:23.223105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe5cd4-5816-4f9c-8438-87ff9f69b888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:23.288225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ebbe5cd4-5816-4f9c-8438-87ff9f69b888 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:03:23.289420 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ebbe5cd4-5816-4f9c-8438-87ff9f69b888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:23.298155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:23.386967 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 722/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 07:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:03:23.424183 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422b2bc-0169-4793-8570-f06a58a4c950 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:03:23.425716 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b422b2bc-0169-4793-8570-f06a58a4c950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:23.530190 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422b2bc-0169-4793-8570-f06a58a4c950 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:03:23.586301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:23.604570 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94dfbb-ee47-4c14-ade1-b43599eab1ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:03:23.605732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94dfbb-ee47-4c14-ade1-b43599eab1ad service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:23.606013 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94dfbb-ee47-4c14-ade1-b43599eab1ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:23.606285 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94dfbb-ee47-4c14-ade1-b43599eab1ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:23.607899 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ac94dfbb-ee47-4c14-ade1-b43599eab1ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:23.716492 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94dfbb-ee47-4c14-ade1-b43599eab1ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:03:23.717904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94dfbb-ee47-4c14-ade1-b43599eab1ad service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:03:23.735336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 739/1461] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:03:25.801394 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a333125-2e2f-4c7c-93fa-217a1a4a2ab2 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:25.801956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a333125-2e2f-4c7c-93fa-217a1a4a2ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:25.801956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a333125-2e2f-4c7c-93fa-217a1a4a2ab2 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:25.803320 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 723/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 07:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:03:25.809149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff06e5-c69f-4a9e-9522-00c45da13cec None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:25.809616 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff06e5-c69f-4a9e-9522-00c45da13cec None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:25.809725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff06e5-c69f-4a9e-9522-00c45da13cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:25.876430 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d5ff06e5-c69f-4a9e-9522-00c45da13cec None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:03:25.877631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d5ff06e5-c69f-4a9e-9522-00c45da13cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:25.914674 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:25.972889 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 740/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 07:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:03:26.010582 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a333125-2e2f-4c7c-93fa-217a1a4a2ab2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:03:26.012806 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8a333125-2e2f-4c7c-93fa-217a1a4a2ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:26.116717 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a333125-2e2f-4c7c-93fa-217a1a4a2ab2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:03:26.155611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:26.190485 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f4ebe-7abf-4baa-bf1e-4d9f30064e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:03:26.191076 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f4ebe-7abf-4baa-bf1e-4d9f30064e94 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:26.191379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f4ebe-7abf-4baa-bf1e-4d9f30064e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:26.191647 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f4ebe-7abf-4baa-bf1e-4d9f30064e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:26.193224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e74f4ebe-7abf-4baa-bf1e-4d9f30064e94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:26.299331 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f4ebe-7abf-4baa-bf1e-4d9f30064e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:03:26.300755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f4ebe-7abf-4baa-bf1e-4d9f30064e94 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:03:26.319454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 724/1464] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:03:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:03:28.352608 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf245d1-4085-43c5-9c2b-2fc70780c21e None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:28.353172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf245d1-4085-43c5-9c2b-2fc70780c21e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:28.353172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf245d1-4085-43c5-9c2b-2fc70780c21e None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:28.354543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 741/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 07:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:03:28.359770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a9d93-7ece-4375-a5e3-7b8388a3cd51 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:28.360225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a9d93-7ece-4375-a5e3-7b8388a3cd51 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:28.360323 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a9d93-7ece-4375-a5e3-7b8388a3cd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:28.424691 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3c1a9d93-7ece-4375-a5e3-7b8388a3cd51 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:03:28.425892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3c1a9d93-7ece-4375-a5e3-7b8388a3cd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:28.443319 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:28.520922 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 725/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 07:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:03:28.557140 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf245d1-4085-43c5-9c2b-2fc70780c21e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:03:28.558873 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3bf245d1-4085-43c5-9c2b-2fc70780c21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:28.661646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf245d1-4085-43c5-9c2b-2fc70780c21e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:03:28.728216 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:28.735417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55067192-05c4-446b-9510-33fb28fd5d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:03:28.736017 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55067192-05c4-446b-9510-33fb28fd5d2c service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:28.736299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55067192-05c4-446b-9510-33fb28fd5d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:28.736567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55067192-05c4-446b-9510-33fb28fd5d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:28.738167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-55067192-05c4-446b-9510-33fb28fd5d2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:28.844733 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55067192-05c4-446b-9510-33fb28fd5d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:03:28.846058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55067192-05c4-446b-9510-33fb28fd5d2c service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:03:28.863965 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 742/1467] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:03:30.864138 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91dd1e-a103-499a-9adb-c9a32eeef66f None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:30.864713 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91dd1e-a103-499a-9adb-c9a32eeef66f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:30.864713 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91dd1e-a103-499a-9adb-c9a32eeef66f None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:30.866093 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 726/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 07:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:03:30.871863 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8e2fe-4ffa-4d7d-adbc-4ae7441d0ad5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:30.872342 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8e2fe-4ffa-4d7d-adbc-4ae7441d0ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:30.872442 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8e2fe-4ffa-4d7d-adbc-4ae7441d0ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:30.937853 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-aff8e2fe-4ffa-4d7d-adbc-4ae7441d0ad5 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:03:30.938971 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-aff8e2fe-4ffa-4d7d-adbc-4ae7441d0ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:30.986100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:31.034664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 743/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 07:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:03:31.071762 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91dd1e-a103-499a-9adb-c9a32eeef66f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:03:31.073325 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9b91dd1e-a103-499a-9adb-c9a32eeef66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:31.175694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91dd1e-a103-499a-9adb-c9a32eeef66f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:03:31.222318 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:31.248837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a9703-1bba-4e70-bc29-fd5edc3fd6b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:03:31.249568 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a9703-1bba-4e70-bc29-fd5edc3fd6b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:31.249856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a9703-1bba-4e70-bc29-fd5edc3fd6b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:31.250124 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a9703-1bba-4e70-bc29-fd5edc3fd6b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:31.251730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-126a9703-1bba-4e70-bc29-fd5edc3fd6b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:31.361806 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a9703-1bba-4e70-bc29-fd5edc3fd6b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:03:31.363254 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a9703-1bba-4e70-bc29-fd5edc3fd6b7 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:03:31.380772 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 727/1470] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:03:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:03:41.032811 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=22 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:41.378603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=66 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:50.978362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbf48a-cee2-411d-9518-7a1aeaaf1788 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:50.978901 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbf48a-cee2-411d-9518-7a1aeaaf1788 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:50.978901 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbf48a-cee2-411d-9518-7a1aeaaf1788 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:50.980927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 744/1471] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:03:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:03:50.986048 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a3c17-538d-40c1-b22e-54bd27b86160 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:50.986526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a3c17-538d-40c1-b22e-54bd27b86160 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:50.986632 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a3c17-538d-40c1-b22e-54bd27b86160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:51.050705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a97a3c17-538d-40c1-b22e-54bd27b86160 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:03:51.051931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a97a3c17-538d-40c1-b22e-54bd27b86160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:51.148921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 728/1472] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:03:51.232425 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25e980-7e8c-4e69-b187-b8a58a20b61f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:51.232668 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25e980-7e8c-4e69-b187-b8a58a20b61f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:51.232935 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25e980-7e8c-4e69-b187-b8a58a20b61f None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:51.234250 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 745/1473] 10.222.0.40 () {54 vars in 967 bytes} [Tue Aug 9 07:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:03:51.238976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a0dbe-3286-4dd9-95ce-f937822445b7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:51.239289 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a0dbe-3286-4dd9-95ce-f937822445b7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:51.239561 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a0dbe-3286-4dd9-95ce-f937822445b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:51.313597 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f67a0dbe-3286-4dd9-95ce-f937822445b7 None None] MFA Rules not processed for user `e44c764958784616b8bdbf59e5692ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:03:51.314830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f67a0dbe-3286-4dd9-95ce-f937822445b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:51.335072 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:51.389622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 729/1474] 10.222.0.40 () {58 vars in 1064 bytes} [Tue Aug 9 07:03:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:03:51.397125 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25e980-7e8c-4e69-b187-b8a58a20b61f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:03:51.398595 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9f25e980-7e8c-4e69-b187-b8a58a20b61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:51.499290 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25e980-7e8c-4e69-b187-b8a58a20b61f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:03:51.570647 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca02a9a-d403-443a-88a5-1d05038b863c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44c764958784616b8bdbf59e5692ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:03:51.571611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02a9a-d403-443a-88a5-1d05038b863c service glance] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:51.572077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02a9a-d403-443a-88a5-1d05038b863c service glance] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:51.572476 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02a9a-d403-443a-88a5-1d05038b863c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:51.575348 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cca02a9a-d403-443a-88a5-1d05038b863c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:51.629680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:51.685581 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca02a9a-d403-443a-88a5-1d05038b863c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:03:51.687007 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca02a9a-d403-443a-88a5-1d05038b863c service glance] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:03:51.705339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 746/1475] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:03:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:03:53.782228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f6303-1df9-46fd-bff5-4de161290586 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:53.782788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f6303-1df9-46fd-bff5-4de161290586 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:53.782788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f6303-1df9-46fd-bff5-4de161290586 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:53.784142 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 730/1476] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:03:53.789247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406476d3-3d01-4da6-9013-6f4731ddb67a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:53.789674 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406476d3-3d01-4da6-9013-6f4731ddb67a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:53.789784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406476d3-3d01-4da6-9013-6f4731ddb67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:53.855675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-406476d3-3d01-4da6-9013-6f4731ddb67a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:03:53.856906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-406476d3-3d01-4da6-9013-6f4731ddb67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:53.953493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 747/1477] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:03:53.981593 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f6303-1df9-46fd-bff5-4de161290586 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:03:53.983158 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-543f6303-1df9-46fd-bff5-4de161290586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:54.106056 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f6303-1df9-46fd-bff5-4de161290586 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:03:54.153541 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:54.201429 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9335a-3d09-416c-80c8-3266bae5e979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:03:54.202029 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9335a-3d09-416c-80c8-3266bae5e979 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:54.202303 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9335a-3d09-416c-80c8-3266bae5e979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:54.202571 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9335a-3d09-416c-80c8-3266bae5e979 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:54.203234 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd9335a-3d09-416c-80c8-3266bae5e979 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:03:54.205005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-ebd9335a-3d09-416c-80c8-3266bae5e979 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 07:03:54.205005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: warnings.warn(msg) Aug 09 07:03:54.205005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: Aug 09 07:03:54.206070 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd9335a-3d09-416c-80c8-3266bae5e979 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:03:54.224764 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 731/1478] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Aug 9 07:03:53 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:03:56.240082 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eb375-c6ee-475e-9445-9dbc9224dc87 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:56.240474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eb375-c6ee-475e-9445-9dbc9224dc87 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:56.240474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eb375-c6ee-475e-9445-9dbc9224dc87 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:56.241775 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 748/1479] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:03:56.247035 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88d2e8-5354-4551-9fb8-37e7e5ad9b24 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:56.247489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88d2e8-5354-4551-9fb8-37e7e5ad9b24 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:56.247600 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88d2e8-5354-4551-9fb8-37e7e5ad9b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:56.314690 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ba88d2e8-5354-4551-9fb8-37e7e5ad9b24 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:03:56.315933 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ba88d2e8-5354-4551-9fb8-37e7e5ad9b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:56.410015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 732/1480] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:03:56.455120 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7eb375-c6ee-475e-9445-9dbc9224dc87 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:03:56.456561 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1f7eb375-c6ee-475e-9445-9dbc9224dc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:56.466994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:56.603182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7eb375-c6ee-475e-9445-9dbc9224dc87 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:03:56.683268 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:56.724604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337f9ab-0baa-4416-b519-6c92ecf5fada service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:03:56.730092 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337f9ab-0baa-4416-b519-6c92ecf5fada service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:56.730383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337f9ab-0baa-4416-b519-6c92ecf5fada service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:56.730662 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337f9ab-0baa-4416-b519-6c92ecf5fada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:56.732322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0337f9ab-0baa-4416-b519-6c92ecf5fada service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:56.827142 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337f9ab-0baa-4416-b519-6c92ecf5fada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:03:56.828719 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337f9ab-0baa-4416-b519-6c92ecf5fada service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:03:56.846111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 749/1481] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:03:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:03:59.012805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7decb-fccc-4da3-8dfc-e7882aff42af None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:59.013377 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7decb-fccc-4da3-8dfc-e7882aff42af None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:59.013377 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7decb-fccc-4da3-8dfc-e7882aff42af None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:59.014672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 733/1482] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:03:59.019847 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82145b-8c7b-4f50-9d14-fbf8a9ccbe85 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:59.020263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82145b-8c7b-4f50-9d14-fbf8a9ccbe85 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:59.020378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82145b-8c7b-4f50-9d14-fbf8a9ccbe85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:59.086281 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ac82145b-8c7b-4f50-9d14-fbf8a9ccbe85 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:03:59.087494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ac82145b-8c7b-4f50-9d14-fbf8a9ccbe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:59.132144 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:59.181322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 750/1483] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:03:59.218152 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7decb-fccc-4da3-8dfc-e7882aff42af None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:03:59.219681 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-12d7decb-fccc-4da3-8dfc-e7882aff42af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:59.242095 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:59.322264 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7decb-fccc-4da3-8dfc-e7882aff42af None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:03:59.393317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903bc29-c60b-4c85-a0e8-a9662fa30779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:03:59.393913 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903bc29-c60b-4c85-a0e8-a9662fa30779 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:03:59.394185 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903bc29-c60b-4c85-a0e8-a9662fa30779 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:03:59.394451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903bc29-c60b-4c85-a0e8-a9662fa30779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:03:59.396062 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3903bc29-c60b-4c85-a0e8-a9662fa30779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:03:59.468527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:59.503015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903bc29-c60b-4c85-a0e8-a9662fa30779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:03:59.504456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903bc29-c60b-4c85-a0e8-a9662fa30779 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:03:59.522938 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 734/1484] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:03:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:04:01.615407 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420e4a9-5c21-4ea8-a9c7-47f0f6393d22 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:04:01.615977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420e4a9-5c21-4ea8-a9c7-47f0f6393d22 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:04:01.615977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420e4a9-5c21-4ea8-a9c7-47f0f6393d22 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:04:01.617293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 751/1485] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:04:01.623704 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c95bf-41fc-4592-a5ec-cd07a454be34 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:04:01.624132 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c95bf-41fc-4592-a5ec-cd07a454be34 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:04:01.624242 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c95bf-41fc-4592-a5ec-cd07a454be34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:04:01.688742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9e4c95bf-41fc-4592-a5ec-cd07a454be34 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:04:01.689969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9e4c95bf-41fc-4592-a5ec-cd07a454be34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:04:01.785558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 735/1486] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:04:01.823715 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420e4a9-5c21-4ea8-a9c7-47f0f6393d22 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:04:01.825494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0420e4a9-5c21-4ea8-a9c7-47f0f6393d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:04:01.929928 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420e4a9-5c21-4ea8-a9c7-47f0f6393d22 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:04:02.004415 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:02.006614 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f09e1-e231-470d-8fb8-ed465ee7b3dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:04:02.007490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f09e1-e231-470d-8fb8-ed465ee7b3dc service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:04:02.007984 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f09e1-e231-470d-8fb8-ed465ee7b3dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:04:02.008299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f09e1-e231-470d-8fb8-ed465ee7b3dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:04:02.010125 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9f3f09e1-e231-470d-8fb8-ed465ee7b3dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:04:02.133037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f09e1-e231-470d-8fb8-ed465ee7b3dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:04:02.135705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f09e1-e231-470d-8fb8-ed465ee7b3dc service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:04:02.161272 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 752/1487] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:04:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:04:04.341019 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2634bca-b3eb-4cfc-9863-969d636fb22d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:04:04.341546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2634bca-b3eb-4cfc-9863-969d636fb22d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:04:04.341546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2634bca-b3eb-4cfc-9863-969d636fb22d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:04:04.342912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 736/1488] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:04:04.348215 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75589262-da3c-49bf-a0b2-b2ed0a413be9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:04:04.348627 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75589262-da3c-49bf-a0b2-b2ed0a413be9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:04:04.348744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75589262-da3c-49bf-a0b2-b2ed0a413be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:04:04.412684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-75589262-da3c-49bf-a0b2-b2ed0a413be9 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:04:04.413859 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-75589262-da3c-49bf-a0b2-b2ed0a413be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:04:04.465597 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:04.509688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 753/1489] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:04:04.549876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2634bca-b3eb-4cfc-9863-969d636fb22d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:04:04.551479 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b2634bca-b3eb-4cfc-9863-969d636fb22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:04:04.587240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:04.656257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2634bca-b3eb-4cfc-9863-969d636fb22d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:04:04.727010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3af07-208c-47fd-b6b6-cbe9cb294224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:04:04.727637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3af07-208c-47fd-b6b6-cbe9cb294224 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:04:04.727913 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3af07-208c-47fd-b6b6-cbe9cb294224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:04:04.728182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3af07-208c-47fd-b6b6-cbe9cb294224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:04:04.730420 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6db3af07-208c-47fd-b6b6-cbe9cb294224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:04:04.808347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:04.838159 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3af07-208c-47fd-b6b6-cbe9cb294224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:04:04.840576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3af07-208c-47fd-b6b6-cbe9cb294224 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:04:04.859483 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 737/1490] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:04:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:04:07.049679 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e670c9-266a-4d91-b70b-34a628aec5aa None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:04:07.050139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e670c9-266a-4d91-b70b-34a628aec5aa None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:04:07.050233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e670c9-266a-4d91-b70b-34a628aec5aa None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:04:07.051660 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 754/1491] 10.222.0.40 () {54 vars in 927 bytes} [Tue Aug 9 07:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:04:07.056827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19781d7e-bfdd-4b9f-94cb-07e56e1bfa0b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:04:07.057790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19781d7e-bfdd-4b9f-94cb-07e56e1bfa0b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:04:07.057938 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19781d7e-bfdd-4b9f-94cb-07e56e1bfa0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:04:07.123043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-19781d7e-bfdd-4b9f-94cb-07e56e1bfa0b None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:04:07.124262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-19781d7e-bfdd-4b9f-94cb-07e56e1bfa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:04:07.219788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 738/1492] 10.222.0.40 () {58 vars in 1024 bytes} [Tue Aug 9 07:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:04:07.259065 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e670c9-266a-4d91-b70b-34a628aec5aa None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:04:07.261521 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-57e670c9-266a-4d91-b70b-34a628aec5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:04:07.363365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e670c9-266a-4d91-b70b-34a628aec5aa None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:04:07.434350 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283589a-c8ee-409c-9acb-2b00afacd616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:04:07.439369 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283589a-c8ee-409c-9acb-2b00afacd616 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:04:07.439369 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283589a-c8ee-409c-9acb-2b00afacd616 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:04:07.439369 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283589a-c8ee-409c-9acb-2b00afacd616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:04:07.441375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7283589a-c8ee-409c-9acb-2b00afacd616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:04:07.452133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:07.560260 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283589a-c8ee-409c-9acb-2b00afacd616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:04:07.561617 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283589a-c8ee-409c-9acb-2b00afacd616 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:04:07.579245 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 755/1493] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:04:17.217958 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=82 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:17.577034 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=50 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:17.534147 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddbe2c-25cf-49bd-8c6b-d96908de47d8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:05:17.534754 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddbe2c-25cf-49bd-8c6b-d96908de47d8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:05:17.534754 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddbe2c-25cf-49bd-8c6b-d96908de47d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:05:17.609352 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0eddbe2c-25cf-49bd-8c6b-d96908de47d8 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:05:17.610544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0eddbe2c-25cf-49bd-8c6b-d96908de47d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:05:17.709452 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 739/1494] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:05:17.718103 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f70ac-8dd7-4745-8339-7fd992f2cbcd None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:05:17.718611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f70ac-8dd7-4745-8339-7fd992f2cbcd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:05:17.718720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f70ac-8dd7-4745-8339-7fd992f2cbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:05:17.792326 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2d0f70ac-8dd7-4745-8339-7fd992f2cbcd None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:05:17.793541 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2d0f70ac-8dd7-4745-8339-7fd992f2cbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:05:17.887695 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 756/1495] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:05:17.892346 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddbe2c-25cf-49bd-8c6b-d96908de47d8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:05:17.893559 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0eddbe2c-25cf-49bd-8c6b-d96908de47d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:05:17.910783 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddbe2c-25cf-49bd-8c6b-d96908de47d8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:05:17.970480 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:18.004990 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295ebcf-f21d-42d8-8dd7-881f48426e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:05:18.005594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295ebcf-f21d-42d8-8dd7-881f48426e4a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:05:18.005869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295ebcf-f21d-42d8-8dd7-881f48426e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:05:18.006139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295ebcf-f21d-42d8-8dd7-881f48426e4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:05:18.006866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295ebcf-f21d-42d8-8dd7-881f48426e4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:05:18.007187 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295ebcf-f21d-42d8-8dd7-881f48426e4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:05:18.008194 dv-cinder-852514-1-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-3295ebcf-f21d-42d8-8dd7-881f48426e4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 07:05:18.008194 dv-cinder-852514-1-smb devstack@keystone.service[80234]: warnings.warn(msg) Aug 09 07:05:18.008194 dv-cinder-852514-1-smb devstack@keystone.service[80234]: Aug 09 07:05:18.009067 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295ebcf-f21d-42d8-8dd7-881f48426e4a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:05:18.020364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 740/1496] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:05:18.028823 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f70ac-8dd7-4745-8339-7fd992f2cbcd None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:05:18.037751 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f70ac-8dd7-4745-8339-7fd992f2cbcd None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:05:18.098062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:18.132300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d44bda-663b-49c2-beaa-605e73c18bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:05:18.132904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d44bda-663b-49c2-beaa-605e73c18bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:05:18.133182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d44bda-663b-49c2-beaa-605e73c18bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:05:18.133450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d44bda-663b-49c2-beaa-605e73c18bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:05:18.134073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d44bda-663b-49c2-beaa-605e73c18bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:05:18.136162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-85d44bda-663b-49c2-beaa-605e73c18bb3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 07:05:18.136162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: warnings.warn(msg) Aug 09 07:05:18.136162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: Aug 09 07:05:18.137354 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d44bda-663b-49c2-beaa-605e73c18bb3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:05:18.192410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 757/1497] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:05:18 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:05:18.196661 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295ebcf-f21d-42d8-8dd7-881f48426e4a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:05:18.198403 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3295ebcf-f21d-42d8-8dd7-881f48426e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:05:18.231104 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295ebcf-f21d-42d8-8dd7-881f48426e4a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:05:18.322006 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d8aa7-2b2d-45b9-bd0a-a5bd21b6ef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:05:18.322635 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d8aa7-2b2d-45b9-bd0a-a5bd21b6ef19 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:05:18.323055 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d8aa7-2b2d-45b9-bd0a-a5bd21b6ef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:05:18.323352 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d8aa7-2b2d-45b9-bd0a-a5bd21b6ef19 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:05:18.323968 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d8aa7-2b2d-45b9-bd0a-a5bd21b6ef19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:05:18.324962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-b83d8aa7-2b2d-45b9-bd0a-a5bd21b6ef19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 07:05:18.324962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: warnings.warn(msg) Aug 09 07:05:18.324962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: Aug 09 07:05:18.326394 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d8aa7-2b2d-45b9-bd0a-a5bd21b6ef19 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:05:18.368570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 741/1498] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:05:18 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:05:18.372669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d44bda-663b-49c2-beaa-605e73c18bb3 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:05:18.374199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-85d44bda-663b-49c2-beaa-605e73c18bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:05:18.437097 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d44bda-663b-49c2-beaa-605e73c18bb3 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:05:18.519243 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:18.531875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25f1fa-1ae9-462b-abac-3d9dbe7c4b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:05:18.532478 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25f1fa-1ae9-462b-abac-3d9dbe7c4b12 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:05:18.532756 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25f1fa-1ae9-462b-abac-3d9dbe7c4b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:05:18.533022 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25f1fa-1ae9-462b-abac-3d9dbe7c4b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:05:18.533689 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25f1fa-1ae9-462b-abac-3d9dbe7c4b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:05:18.534682 dv-cinder-852514-1-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-ca25f1fa-1ae9-462b-abac-3d9dbe7c4b12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 07:05:18.534682 dv-cinder-852514-1-smb devstack@keystone.service[80233]: warnings.warn(msg) Aug 09 07:05:18.534682 dv-cinder-852514-1-smb devstack@keystone.service[80233]: Aug 09 07:05:18.535582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25f1fa-1ae9-462b-abac-3d9dbe7c4b12 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:05:18.548450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 758/1499] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:05:18.552466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d8aa7-2b2d-45b9-bd0a-a5bd21b6ef19 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:05:18.554012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b83d8aa7-2b2d-45b9-bd0a-a5bd21b6ef19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:05:18.565120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d8aa7-2b2d-45b9-bd0a-a5bd21b6ef19 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:05:18.590540 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:18.660869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799c76a-9f86-4c9b-9b38-e0685a78e959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:05:18.661469 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799c76a-9f86-4c9b-9b38-e0685a78e959 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:05:18.661740 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799c76a-9f86-4c9b-9b38-e0685a78e959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:05:18.662001 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799c76a-9f86-4c9b-9b38-e0685a78e959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:05:18.662628 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799c76a-9f86-4c9b-9b38-e0685a78e959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:05:18.663655 dv-cinder-852514-1-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-b799c76a-9f86-4c9b-9b38-e0685a78e959 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 07:05:18.663655 dv-cinder-852514-1-smb devstack@keystone.service[80234]: warnings.warn(msg) Aug 09 07:05:18.663655 dv-cinder-852514-1-smb devstack@keystone.service[80234]: Aug 09 07:05:18.664530 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799c76a-9f86-4c9b-9b38-e0685a78e959 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:05:18.677082 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 742/1500] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:05:18.681339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25f1fa-1ae9-462b-abac-3d9dbe7c4b12 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:05:18.682834 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ca25f1fa-1ae9-462b-abac-3d9dbe7c4b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:05:18.715746 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25f1fa-1ae9-462b-abac-3d9dbe7c4b12 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:05:18.806955 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019b8d6-740f-4973-826f-b573d9dd43a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:05:18.807672 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019b8d6-740f-4973-826f-b573d9dd43a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:05:18.807904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019b8d6-740f-4973-826f-b573d9dd43a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:05:18.808175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019b8d6-740f-4973-826f-b573d9dd43a1 admin admin] PATH_INFO: `/v3/projects/5898fb80ab45496380319db1fbc793c1/users/46ae3426cc41411fb5613ad760d94ef4/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:05:18.829464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019b8d6-740f-4973-826f-b573d9dd43a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5898fb80ab45496380319db1fbc793c1, user_id=46ae3426cc41411fb5613ad760d94ef4, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:05:18.830470 dv-cinder-852514-1-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-6019b8d6-740f-4973-826f-b573d9dd43a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 07:05:18.830470 dv-cinder-852514-1-smb devstack@keystone.service[80233]: warnings.warn(msg) Aug 09 07:05:18.830470 dv-cinder-852514-1-smb devstack@keystone.service[80233]: Aug 09 07:05:18.832433 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019b8d6-740f-4973-826f-b573d9dd43a1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:05:18.857153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 759/1501] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:05:18 2022] PUT /identity/v3/projects/5898fb80ab45496380319db1fbc793c1/users/46ae3426cc41411fb5613ad760d94ef4/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:05:18.869378 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb6937-20d7-4988-9531-f200127305c6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:05:18.869657 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb6937-20d7-4988-9531-f200127305c6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:05:18.869925 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb6937-20d7-4988-9531-f200127305c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:05:18.924577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9edb6937-20d7-4988-9531-f200127305c6 None None] MFA Rules not processed for user `46ae3426cc41411fb5613ad760d94ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:05:18.925688 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9edb6937-20d7-4988-9531-f200127305c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:05:19.001545 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 743/1502] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:05:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:05:19.014743 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4d1b6-40f4-41e6-aa60-58619f0b74a7 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:05:19.015029 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4d1b6-40f4-41e6-aa60-58619f0b74a7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:05:19.015335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4d1b6-40f4-41e6-aa60-58619f0b74a7 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:05:19.016667 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 760/1503] 10.222.0.40 () {54 vars in 964 bytes} [Tue Aug 9 07:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:05:19.021408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd418b69-ea31-464e-a13e-2db4f7d4cee5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:05:19.021706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd418b69-ea31-464e-a13e-2db4f7d4cee5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:05:19.021973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd418b69-ea31-464e-a13e-2db4f7d4cee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:05:19.053286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:19.097672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bd418b69-ea31-464e-a13e-2db4f7d4cee5 None None] MFA Rules not processed for user `8977d7479b3e405c976fa1a570987704`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:05:19.098867 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bd418b69-ea31-464e-a13e-2db4f7d4cee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:05:19.174222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 744/1504] 10.222.0.40 () {58 vars in 1061 bytes} [Tue Aug 9 07:05:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:05:19.181994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4d1b6-40f4-41e6-aa60-58619f0b74a7 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:05:19.184184 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5aa4d1b6-40f4-41e6-aa60-58619f0b74a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:05:19.232817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:19.285602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4d1b6-40f4-41e6-aa60-58619f0b74a7 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:05:19.357595 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5690826-fb85-41c7-9582-481e89abc1ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:05:19.358190 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5690826-fb85-41c7-9582-481e89abc1ee service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:05:19.358464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5690826-fb85-41c7-9582-481e89abc1ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:05:19.358732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5690826-fb85-41c7-9582-481e89abc1ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:05:19.360324 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c5690826-fb85-41c7-9582-481e89abc1ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:05:19.456648 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5690826-fb85-41c7-9582-481e89abc1ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:05:19.457977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5690826-fb85-41c7-9582-481e89abc1ee service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:05:19.461323 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:19.476213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 761/1505] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:05:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:05:19.520762 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c72980-764c-4f3e-ab62-c85057cfee64 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:05:19.521046 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c72980-764c-4f3e-ab62-c85057cfee64 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:05:19.521343 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c72980-764c-4f3e-ab62-c85057cfee64 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:05:19.522699 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 745/1506] 10.222.0.40 () {52 vars in 830 bytes} [Tue Aug 9 07:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 07:05:19.526201 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5690826-fb85-41c7-9582-481e89abc1ee service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:05:19.528039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c5690826-fb85-41c7-9582-481e89abc1ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:05:19.627287 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5690826-fb85-41c7-9582-481e89abc1ee service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:05:19.720161 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194e886-2441-4a37-b5aa-621d9c3a3710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:05:19.720784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194e886-2441-4a37-b5aa-621d9c3a3710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:05:19.721066 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194e886-2441-4a37-b5aa-621d9c3a3710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:05:19.721336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194e886-2441-4a37-b5aa-621d9c3a3710 admin admin] PATH_INFO: `/v3/users/46ae3426cc41411fb5613ad760d94ef4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:05:19.733772 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194e886-2441-4a37-b5aa-621d9c3a3710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ae3426cc41411fb5613ad760d94ef4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:05:19.734781 dv-cinder-852514-1-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-6194e886-2441-4a37-b5aa-621d9c3a3710 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 07:05:19.734781 dv-cinder-852514-1-smb devstack@keystone.service[80233]: warnings.warn(msg) Aug 09 07:05:19.734781 dv-cinder-852514-1-smb devstack@keystone.service[80233]: Aug 09 07:05:19.736019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194e886-2441-4a37-b5aa-621d9c3a3710 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:05:19.745593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:19.801626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6194e886-2441-4a37-b5aa-621d9c3a3710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ae3426cc41411fb5613ad760d94ef4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:05:19.812111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6194e886-2441-4a37-b5aa-621d9c3a3710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ae3426cc41411fb5613ad760d94ef4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:05:19.812677 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6194e886-2441-4a37-b5aa-621d9c3a3710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ae3426cc41411fb5613ad760d94ef4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:05:19.834937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6194e886-2441-4a37-b5aa-621d9c3a3710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ae3426cc41411fb5613ad760d94ef4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:05:19.848763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6194e886-2441-4a37-b5aa-621d9c3a3710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ae3426cc41411fb5613ad760d94ef4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:05:19.854303 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 762/1507] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:05:19 2022] DELETE /identity/v3/users/46ae3426cc41411fb5613ad760d94ef4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:05:19.859270 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40973f21-6848-4860-ab25-4d493d7a4fa8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:05:19.859741 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40973f21-6848-4860-ab25-4d493d7a4fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:05:19.859848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40973f21-6848-4860-ab25-4d493d7a4fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:05:19.915364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-40973f21-6848-4860-ab25-4d493d7a4fa8 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:05:19.916561 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-40973f21-6848-4860-ab25-4d493d7a4fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:05:19.991629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:20.005256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 746/1508] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:05:20.015989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194e886-2441-4a37-b5aa-621d9c3a3710 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:05:20.017220 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6194e886-2441-4a37-b5aa-621d9c3a3710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:05:20.114762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194e886-2441-4a37-b5aa-621d9c3a3710 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:05:20.169209 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:20.189390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558a5ad-4db9-41fb-80a4-b1ff32c75628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:05:20.189989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558a5ad-4db9-41fb-80a4-b1ff32c75628 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:05:20.190265 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558a5ad-4db9-41fb-80a4-b1ff32c75628 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:05:20.190530 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558a5ad-4db9-41fb-80a4-b1ff32c75628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:05:20.192123 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6558a5ad-4db9-41fb-80a4-b1ff32c75628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:05:20.299816 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558a5ad-4db9-41fb-80a4-b1ff32c75628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:05:20.301271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558a5ad-4db9-41fb-80a4-b1ff32c75628 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:05:20.321852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 763/1509] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:05:20.675901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40973f21-6848-4860-ab25-4d493d7a4fa8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:05:20.677147 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-40973f21-6848-4860-ab25-4d493d7a4fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:05:20.689537 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40973f21-6848-4860-ab25-4d493d7a4fa8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:05:20.791548 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19711d-2566-402d-a42c-dcab2b982948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:05:20.792178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19711d-2566-402d-a42c-dcab2b982948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:05:20.792451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19711d-2566-402d-a42c-dcab2b982948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:05:20.793773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19711d-2566-402d-a42c-dcab2b982948 admin admin] PATH_INFO: `/v3/projects/5898fb80ab45496380319db1fbc793c1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:05:20.803341 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19711d-2566-402d-a42c-dcab2b982948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5898fb80ab45496380319db1fbc793c1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:05:20.804305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-bb19711d-2566-402d-a42c-dcab2b982948 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 07:05:20.804305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: warnings.warn(msg) Aug 09 07:05:20.804305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: Aug 09 07:05:20.805491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19711d-2566-402d-a42c-dcab2b982948 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:05:20.864286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bb19711d-2566-402d-a42c-dcab2b982948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5898fb80ab45496380319db1fbc793c1', 'request_id': 'req-bb19711d-2566-402d-a42c-dcab2b982948'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:05:20.877133 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bb19711d-2566-402d-a42c-dcab2b982948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5898fb80ab45496380319db1fbc793c1', 'request_id': 'req-bb19711d-2566-402d-a42c-dcab2b982948'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:05:20.883048 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bb19711d-2566-402d-a42c-dcab2b982948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5898fb80ab45496380319db1fbc793c1', 'request_id': 'req-bb19711d-2566-402d-a42c-dcab2b982948'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:05:20.909165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bb19711d-2566-402d-a42c-dcab2b982948 admin admin] The token cache is being invalidate because project 5898fb80ab45496380319db1fbc793c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:05:20.909457 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bb19711d-2566-402d-a42c-dcab2b982948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:05:20.909907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bb19711d-2566-402d-a42c-dcab2b982948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:05:20.911349 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 747/1510] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:05:20 2022] DELETE /identity/v3/projects/5898fb80ab45496380319db1fbc793c1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:05:30.319047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=62 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:30.907174 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:06:52.533104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a419b5a-87db-4e4a-b8ad-3bd77490cde3 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:06:52.533698 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a419b5a-87db-4e4a-b8ad-3bd77490cde3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:06:52.533698 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a419b5a-87db-4e4a-b8ad-3bd77490cde3 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:06:52.534980 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 764/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 07:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:06:52.539717 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a6c70-ad34-4d39-ba9c-f9d92ca9e0bb None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:06:52.540179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a6c70-ad34-4d39-ba9c-f9d92ca9e0bb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:06:52.540285 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a6c70-ad34-4d39-ba9c-f9d92ca9e0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:06:52.618400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-311a6c70-ad34-4d39-ba9c-f9d92ca9e0bb None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:06:52.619545 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-311a6c70-ad34-4d39-ba9c-f9d92ca9e0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:06:52.729705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 748/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 07:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:06:52.882289 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a419b5a-87db-4e4a-b8ad-3bd77490cde3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:06:52.884486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8a419b5a-87db-4e4a-b8ad-3bd77490cde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:06:53.001015 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a419b5a-87db-4e4a-b8ad-3bd77490cde3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:06:53.006408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ad518-337c-4482-b8dd-b5c8fb1fa136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:06:53.007011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ad518-337c-4482-b8dd-b5c8fb1fa136 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:06:53.007319 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ad518-337c-4482-b8dd-b5c8fb1fa136 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:06:53.007588 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ad518-337c-4482-b8dd-b5c8fb1fa136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:06:53.015487 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ad518-337c-4482-b8dd-b5c8fb1fa136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:06:53.017042 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ad518-337c-4482-b8dd-b5c8fb1fa136 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:06:53.026036 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 765/1513] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:06:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:06:53.857443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0648b-c916-4496-bb85-5509f5f25321 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:06:53.858025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0648b-c916-4496-bb85-5509f5f25321 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:06:53.858135 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0648b-c916-4496-bb85-5509f5f25321 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:06:53.859548 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 749/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 07:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:06:53.864430 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47557764-f526-4de9-9fe5-cc372d7ee150 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:06:53.864845 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47557764-f526-4de9-9fe5-cc372d7ee150 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:06:53.864964 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47557764-f526-4de9-9fe5-cc372d7ee150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:06:53.889505 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-47557764-f526-4de9-9fe5-cc372d7ee150 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:06:53.890618 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-47557764-f526-4de9-9fe5-cc372d7ee150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:06:53.898562 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 766/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 07:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:06:54.051645 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0648b-c916-4496-bb85-5509f5f25321 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:06:54.066071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0648b-c916-4496-bb85-5509f5f25321 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:06:54.071469 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13729cc-a1a7-44c6-b951-8f138d294aff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:06:54.072059 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13729cc-a1a7-44c6-b951-8f138d294aff service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:06:54.072331 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13729cc-a1a7-44c6-b951-8f138d294aff service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:06:54.072599 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13729cc-a1a7-44c6-b951-8f138d294aff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:06:54.080707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13729cc-a1a7-44c6-b951-8f138d294aff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:06:54.082279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13729cc-a1a7-44c6-b951-8f138d294aff service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:06:54.091504 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 750/1516] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:06:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:06:54.524468 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a35bf3-01dd-47f7-bc7f-8e15b16d351f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:06:54.524755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a35bf3-01dd-47f7-bc7f-8e15b16d351f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:06:54.525031 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a35bf3-01dd-47f7-bc7f-8e15b16d351f None None] PATH_INFO: `/v3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:06:54.526311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 767/1517] 10.222.0.25 () {54 vars in 925 bytes} [Tue Aug 9 07:06:54 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:06:54.532811 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a39cfd-3047-4003-b789-f88e516d6575 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:06:54.533093 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a39cfd-3047-4003-b789-f88e516d6575 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:06:54.533388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a39cfd-3047-4003-b789-f88e516d6575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:06:54.592042 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-31a39cfd-3047-4003-b789-f88e516d6575 None None] MFA Rules not processed for user `07d2ee351e734fd09938cea9be3bb08a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:06:54.593169 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-31a39cfd-3047-4003-b789-f88e516d6575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:06:54.610500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:06:54.665581 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 751/1518] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Aug 9 07:06:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:07:03.884564 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=56 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:07:03.965396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a048f5-0123-4210-84b2-7001a23152ad None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:03.965674 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a048f5-0123-4210-84b2-7001a23152ad None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:03.965944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a048f5-0123-4210-84b2-7001a23152ad None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:03.967925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 768/1519] 10.222.0.40 () {54 vars in 961 bytes} [Tue Aug 9 07:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:07:03.973073 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb8f12-4d63-4e6e-972e-368886cf97f0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:03.973512 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb8f12-4d63-4e6e-972e-368886cf97f0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:03.973620 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb8f12-4d63-4e6e-972e-368886cf97f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:03.992570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3fbb8f12-4d63-4e6e-972e-368886cf97f0 None None] MFA Rules not processed for user `07d2ee351e734fd09938cea9be3bb08a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:07:03.993755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3fbb8f12-4d63-4e6e-972e-368886cf97f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:07:04.002272 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 752/1520] 10.222.0.40 () {58 vars in 1058 bytes} [Tue Aug 9 07:07:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:07:04.009492 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a048f5-0123-4210-84b2-7001a23152ad None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:07:04.022943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a048f5-0123-4210-84b2-7001a23152ad None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:07:04.027855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cd9c5-3d72-4c68-b47f-206003a3e559 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07d2ee351e734fd09938cea9be3bb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:07:04.028437 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cd9c5-3d72-4c68-b47f-206003a3e559 service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:04.028720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cd9c5-3d72-4c68-b47f-206003a3e559 service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:04.029585 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cd9c5-3d72-4c68-b47f-206003a3e559 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:04.037636 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cd9c5-3d72-4c68-b47f-206003a3e559 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:07:04.039242 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cd9c5-3d72-4c68-b47f-206003a3e559 service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:07:04.049298 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 769/1521] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:07:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:07:05.327846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933e4dc-1475-4172-b62e-a1d4635efc10 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:05.328414 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933e4dc-1475-4172-b62e-a1d4635efc10 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:05.328414 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933e4dc-1475-4172-b62e-a1d4635efc10 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:05.329732 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 753/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 07:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:07:05.334475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabbfe6-9365-4050-bb9a-e0ce25ceb722 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:05.334892 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabbfe6-9365-4050-bb9a-e0ce25ceb722 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:05.335059 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabbfe6-9365-4050-bb9a-e0ce25ceb722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:05.354795 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7cabbfe6-9365-4050-bb9a-e0ce25ceb722 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:07:05.356027 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7cabbfe6-9365-4050-bb9a-e0ce25ceb722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:07:05.363759 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 770/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 07:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:07:05.523754 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933e4dc-1475-4172-b62e-a1d4635efc10 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:07:05.538819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933e4dc-1475-4172-b62e-a1d4635efc10 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:07:05.544320 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b133fd3-2d38-48aa-88b4-c104c1e6d7f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:07:05.544914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b133fd3-2d38-48aa-88b4-c104c1e6d7f2 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:05.545189 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b133fd3-2d38-48aa-88b4-c104c1e6d7f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:05.545463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b133fd3-2d38-48aa-88b4-c104c1e6d7f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:05.553401 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b133fd3-2d38-48aa-88b4-c104c1e6d7f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:07:05.554967 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b133fd3-2d38-48aa-88b4-c104c1e6d7f2 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:07:05.564229 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 754/1524] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:07:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:07:06.423301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c7046-ed2a-45a4-b82b-9e21d8448f76 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:06.423883 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c7046-ed2a-45a4-b82b-9e21d8448f76 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:06.423883 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c7046-ed2a-45a4-b82b-9e21d8448f76 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:06.425200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 771/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 07:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:07:06.430009 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23a3c2-3510-4746-8ce2-374100af0ded None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:06.430428 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23a3c2-3510-4746-8ce2-374100af0ded None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:06.430551 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23a3c2-3510-4746-8ce2-374100af0ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:06.452524 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5d23a3c2-3510-4746-8ce2-374100af0ded None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:07:06.453722 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5d23a3c2-3510-4746-8ce2-374100af0ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:07:06.461527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 755/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 07:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:07:06.614067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c7046-ed2a-45a4-b82b-9e21d8448f76 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:07:06.630767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c7046-ed2a-45a4-b82b-9e21d8448f76 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:07:06.637282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8303a-f70f-4e0b-bd24-4cf300905eae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:07:06.637918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8303a-f70f-4e0b-bd24-4cf300905eae service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:06.638804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8303a-f70f-4e0b-bd24-4cf300905eae service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:06.639093 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8303a-f70f-4e0b-bd24-4cf300905eae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:06.647745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8303a-f70f-4e0b-bd24-4cf300905eae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:07:06.649318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8303a-f70f-4e0b-bd24-4cf300905eae service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:07:06.659074 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 772/1527] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:07:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:07:10.508433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc74225-7dff-4a61-9c93-8bc6e60034cc None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:10.508984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc74225-7dff-4a61-9c93-8bc6e60034cc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:10.508984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc74225-7dff-4a61-9c93-8bc6e60034cc None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:10.510317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 756/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 07:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:07:10.516045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fd4e1-7fee-47f5-8f0b-de49b09ebcbc None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:10.516483 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fd4e1-7fee-47f5-8f0b-de49b09ebcbc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:10.516580 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fd4e1-7fee-47f5-8f0b-de49b09ebcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:10.535949 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7a9fd4e1-7fee-47f5-8f0b-de49b09ebcbc None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:07:10.537143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7a9fd4e1-7fee-47f5-8f0b-de49b09ebcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:07:10.545207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 773/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 07:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:07:10.618707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc74225-7dff-4a61-9c93-8bc6e60034cc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:07:10.620436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3dc74225-7dff-4a61-9c93-8bc6e60034cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:07:10.697776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc74225-7dff-4a61-9c93-8bc6e60034cc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:07:10.701697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13ea59-3f19-4c5d-9718-3f682fda5c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:07:10.702297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13ea59-3f19-4c5d-9718-3f682fda5c8a service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:10.702574 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13ea59-3f19-4c5d-9718-3f682fda5c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:10.702846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13ea59-3f19-4c5d-9718-3f682fda5c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:10.711802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13ea59-3f19-4c5d-9718-3f682fda5c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:07:10.713213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13ea59-3f19-4c5d-9718-3f682fda5c8a service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:07:10.722377 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 757/1530] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:07:12.762453 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f54a0-6b94-4a16-b147-416b8423fbc2 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:12.763075 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f54a0-6b94-4a16-b147-416b8423fbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:12.763216 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f54a0-6b94-4a16-b147-416b8423fbc2 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:12.764511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 774/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 07:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:07:12.771989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f26ad-9a25-4486-8a16-d3880f02814c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:12.772480 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f26ad-9a25-4486-8a16-d3880f02814c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:12.772605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f26ad-9a25-4486-8a16-d3880f02814c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:12.791288 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-931f26ad-9a25-4486-8a16-d3880f02814c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:07:12.792465 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-931f26ad-9a25-4486-8a16-d3880f02814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:07:12.800948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 758/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 07:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:07:12.836863 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f54a0-6b94-4a16-b147-416b8423fbc2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:07:12.847679 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f54a0-6b94-4a16-b147-416b8423fbc2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:07:12.851182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677847a4-3af0-47d1-937e-92f9896375b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:07:12.851768 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677847a4-3af0-47d1-937e-92f9896375b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:12.852047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677847a4-3af0-47d1-937e-92f9896375b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:12.852316 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677847a4-3af0-47d1-937e-92f9896375b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:12.861513 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677847a4-3af0-47d1-937e-92f9896375b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:07:12.862914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677847a4-3af0-47d1-937e-92f9896375b4 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:07:12.872158 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 775/1533] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:07:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:07:16.311191 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f16cd-4595-4295-bd29-77ba1e0bcaff None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:16.311849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f16cd-4595-4295-bd29-77ba1e0bcaff None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:16.311849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f16cd-4595-4295-bd29-77ba1e0bcaff None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:16.313106 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 759/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 07:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:07:16.318105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6b23-5bd7-46b4-b4fc-7d87da65f593 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:16.318515 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6b23-5bd7-46b4-b4fc-7d87da65f593 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:16.318643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6b23-5bd7-46b4-b4fc-7d87da65f593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:16.337774 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-aa6d6b23-5bd7-46b4-b4fc-7d87da65f593 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:07:16.338950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-aa6d6b23-5bd7-46b4-b4fc-7d87da65f593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:07:16.347531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 776/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 07:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:07:16.649096 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f16cd-4595-4295-bd29-77ba1e0bcaff None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:07:16.650770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-504f16cd-4595-4295-bd29-77ba1e0bcaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:07:16.715206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:07:16.729450 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f16cd-4595-4295-bd29-77ba1e0bcaff None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:07:16.733501 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d60b5-743e-44ff-9b2f-422b3d4fe374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:07:16.734100 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d60b5-743e-44ff-9b2f-422b3d4fe374 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:16.734373 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d60b5-743e-44ff-9b2f-422b3d4fe374 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:16.734641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d60b5-743e-44ff-9b2f-422b3d4fe374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:16.743365 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d60b5-743e-44ff-9b2f-422b3d4fe374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:07:16.744800 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d60b5-743e-44ff-9b2f-422b3d4fe374 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:07:16.754017 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 760/1536] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:07:18.757757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ddf01-c04e-44fa-9214-f8a131ea53b1 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:18.758316 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ddf01-c04e-44fa-9214-f8a131ea53b1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:18.758316 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ddf01-c04e-44fa-9214-f8a131ea53b1 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:18.759681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 777/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 07:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:07:18.765284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de219e-35e9-4fce-a2f8-6cf6e423dca9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:18.765690 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de219e-35e9-4fce-a2f8-6cf6e423dca9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:18.765836 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de219e-35e9-4fce-a2f8-6cf6e423dca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:18.785358 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-01de219e-35e9-4fce-a2f8-6cf6e423dca9 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:07:18.786543 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-01de219e-35e9-4fce-a2f8-6cf6e423dca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:07:18.794498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 761/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 07:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:07:19.099886 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ddf01-c04e-44fa-9214-f8a131ea53b1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:07:19.101532 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-588ddf01-c04e-44fa-9214-f8a131ea53b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:07:19.114153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ddf01-c04e-44fa-9214-f8a131ea53b1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:07:19.117626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffe91c-ed82-418f-bc93-c82f46775f9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:07:19.118213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffe91c-ed82-418f-bc93-c82f46775f9f service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:07:19.118489 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffe91c-ed82-418f-bc93-c82f46775f9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:07:19.118756 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffe91c-ed82-418f-bc93-c82f46775f9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:07:19.127862 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffe91c-ed82-418f-bc93-c82f46775f9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:07:19.129264 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffe91c-ed82-418f-bc93-c82f46775f9f service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:07:19.138878 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 778/1539] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:07:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:07:28.780791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=11 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:07:29.134273 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=33 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:48.404634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7eee85-a898-4ea6-b9ef-48fd4c429bc4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:48.407294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7eee85-a898-4ea6-b9ef-48fd4c429bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:48.407294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7eee85-a898-4ea6-b9ef-48fd4c429bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:48.438139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2d7eee85-a898-4ea6-b9ef-48fd4c429bc4 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:48.439817 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2d7eee85-a898-4ea6-b9ef-48fd4c429bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:48.455441 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 762/1540] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:48.468104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310808d-391f-4cd0-83f3-555f99cf53db None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:48.468731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310808d-391f-4cd0-83f3-555f99cf53db None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:48.468731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310808d-391f-4cd0-83f3-555f99cf53db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:48.504485 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e310808d-391f-4cd0-83f3-555f99cf53db None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:48.505721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e310808d-391f-4cd0-83f3-555f99cf53db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:48.516818 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 779/1541] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:48.521818 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7eee85-a898-4ea6-b9ef-48fd4c429bc4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:48.536962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7eee85-a898-4ea6-b9ef-48fd4c429bc4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:48.546458 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89054ab2-58dd-4a2c-9bb6-fa3ec5ddb707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:48.550791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89054ab2-58dd-4a2c-9bb6-fa3ec5ddb707 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:48.551594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89054ab2-58dd-4a2c-9bb6-fa3ec5ddb707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:48.552089 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89054ab2-58dd-4a2c-9bb6-fa3ec5ddb707 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:48.552999 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89054ab2-58dd-4a2c-9bb6-fa3ec5ddb707 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:08:48.553527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89054ab2-58dd-4a2c-9bb6-fa3ec5ddb707 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:48.558772 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89054ab2-58dd-4a2c-9bb6-fa3ec5ddb707 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:48.575502 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 763/1542] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:08:48.583766 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310808d-391f-4cd0-83f3-555f99cf53db None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:48.599630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310808d-391f-4cd0-83f3-555f99cf53db None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:48.610322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d561a-a935-47af-baf3-c2d952fd3c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:48.610948 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d561a-a935-47af-baf3-c2d952fd3c17 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:48.611259 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d561a-a935-47af-baf3-c2d952fd3c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:48.611530 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d561a-a935-47af-baf3-c2d952fd3c17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:48.612168 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d561a-a935-47af-baf3-c2d952fd3c17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:48.614267 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d561a-a935-47af-baf3-c2d952fd3c17 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:48.699637 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 780/1543] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:08:48 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:48.704156 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89054ab2-58dd-4a2c-9bb6-fa3ec5ddb707 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:48.725750 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89054ab2-58dd-4a2c-9bb6-fa3ec5ddb707 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:48.772560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d356ba9-f494-4624-913f-48fc95750ffe None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:48.773257 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d356ba9-f494-4624-913f-48fc95750ffe None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:48.773750 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d356ba9-f494-4624-913f-48fc95750ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:48.815171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8d356ba9-f494-4624-913f-48fc95750ffe None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:48.816758 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8d356ba9-f494-4624-913f-48fc95750ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:48.849220 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27653f56-859d-4bd3-b546-27d829ce819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:48.849841 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27653f56-859d-4bd3-b546-27d829ce819c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:48.850119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27653f56-859d-4bd3-b546-27d829ce819c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:48.850390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27653f56-859d-4bd3-b546-27d829ce819c admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:48.851027 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27653f56-859d-4bd3-b546-27d829ce819c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:48.853534 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27653f56-859d-4bd3-b546-27d829ce819c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:48.909370 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 764/1544] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:08:48 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:48.914157 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27653f56-859d-4bd3-b546-27d829ce819c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:48.934693 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27653f56-859d-4bd3-b546-27d829ce819c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:48.951268 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49997df9-756d-4876-9b26-272c25a4722f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:48.951821 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49997df9-756d-4876-9b26-272c25a4722f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:48.952096 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49997df9-756d-4876-9b26-272c25a4722f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:48.952370 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49997df9-756d-4876-9b26-272c25a4722f admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:48.953019 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49997df9-756d-4876-9b26-272c25a4722f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:48.954667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49997df9-756d-4876-9b26-272c25a4722f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:48.954797 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 781/1545] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:48.963613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c798a7b-3c5f-44ac-b1a4-ffd19faa1634 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:48.964158 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c798a7b-3c5f-44ac-b1a4-ffd19faa1634 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:48.964448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c798a7b-3c5f-44ac-b1a4-ffd19faa1634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:48.975232 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 765/1546] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:48.976379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47446ae-218f-4f20-a1b2-3adc9b67c52f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:48.976663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47446ae-218f-4f20-a1b2-3adc9b67c52f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:48.976938 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47446ae-218f-4f20-a1b2-3adc9b67c52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.003616 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1c798a7b-3c5f-44ac-b1a4-ffd19faa1634 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:49.005114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1c798a7b-3c5f-44ac-b1a4-ffd19faa1634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:49.014527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c47446ae-218f-4f20-a1b2-3adc9b67c52f None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:49.017874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c47446ae-218f-4f20-a1b2-3adc9b67c52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:49.023726 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 782/1547] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 09 07:08:49.025024 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cd364-5d7a-48c5-9d24-cb8c23402696 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.025925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cd364-5d7a-48c5-9d24-cb8c23402696 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.026991 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cd364-5d7a-48c5-9d24-cb8c23402696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.044118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 766/1548] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:49.046526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47446ae-218f-4f20-a1b2-3adc9b67c52f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.062375 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47446ae-218f-4f20-a1b2-3adc9b67c52f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:49.065473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-097cd364-5d7a-48c5-9d24-cb8c23402696 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:49.066895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-097cd364-5d7a-48c5-9d24-cb8c23402696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:49.070015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c763b-c186-47fb-8d9c-804fc6301367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:49.070015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c763b-c186-47fb-8d9c-804fc6301367 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.070015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c763b-c186-47fb-8d9c-804fc6301367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.070015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c763b-c186-47fb-8d9c-804fc6301367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.070446 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c763b-c186-47fb-8d9c-804fc6301367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:49.071585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c763b-c186-47fb-8d9c-804fc6301367 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:49.080631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 783/1549] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:49.082271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134a054-f032-4f37-ba13-dbb9c91449f4 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.082733 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134a054-f032-4f37-ba13-dbb9c91449f4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.083322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134a054-f032-4f37-ba13-dbb9c91449f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.089919 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 767/1550] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:49.091236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec3868-e67f-43f6-b0c4-3d00dd78587e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.091505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec3868-e67f-43f6-b0c4-3d00dd78587e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.091779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec3868-e67f-43f6-b0c4-3d00dd78587e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.106188 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9134a054-f032-4f37-ba13-dbb9c91449f4 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:49.107438 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9134a054-f032-4f37-ba13-dbb9c91449f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:49.117134 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-98ec3868-e67f-43f6-b0c4-3d00dd78587e None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:49.118310 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-98ec3868-e67f-43f6-b0c4-3d00dd78587e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:49.120883 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 784/1551] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:49.124025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134a054-f032-4f37-ba13-dbb9c91449f4 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.129569 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 768/1552] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:49.131648 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23faac-27d5-4aef-8bfd-c385fc520213 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.132098 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23faac-27d5-4aef-8bfd-c385fc520213 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.132468 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23faac-27d5-4aef-8bfd-c385fc520213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.138939 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134a054-f032-4f37-ba13-dbb9c91449f4 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:49.143712 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da252e-1d74-471a-a55e-a055630f71c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:49.144312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da252e-1d74-471a-a55e-a055630f71c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.144591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da252e-1d74-471a-a55e-a055630f71c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.144862 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da252e-1d74-471a-a55e-a055630f71c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.145535 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da252e-1d74-471a-a55e-a055630f71c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:08:49.145838 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da252e-1d74-471a-a55e-a055630f71c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:49.146833 dv-cinder-852514-1-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-a3da252e-1d74-471a-a55e-a055630f71c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 07:08:49.146833 dv-cinder-852514-1-smb devstack@keystone.service[80233]: warnings.warn(msg) Aug 09 07:08:49.146833 dv-cinder-852514-1-smb devstack@keystone.service[80233]: Aug 09 07:08:49.147794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da252e-1d74-471a-a55e-a055630f71c4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:49.153681 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2f23faac-27d5-4aef-8bfd-c385fc520213 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:49.154856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2f23faac-27d5-4aef-8bfd-c385fc520213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:49.160663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 785/1553] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:08:49.161688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2b3c8-095a-4f03-a32a-d7bb72a4ef78 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.161974 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2b3c8-095a-4f03-a32a-d7bb72a4ef78 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.162247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2b3c8-095a-4f03-a32a-d7bb72a4ef78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.168435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 769/1554] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:49.169397 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23faac-27d5-4aef-8bfd-c385fc520213 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.178959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23faac-27d5-4aef-8bfd-c385fc520213 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:49.183190 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-10c2b3c8-095a-4f03-a32a-d7bb72a4ef78 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:49.183565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354875dd-0efd-4031-b42a-5b9798feb4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:49.184213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354875dd-0efd-4031-b42a-5b9798feb4ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.184453 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-10c2b3c8-095a-4f03-a32a-d7bb72a4ef78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:49.184565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354875dd-0efd-4031-b42a-5b9798feb4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.184739 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354875dd-0efd-4031-b42a-5b9798feb4ff admin admin] PATH_INFO: `/v3/projects/d5f64f07e4b44a2cb6821147609a35a3/users/a7d50e164ef94115b2a5774480a8155d/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.192361 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 786/1555] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:49.193527 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba71b5-88ff-436e-93ec-ce38cb7e5ff9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.193811 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba71b5-88ff-436e-93ec-ce38cb7e5ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.194083 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba71b5-88ff-436e-93ec-ce38cb7e5ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.200258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354875dd-0efd-4031-b42a-5b9798feb4ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f64f07e4b44a2cb6821147609a35a3, user_id=a7d50e164ef94115b2a5774480a8155d, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:49.201443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-354875dd-0efd-4031-b42a-5b9798feb4ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 07:08:49.201443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: warnings.warn(msg) Aug 09 07:08:49.201443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: Aug 09 07:08:49.203325 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354875dd-0efd-4031-b42a-5b9798feb4ff admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:49.214046 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e8ba71b5-88ff-436e-93ec-ce38cb7e5ff9 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:49.215274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e8ba71b5-88ff-436e-93ec-ce38cb7e5ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:49.217062 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 770/1556] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:08:49 2022] PUT /identity/v3/projects/d5f64f07e4b44a2cb6821147609a35a3/users/a7d50e164ef94115b2a5774480a8155d/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:49.218326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8553b-1b53-4612-a5f9-734d12c3dfb0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.218609 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8553b-1b53-4612-a5f9-734d12c3dfb0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.218880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8553b-1b53-4612-a5f9-734d12c3dfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.238001 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a6b8553b-1b53-4612-a5f9-734d12c3dfb0 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:49.239200 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a6b8553b-1b53-4612-a5f9-734d12c3dfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:49.278636 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 787/1557] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:49.279985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a1fa2-2131-4254-9e7d-314de6ab1c7e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.280270 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a1fa2-2131-4254-9e7d-314de6ab1c7e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.280775 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a1fa2-2131-4254-9e7d-314de6ab1c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.298646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 771/1558] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:49.299535 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8553b-1b53-4612-a5f9-734d12c3dfb0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.299856 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-679a1fa2-2131-4254-9e7d-314de6ab1c7e None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:49.301080 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-679a1fa2-2131-4254-9e7d-314de6ab1c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:49.305289 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:49.309662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8553b-1b53-4612-a5f9-734d12c3dfb0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:49.310789 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 788/1559] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:49.311741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a1fa2-2131-4254-9e7d-314de6ab1c7e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.318602 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d9c93-582a-4fbe-a04e-b18a16bc026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:49.319307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d9c93-582a-4fbe-a04e-b18a16bc026f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.319584 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d9c93-582a-4fbe-a04e-b18a16bc026f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.319851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d9c93-582a-4fbe-a04e-b18a16bc026f admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.320518 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d9c93-582a-4fbe-a04e-b18a16bc026f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:08:49.320817 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d9c93-582a-4fbe-a04e-b18a16bc026f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:49.321223 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a1fa2-2131-4254-9e7d-314de6ab1c7e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:49.322631 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d9c93-582a-4fbe-a04e-b18a16bc026f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:49.328143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5736e7-69fc-4cb6-9b1d-17acda6e449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:49.328827 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5736e7-69fc-4cb6-9b1d-17acda6e449a admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.329190 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5736e7-69fc-4cb6-9b1d-17acda6e449a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.329516 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5736e7-69fc-4cb6-9b1d-17acda6e449a admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.330129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5736e7-69fc-4cb6-9b1d-17acda6e449a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:49.332411 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5736e7-69fc-4cb6-9b1d-17acda6e449a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:49.344179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 772/1560] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:08:49.344179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3ad45-a1a4-47a6-8838-2deee5f34474 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.344179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3ad45-a1a4-47a6-8838-2deee5f34474 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.344179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3ad45-a1a4-47a6-8838-2deee5f34474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.351713 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:49.362553 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4bc3ad45-a1a4-47a6-8838-2deee5f34474 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:49.364037 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4bc3ad45-a1a4-47a6-8838-2deee5f34474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:49.372856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 773/1561] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:49.373659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 789/1562] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/projects => generated 405 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:49.374354 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01c358-2f76-46e1-9062-6929558156f6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.374699 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01c358-2f76-46e1-9062-6929558156f6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.375035 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01c358-2f76-46e1-9062-6929558156f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.375732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f638816-5781-48a4-970e-a1241975f2a6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.376238 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f638816-5781-48a4-970e-a1241975f2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.376809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f638816-5781-48a4-970e-a1241975f2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.394971 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6f638816-5781-48a4-970e-a1241975f2a6 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:49.395191 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5b01c358-2f76-46e1-9062-6929558156f6 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:49.396206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6f638816-5781-48a4-970e-a1241975f2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:49.396359 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5b01c358-2f76-46e1-9062-6929558156f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:49.455665 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 774/1563] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:49.456541 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 790/1564] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:49.457784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43aedd7-816b-4e39-accb-919b121f32ee None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.458075 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43aedd7-816b-4e39-accb-919b121f32ee None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.458352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43aedd7-816b-4e39-accb-919b121f32ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.460448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01c358-2f76-46e1-9062-6929558156f6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.471010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01c358-2f76-46e1-9062-6929558156f6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:49.475983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f81de-8cc0-42a7-8a4d-efe4c066c49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:49.476581 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f81de-8cc0-42a7-8a4d-efe4c066c49c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.476862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f81de-8cc0-42a7-8a4d-efe4c066c49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.477134 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f81de-8cc0-42a7-8a4d-efe4c066c49c admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.477772 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f81de-8cc0-42a7-8a4d-efe4c066c49c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:08:49.478668 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f81de-8cc0-42a7-8a4d-efe4c066c49c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:49.479549 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d43aedd7-816b-4e39-accb-919b121f32ee None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:49.480343 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f81de-8cc0-42a7-8a4d-efe4c066c49c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:49.480746 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d43aedd7-816b-4e39-accb-919b121f32ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:49.488590 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 791/1565] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:49.492442 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43aedd7-816b-4e39-accb-919b121f32ee None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.495636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 775/1566] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:08:49.496514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f81de-8cc0-42a7-8a4d-efe4c066c49c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.502267 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43aedd7-816b-4e39-accb-919b121f32ee None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:49.506191 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f81de-8cc0-42a7-8a4d-efe4c066c49c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:49.507210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd03a68-85ff-4f32-882e-9477149cdbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:49.507802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd03a68-85ff-4f32-882e-9477149cdbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.508078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd03a68-85ff-4f32-882e-9477149cdbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.508349 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd03a68-85ff-4f32-882e-9477149cdbc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.508985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd03a68-85ff-4f32-882e-9477149cdbc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:08:49.509850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd03a68-85ff-4f32-882e-9477149cdbc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:49.511356 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9608e-18f6-4365-8a64-ecb14fffe515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:49.511622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd03a68-85ff-4f32-882e-9477149cdbc8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:49.512041 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9608e-18f6-4365-8a64-ecb14fffe515 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.512317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9608e-18f6-4365-8a64-ecb14fffe515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.512583 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9608e-18f6-4365-8a64-ecb14fffe515 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.513192 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9608e-18f6-4365-8a64-ecb14fffe515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:49.514185 dv-cinder-852514-1-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-e2f9608e-18f6-4365-8a64-ecb14fffe515 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 07:08:49.514185 dv-cinder-852514-1-smb devstack@keystone.service[80234]: warnings.warn(msg) Aug 09 07:08:49.514185 dv-cinder-852514-1-smb devstack@keystone.service[80234]: Aug 09 07:08:49.515376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9608e-18f6-4365-8a64-ecb14fffe515 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:49.528463 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 792/1567] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:08:49.528463 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd03a68-85ff-4f32-882e-9477149cdbc8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.538782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd03a68-85ff-4f32-882e-9477149cdbc8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:49.544274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d5af4-ec99-45d1-9d83-e47bcad91fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:49.544924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 776/1568] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:49.545727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9608e-18f6-4365-8a64-ecb14fffe515 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.547434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d5af4-ec99-45d1-9d83-e47bcad91fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.547955 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d5af4-ec99-45d1-9d83-e47bcad91fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.548249 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d5af4-ec99-45d1-9d83-e47bcad91fc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.548914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d5af4-ec99-45d1-9d83-e47bcad91fc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:08:49.549222 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d5af4-ec99-45d1-9d83-e47bcad91fc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:49.550806 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d5af4-ec99-45d1-9d83-e47bcad91fc7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:49.563417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 793/1569] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:08:49.564442 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d5af4-ec99-45d1-9d83-e47bcad91fc7 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.574484 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d5af4-ec99-45d1-9d83-e47bcad91fc7 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:49.612725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9608e-18f6-4365-8a64-ecb14fffe515 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:49.617705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574fce1-20fe-47b1-8a30-5fd82748366c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:49.617966 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574fce1-20fe-47b1-8a30-5fd82748366c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.618238 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574fce1-20fe-47b1-8a30-5fd82748366c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.618503 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574fce1-20fe-47b1-8a30-5fd82748366c admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.619178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574fce1-20fe-47b1-8a30-5fd82748366c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:49.621078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574fce1-20fe-47b1-8a30-5fd82748366c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:49.642515 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b080418-2be8-49ca-a080-275c879debf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:49.643197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b080418-2be8-49ca-a080-275c879debf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.643510 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b080418-2be8-49ca-a080-275c879debf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.643785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b080418-2be8-49ca-a080-275c879debf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.644430 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b080418-2be8-49ca-a080-275c879debf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:08:49.644734 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b080418-2be8-49ca-a080-275c879debf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:49.645853 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 777/1570] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:49.646681 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574fce1-20fe-47b1-8a30-5fd82748366c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.649277 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b080418-2be8-49ca-a080-275c879debf1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:49.669303 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 794/1571] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:08:49.669303 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b080418-2be8-49ca-a080-275c879debf1 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.672811 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b080418-2be8-49ca-a080-275c879debf1 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:49.677643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e36e8c-aad1-4734-8370-af322ceac5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:49.678234 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e36e8c-aad1-4734-8370-af322ceac5aa admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.678510 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e36e8c-aad1-4734-8370-af322ceac5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.678777 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e36e8c-aad1-4734-8370-af322ceac5aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.679436 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e36e8c-aad1-4734-8370-af322ceac5aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:08:49.679743 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e36e8c-aad1-4734-8370-af322ceac5aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:49.681347 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e36e8c-aad1-4734-8370-af322ceac5aa admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:49.693160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 795/1572] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:08:49.693926 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e36e8c-aad1-4734-8370-af322ceac5aa admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.695265 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:49.705434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e36e8c-aad1-4734-8370-af322ceac5aa admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:49.710656 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9b073-4bd1-4efa-82b9-f30653ef8cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:49.711012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574fce1-20fe-47b1-8a30-5fd82748366c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:49.711230 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9b073-4bd1-4efa-82b9-f30653ef8cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.711511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9b073-4bd1-4efa-82b9-f30653ef8cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.711780 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9b073-4bd1-4efa-82b9-f30653ef8cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.712968 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9b073-4bd1-4efa-82b9-f30653ef8cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:49.715234 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9b073-4bd1-4efa-82b9-f30653ef8cb7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:49.715426 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e870db-2826-43a9-8667-f9cb41728762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:49.716052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e870db-2826-43a9-8667-f9cb41728762 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.716322 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e870db-2826-43a9-8667-f9cb41728762 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.716587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e870db-2826-43a9-8667-f9cb41728762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.725519 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e870db-2826-43a9-8667-f9cb41728762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:49.726998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e870db-2826-43a9-8667-f9cb41728762 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:49.737893 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 778/1573] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:08:49.738663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e870db-2826-43a9-8667-f9cb41728762 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.746378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 796/1574] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:49.746378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9b073-4bd1-4efa-82b9-f30653ef8cb7 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.748571 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e870db-2826-43a9-8667-f9cb41728762 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:49.778053 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:49.809357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1d3d1-9ed0-43ed-8370-14beb2d8f928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:49.809973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1d3d1-9ed0-43ed-8370-14beb2d8f928 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.810247 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1d3d1-9ed0-43ed-8370-14beb2d8f928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.810573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1d3d1-9ed0-43ed-8370-14beb2d8f928 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.811288 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1d3d1-9ed0-43ed-8370-14beb2d8f928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:49.814203 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1d3d1-9ed0-43ed-8370-14beb2d8f928 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:49.823717 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9b073-4bd1-4efa-82b9-f30653ef8cb7 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:49.831247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378462a-bc9f-4aa7-9c43-849f791ca172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:49.832090 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378462a-bc9f-4aa7-9c43-849f791ca172 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.832514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378462a-bc9f-4aa7-9c43-849f791ca172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.833075 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378462a-bc9f-4aa7-9c43-849f791ca172 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.833960 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378462a-bc9f-4aa7-9c43-849f791ca172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:49.835004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-d378462a-bc9f-4aa7-9c43-849f791ca172 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 07:08:49.835004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: warnings.warn(msg) Aug 09 07:08:49.835004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: Aug 09 07:08:49.836345 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378462a-bc9f-4aa7-9c43-849f791ca172 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:49.850462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 779/1575] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/projects => generated 403 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:49.851744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1d3d1-9ed0-43ed-8370-14beb2d8f928 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.866747 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 797/1576] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:49.867605 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378462a-bc9f-4aa7-9c43-849f791ca172 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.877587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378462a-bc9f-4aa7-9c43-849f791ca172 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:49.930863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1d3d1-9ed0-43ed-8370-14beb2d8f928 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:49.937199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ff5de-e3b1-4d13-b752-85a9bf41cc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:49.938061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ff5de-e3b1-4d13-b752-85a9bf41cc17 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.938228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ff5de-e3b1-4d13-b752-85a9bf41cc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.938467 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ff5de-e3b1-4d13-b752-85a9bf41cc17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.939156 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ff5de-e3b1-4d13-b752-85a9bf41cc17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:49.941613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ff5de-e3b1-4d13-b752-85a9bf41cc17 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:49.946561 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43855f96-50f5-42e4-bd1d-822e006b109f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:49.947707 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43855f96-50f5-42e4-bd1d-822e006b109f admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:49.948190 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43855f96-50f5-42e4-bd1d-822e006b109f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:49.948880 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43855f96-50f5-42e4-bd1d-822e006b109f admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:49.949510 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43855f96-50f5-42e4-bd1d-822e006b109f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:49.953470 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43855f96-50f5-42e4-bd1d-822e006b109f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:49.969352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 798/1577] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:49.973335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43855f96-50f5-42e4-bd1d-822e006b109f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.980408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 780/1578] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:49.981688 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ff5de-e3b1-4d13-b752-85a9bf41cc17 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:49.989211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43855f96-50f5-42e4-bd1d-822e006b109f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.040470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:50.054313 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75097b-c3f0-404f-a681-7a55db3615dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.054922 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75097b-c3f0-404f-a681-7a55db3615dd admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.055255 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75097b-c3f0-404f-a681-7a55db3615dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.055526 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75097b-c3f0-404f-a681-7a55db3615dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.055969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ff5de-e3b1-4d13-b752-85a9bf41cc17 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.056267 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75097b-c3f0-404f-a681-7a55db3615dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.058601 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75097b-c3f0-404f-a681-7a55db3615dd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.062326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d97d8-0531-4e2a-aae3-d2c1fbadcdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.062952 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d97d8-0531-4e2a-aae3-d2c1fbadcdaf admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.063259 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d97d8-0531-4e2a-aae3-d2c1fbadcdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.063532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d97d8-0531-4e2a-aae3-d2c1fbadcdaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.064319 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d97d8-0531-4e2a-aae3-d2c1fbadcdaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.066228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d97d8-0531-4e2a-aae3-d2c1fbadcdaf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.095147 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 799/1579] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/projects => generated 393 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:50.095606 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 781/1580] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:08:49 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:50.096395 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75097b-c3f0-404f-a681-7a55db3615dd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.096515 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d97d8-0531-4e2a-aae3-d2c1fbadcdaf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.139368 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:50.173074 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d97d8-0531-4e2a-aae3-d2c1fbadcdaf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.178088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75097b-c3f0-404f-a681-7a55db3615dd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.179185 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efb0d3-5056-4bf8-898f-409662d751da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.179904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efb0d3-5056-4bf8-898f-409662d751da admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.180293 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efb0d3-5056-4bf8-898f-409662d751da admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.180636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efb0d3-5056-4bf8-898f-409662d751da admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.181891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efb0d3-5056-4bf8-898f-409662d751da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.184469 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efb0d3-5056-4bf8-898f-409662d751da admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.193810 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c786fa9-33e3-44a1-bc2b-7021fe288ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.194818 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c786fa9-33e3-44a1-bc2b-7021fe288ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.195312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c786fa9-33e3-44a1-bc2b-7021fe288ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.195778 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c786fa9-33e3-44a1-bc2b-7021fe288ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.196598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c786fa9-33e3-44a1-bc2b-7021fe288ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.198994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c786fa9-33e3-44a1-bc2b-7021fe288ce1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.217857 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 782/1581] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:08:50 2022] POST /identity/v3/users => generated 302 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:50.217857 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efb0d3-5056-4bf8-898f-409662d751da admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.232901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efb0d3-5056-4bf8-898f-409662d751da admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.233705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 800/1582] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:08:50 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:50.235390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c786fa9-33e3-44a1-bc2b-7021fe288ce1 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.238947 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1519e77-885f-49a5-8845-bcfe4798cdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.239615 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1519e77-885f-49a5-8845-bcfe4798cdcf admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.239895 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1519e77-885f-49a5-8845-bcfe4798cdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.240168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1519e77-885f-49a5-8845-bcfe4798cdcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.240894 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1519e77-885f-49a5-8845-bcfe4798cdcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.243038 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1519e77-885f-49a5-8845-bcfe4798cdcf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.248125 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c786fa9-33e3-44a1-bc2b-7021fe288ce1 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.255275 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b05716-e4cf-4380-ae6b-71980b962542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.258912 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b05716-e4cf-4380-ae6b-71980b962542 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.259104 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 783/1583] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:50.259740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b05716-e4cf-4380-ae6b-71980b962542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.259740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b05716-e4cf-4380-ae6b-71980b962542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.259931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1519e77-885f-49a5-8845-bcfe4798cdcf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.260023 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b05716-e4cf-4380-ae6b-71980b962542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.260871 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b05716-e4cf-4380-ae6b-71980b962542 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.276362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 801/1584] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:50.276597 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1519e77-885f-49a5-8845-bcfe4798cdcf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.276728 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b05716-e4cf-4380-ae6b-71980b962542 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.282692 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56836f20-601f-4e16-b788-a0891fb56643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.283499 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56836f20-601f-4e16-b788-a0891fb56643 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.283930 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56836f20-601f-4e16-b788-a0891fb56643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.284196 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56836f20-601f-4e16-b788-a0891fb56643 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.284911 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56836f20-601f-4e16-b788-a0891fb56643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.286875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56836f20-601f-4e16-b788-a0891fb56643 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.290329 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b05716-e4cf-4380-ae6b-71980b962542 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.295559 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20fffb-0cdf-45a6-8f94-bef348e0385d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.297298 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20fffb-0cdf-45a6-8f94-bef348e0385d admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.297445 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20fffb-0cdf-45a6-8f94-bef348e0385d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.298290 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20fffb-0cdf-45a6-8f94-bef348e0385d admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.299217 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20fffb-0cdf-45a6-8f94-bef348e0385d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.302097 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20fffb-0cdf-45a6-8f94-bef348e0385d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.310862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 784/1585] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:08:50 2022] POST /identity/v3/users => generated 289 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:50.312009 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56836f20-601f-4e16-b788-a0891fb56643 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.325216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56836f20-601f-4e16-b788-a0891fb56643 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.330394 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc42a5-2549-4e91-bf2b-204805cf37fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.331033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc42a5-2549-4e91-bf2b-204805cf37fd admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.331419 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc42a5-2549-4e91-bf2b-204805cf37fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.331694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc42a5-2549-4e91-bf2b-204805cf37fd admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.332324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc42a5-2549-4e91-bf2b-204805cf37fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.334261 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc42a5-2549-4e91-bf2b-204805cf37fd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.334593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 802/1586] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:08:50 2022] POST /identity/v3/users => generated 297 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:50.335647 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20fffb-0cdf-45a6-8f94-bef348e0385d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.350573 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20fffb-0cdf-45a6-8f94-bef348e0385d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.359117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58335c68-865f-43ee-8d41-b75a85ac227f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.359988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58335c68-865f-43ee-8d41-b75a85ac227f admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.360375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58335c68-865f-43ee-8d41-b75a85ac227f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.360753 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58335c68-865f-43ee-8d41-b75a85ac227f admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.363981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 785/1587] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:08:50 2022] POST /identity/v3/users => generated 287 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:50.364147 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58335c68-865f-43ee-8d41-b75a85ac227f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.364261 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc42a5-2549-4e91-bf2b-204805cf37fd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.364357 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58335c68-865f-43ee-8d41-b75a85ac227f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.375018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc42a5-2549-4e91-bf2b-204805cf37fd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.380699 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 803/1588] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:50.380699 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58335c68-865f-43ee-8d41-b75a85ac227f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.383386 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4127a3-f124-4b1b-9eba-b636c3337565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.384703 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4127a3-f124-4b1b-9eba-b636c3337565 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.385041 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4127a3-f124-4b1b-9eba-b636c3337565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.385733 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4127a3-f124-4b1b-9eba-b636c3337565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.386701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4127a3-f124-4b1b-9eba-b636c3337565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.387871 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4127a3-f124-4b1b-9eba-b636c3337565 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.397953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58335c68-865f-43ee-8d41-b75a85ac227f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.403121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 786/1589] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:50.403121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4127a3-f124-4b1b-9eba-b636c3337565 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.408623 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45efd7-ec8c-4e78-a14f-5b8159a04728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.409396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45efd7-ec8c-4e78-a14f-5b8159a04728 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.409530 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45efd7-ec8c-4e78-a14f-5b8159a04728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.409794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45efd7-ec8c-4e78-a14f-5b8159a04728 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.410473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45efd7-ec8c-4e78-a14f-5b8159a04728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.412121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45efd7-ec8c-4e78-a14f-5b8159a04728 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.414944 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4127a3-f124-4b1b-9eba-b636c3337565 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.420595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050d6fb-49be-4321-a4f0-207c66a7ed8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.421300 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050d6fb-49be-4321-a4f0-207c66a7ed8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.421580 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050d6fb-49be-4321-a4f0-207c66a7ed8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.421856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050d6fb-49be-4321-a4f0-207c66a7ed8d admin admin] PATH_INFO: `/v3/projects/a1482db1de4445468883cf5079e29f9d/users/df0004375b95482fa5d05f17ed9e0632/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.423169 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 804/1590] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:50.426907 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45efd7-ec8c-4e78-a14f-5b8159a04728 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.437080 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45efd7-ec8c-4e78-a14f-5b8159a04728 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.437494 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050d6fb-49be-4321-a4f0-207c66a7ed8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1482db1de4445468883cf5079e29f9d, user_id=df0004375b95482fa5d05f17ed9e0632, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.440180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050d6fb-49be-4321-a4f0-207c66a7ed8d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.451656 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ec1e4-e1aa-4f1f-94ea-38f283c70e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.452623 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ec1e4-e1aa-4f1f-94ea-38f283c70e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.452992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ec1e4-e1aa-4f1f-94ea-38f283c70e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.453246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ec1e4-e1aa-4f1f-94ea-38f283c70e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.454040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ec1e4-e1aa-4f1f-94ea-38f283c70e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.455776 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ec1e4-e1aa-4f1f-94ea-38f283c70e65 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.460823 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 787/1591] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:08:50 2022] PUT /identity/v3/projects/a1482db1de4445468883cf5079e29f9d/users/df0004375b95482fa5d05f17ed9e0632/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:50.464105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050d6fb-49be-4321-a4f0-207c66a7ed8d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.468578 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 805/1592] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:50.469599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ec1e4-e1aa-4f1f-94ea-38f283c70e65 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.481886 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ec1e4-e1aa-4f1f-94ea-38f283c70e65 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.527701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:50.545105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050d6fb-49be-4321-a4f0-207c66a7ed8d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.547820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36921fc3-e9ca-44af-af38-6cd69fe724be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.548509 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36921fc3-e9ca-44af-af38-6cd69fe724be admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.548879 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36921fc3-e9ca-44af-af38-6cd69fe724be admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.549258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36921fc3-e9ca-44af-af38-6cd69fe724be admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.550011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36921fc3-e9ca-44af-af38-6cd69fe724be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.550760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea3a82-5407-43b3-b5ab-5872824c9829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.551425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea3a82-5407-43b3-b5ab-5872824c9829 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.551660 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36921fc3-e9ca-44af-af38-6cd69fe724be admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.551770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea3a82-5407-43b3-b5ab-5872824c9829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.551955 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea3a82-5407-43b3-b5ab-5872824c9829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.552634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea3a82-5407-43b3-b5ab-5872824c9829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.554810 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea3a82-5407-43b3-b5ab-5872824c9829 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.564664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 806/1593] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:50.565861 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36921fc3-e9ca-44af-af38-6cd69fe724be admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.565976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 788/1594] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:50.566709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea3a82-5407-43b3-b5ab-5872824c9829 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.578374 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea3a82-5407-43b3-b5ab-5872824c9829 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.584008 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36921fc3-e9ca-44af-af38-6cd69fe724be admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.584235 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617aa50d-39ff-4ada-926e-ec7759aba426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.584749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617aa50d-39ff-4ada-926e-ec7759aba426 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.585023 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617aa50d-39ff-4ada-926e-ec7759aba426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.585293 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617aa50d-39ff-4ada-926e-ec7759aba426 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.589161 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617aa50d-39ff-4ada-926e-ec7759aba426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.589161 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617aa50d-39ff-4ada-926e-ec7759aba426 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.589336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bf6a9-aa96-4242-b7c6-6ebfcc077296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.589947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bf6a9-aa96-4242-b7c6-6ebfcc077296 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.590228 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bf6a9-aa96-4242-b7c6-6ebfcc077296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.590632 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bf6a9-aa96-4242-b7c6-6ebfcc077296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.591584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bf6a9-aa96-4242-b7c6-6ebfcc077296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.593509 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bf6a9-aa96-4242-b7c6-6ebfcc077296 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.602088 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 789/1595] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:50.603074 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617aa50d-39ff-4ada-926e-ec7759aba426 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.611525 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 807/1596] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:50.612394 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bf6a9-aa96-4242-b7c6-6ebfcc077296 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.613400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617aa50d-39ff-4ada-926e-ec7759aba426 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.618311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea766deb-425b-4031-9f5f-be3ed60564b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.619568 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea766deb-425b-4031-9f5f-be3ed60564b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.619818 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea766deb-425b-4031-9f5f-be3ed60564b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.620057 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea766deb-425b-4031-9f5f-be3ed60564b0 admin admin] PATH_INFO: `/v3/projects/eb1015d1c9e145e4a43ec2d5456bbf47/users/6cead1e7fb98489fbe122f9bff8a63b1/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.633887 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bf6a9-aa96-4242-b7c6-6ebfcc077296 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.639011 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea766deb-425b-4031-9f5f-be3ed60564b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1015d1c9e145e4a43ec2d5456bbf47, user_id=6cead1e7fb98489fbe122f9bff8a63b1, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.640775 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e356244-2bd5-4486-a8b5-3b73316b2f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.641990 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e356244-2bd5-4486-a8b5-3b73316b2f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.642344 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e356244-2bd5-4486-a8b5-3b73316b2f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.642683 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e356244-2bd5-4486-a8b5-3b73316b2f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.643805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea766deb-425b-4031-9f5f-be3ed60564b0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.644259 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e356244-2bd5-4486-a8b5-3b73316b2f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.646122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e356244-2bd5-4486-a8b5-3b73316b2f79 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.665369 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 808/1597] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:50.665369 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209cc99-761a-496a-9d04-b0240ddabca2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.665369 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209cc99-761a-496a-9d04-b0240ddabca2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.665369 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209cc99-761a-496a-9d04-b0240ddabca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.671252 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 790/1598] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:08:50 2022] PUT /identity/v3/projects/eb1015d1c9e145e4a43ec2d5456bbf47/users/6cead1e7fb98489fbe122f9bff8a63b1/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:50.672169 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea766deb-425b-4031-9f5f-be3ed60564b0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.701679 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5209cc99-761a-496a-9d04-b0240ddabca2 None None] MFA Rules not processed for user `df0004375b95482fa5d05f17ed9e0632`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:50.702905 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5209cc99-761a-496a-9d04-b0240ddabca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:50.742042 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:50.775958 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea766deb-425b-4031-9f5f-be3ed60564b0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.781982 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be1e50-40ea-44c8-8dc6-59e36a782d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.781982 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be1e50-40ea-44c8-8dc6-59e36a782d2f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.782274 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be1e50-40ea-44c8-8dc6-59e36a782d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.782431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be1e50-40ea-44c8-8dc6-59e36a782d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.783221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be1e50-40ea-44c8-8dc6-59e36a782d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.784813 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be1e50-40ea-44c8-8dc6-59e36a782d2f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.807289 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 791/1599] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:50.808423 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be1e50-40ea-44c8-8dc6-59e36a782d2f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.811155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 809/1600] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:50 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:50.812130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209cc99-761a-496a-9d04-b0240ddabca2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.828945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be1e50-40ea-44c8-8dc6-59e36a782d2f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.829758 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209cc99-761a-496a-9d04-b0240ddabca2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.835395 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c171f-3396-4e42-b6d8-6a3754060a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.836355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c171f-3396-4e42-b6d8-6a3754060a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.836554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b073061-b3cb-4a3f-b555-d1740c14dd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.837129 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c171f-3396-4e42-b6d8-6a3754060a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.837844 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b073061-b3cb-4a3f-b555-d1740c14dd3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.838112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b073061-b3cb-4a3f-b555-d1740c14dd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.838429 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b073061-b3cb-4a3f-b555-d1740c14dd3e admin admin] PATH_INFO: `/v3/projects/5906d2c426ee4d0e9477bfa878bc0c08/users/706a7628801749c490d34e4ce9076f33/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.838861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c171f-3396-4e42-b6d8-6a3754060a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.839742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c171f-3396-4e42-b6d8-6a3754060a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.841703 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c171f-3396-4e42-b6d8-6a3754060a7c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.852725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 792/1601] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:50.854335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c171f-3396-4e42-b6d8-6a3754060a7c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.863959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b073061-b3cb-4a3f-b555-d1740c14dd3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5906d2c426ee4d0e9477bfa878bc0c08, user_id=706a7628801749c490d34e4ce9076f33, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.867525 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b073061-b3cb-4a3f-b555-d1740c14dd3e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.875034 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c171f-3396-4e42-b6d8-6a3754060a7c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:50.886529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f17958-6ea8-4a6e-87b3-9e5a51c069a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:50.887214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f17958-6ea8-4a6e-87b3-9e5a51c069a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.887491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f17958-6ea8-4a6e-87b3-9e5a51c069a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.887761 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f17958-6ea8-4a6e-87b3-9e5a51c069a4 admin admin] PATH_INFO: `/v3/projects/3241c7228b4a4b699c72f98ddfbbf7c5/users/711f9b1b972b4b74ade8b649d9b8a39a/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.890885 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 810/1602] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:08:50 2022] PUT /identity/v3/projects/5906d2c426ee4d0e9477bfa878bc0c08/users/706a7628801749c490d34e4ce9076f33/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:50.892325 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b073061-b3cb-4a3f-b555-d1740c14dd3e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:50.915068 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f17958-6ea8-4a6e-87b3-9e5a51c069a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3241c7228b4a4b699c72f98ddfbbf7c5, user_id=711f9b1b972b4b74ade8b649d9b8a39a, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:50.918020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f17958-6ea8-4a6e-87b3-9e5a51c069a4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:50.940320 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 793/1603] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:08:50 2022] PUT /identity/v3/projects/3241c7228b4a4b699c72f98ddfbbf7c5/users/711f9b1b972b4b74ade8b649d9b8a39a/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:50.941440 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7e6a4-8905-4524-9e3c-bbc1f6c71941 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:50.941729 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7e6a4-8905-4524-9e3c-bbc1f6c71941 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:50.941962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7e6a4-8905-4524-9e3c-bbc1f6c71941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:50.963407 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-dbf7e6a4-8905-4524-9e3c-bbc1f6c71941 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:50.964804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dbf7e6a4-8905-4524-9e3c-bbc1f6c71941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:50.986658 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b073061-b3cb-4a3f-b555-d1740c14dd3e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:51.039871 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 794/1604] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:51.040431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7e6a4-8905-4524-9e3c-bbc1f6c71941 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:51.051573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7e6a4-8905-4524-9e3c-bbc1f6c71941 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:51.057443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b34fb9-2bac-4bfd-9e03-cf382830a92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:51.058125 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b34fb9-2bac-4bfd-9e03-cf382830a92a admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:51.058605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b34fb9-2bac-4bfd-9e03-cf382830a92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:51.058877 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b34fb9-2bac-4bfd-9e03-cf382830a92a admin admin] PATH_INFO: `/v3/projects/de6c1217e3c1451da9191d0d9d0065c1/users/4fc757089f7845bebcbea574dc61bbac/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:51.064011 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:51.079639 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b34fb9-2bac-4bfd-9e03-cf382830a92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=de6c1217e3c1451da9191d0d9d0065c1, user_id=4fc757089f7845bebcbea574dc61bbac, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:51.082947 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b34fb9-2bac-4bfd-9e03-cf382830a92a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:51.094379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1e728-06cf-4825-9299-8c479b3cc7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:51.095943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1e728-06cf-4825-9299-8c479b3cc7df admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:51.096224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1e728-06cf-4825-9299-8c479b3cc7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:51.099625 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1e728-06cf-4825-9299-8c479b3cc7df admin admin] PATH_INFO: `/v3/projects/f58cec8f7a8e4f9d9fa0af4eac9540f6/users/4c652bdbf6fb432eb25b6be62b5b5077/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:51.103559 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 795/1605] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:08:51 2022] PUT /identity/v3/projects/de6c1217e3c1451da9191d0d9d0065c1/users/4fc757089f7845bebcbea574dc61bbac/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:51.104891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b34fb9-2bac-4bfd-9e03-cf382830a92a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:51.131522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1e728-06cf-4825-9299-8c479b3cc7df admin admin] RBAC: Authorizing `identity:create_grant(project_id=f58cec8f7a8e4f9d9fa0af4eac9540f6, user_id=4c652bdbf6fb432eb25b6be62b5b5077, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:51.136224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1e728-06cf-4825-9299-8c479b3cc7df admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:51.160729 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 811/1606] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:08:50 2022] PUT /identity/v3/projects/f58cec8f7a8e4f9d9fa0af4eac9540f6/users/4c652bdbf6fb432eb25b6be62b5b5077/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:51.161644 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1e728-06cf-4825-9299-8c479b3cc7df admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:51.203705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:51.214595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b34fb9-2bac-4bfd-9e03-cf382830a92a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:51.274005 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1e728-06cf-4825-9299-8c479b3cc7df admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:51.284819 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b56f8-21b4-489c-84d4-558d3144edb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:51.285663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b56f8-21b4-489c-84d4-558d3144edb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:51.286648 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b56f8-21b4-489c-84d4-558d3144edb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:51.286997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b56f8-21b4-489c-84d4-558d3144edb7 admin admin] PATH_INFO: `/v3/projects/1d57da5185404e4d991960f56a10323f/users/86b1015b309e4b06b21269892fbc8287/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:51.288149 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc234b6-598e-4db8-9a18-cde4d4153b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:51.288885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc234b6-598e-4db8-9a18-cde4d4153b77 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:51.289230 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc234b6-598e-4db8-9a18-cde4d4153b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:51.289627 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc234b6-598e-4db8-9a18-cde4d4153b77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:51.291063 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc234b6-598e-4db8-9a18-cde4d4153b77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:51.294049 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc234b6-598e-4db8-9a18-cde4d4153b77 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:51.315153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b56f8-21b4-489c-84d4-558d3144edb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d57da5185404e4d991960f56a10323f, user_id=86b1015b309e4b06b21269892fbc8287, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:51.318143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b56f8-21b4-489c-84d4-558d3144edb7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:51.334454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 796/1607] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:08:51 2022] POST /identity/v3/projects => generated 403 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:51.336623 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92869a67-d5f9-45fb-b19d-43be672ff945 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:51.336972 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92869a67-d5f9-45fb-b19d-43be672ff945 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:51.337458 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92869a67-d5f9-45fb-b19d-43be672ff945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:51.347193 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 812/1608] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:08:51 2022] PUT /identity/v3/projects/1d57da5185404e4d991960f56a10323f/users/86b1015b309e4b06b21269892fbc8287/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:51.349027 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578d0c7-6a37-4bb7-a85e-93d342baf0fd None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:51.349446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578d0c7-6a37-4bb7-a85e-93d342baf0fd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:51.349720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578d0c7-6a37-4bb7-a85e-93d342baf0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:51.372628 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-92869a67-d5f9-45fb-b19d-43be672ff945 None None] MFA Rules not processed for user `706a7628801749c490d34e4ce9076f33`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:51.373992 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-92869a67-d5f9-45fb-b19d-43be672ff945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:51.388867 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c578d0c7-6a37-4bb7-a85e-93d342baf0fd None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:51.391680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c578d0c7-6a37-4bb7-a85e-93d342baf0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:51.453917 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 797/1609] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:51.454874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92869a67-d5f9-45fb-b19d-43be672ff945 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:51.466079 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:51.521417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 813/1610] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:51.522760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0817f-f2ce-4457-995d-9f0bdcf0aa83 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:51.523188 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0817f-f2ce-4457-995d-9f0bdcf0aa83 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:51.524126 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0817f-f2ce-4457-995d-9f0bdcf0aa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:51.528782 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92869a67-d5f9-45fb-b19d-43be672ff945 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:51.533213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c473bb8-5a8e-4446-a419-8b01de153324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:51.533786 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c473bb8-5a8e-4446-a419-8b01de153324 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:51.534065 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c473bb8-5a8e-4446-a419-8b01de153324 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:51.534336 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c473bb8-5a8e-4446-a419-8b01de153324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:51.545743 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c473bb8-5a8e-4446-a419-8b01de153324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:51.547367 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c473bb8-5a8e-4446-a419-8b01de153324 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:51.559604 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 798/1611] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:08:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:08:51.560947 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dbca5-0fe5-421d-8f6c-d5bcc2d2231f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:51.561221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dbca5-0fe5-421d-8f6c-d5bcc2d2231f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:51.561498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dbca5-0fe5-421d-8f6c-d5bcc2d2231f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:51.584949 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0bb0817f-f2ce-4457-995d-9f0bdcf0aa83 None None] MFA Rules not processed for user `4fc757089f7845bebcbea574dc61bbac`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:51.586289 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0bb0817f-f2ce-4457-995d-9f0bdcf0aa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:51.591585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-706dbca5-0fe5-421d-8f6c-d5bcc2d2231f None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:51.594711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-706dbca5-0fe5-421d-8f6c-d5bcc2d2231f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:51.613334 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 799/1612] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:51.613334 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706dbca5-0fe5-421d-8f6c-d5bcc2d2231f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:51.630541 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706dbca5-0fe5-421d-8f6c-d5bcc2d2231f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:51.636214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d601e-8efb-46e1-95cd-45595ba76888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:51.637025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d601e-8efb-46e1-95cd-45595ba76888 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:51.637168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d601e-8efb-46e1-95cd-45595ba76888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:51.637353 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d601e-8efb-46e1-95cd-45595ba76888 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:51.637979 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d601e-8efb-46e1-95cd-45595ba76888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:51.640050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d601e-8efb-46e1-95cd-45595ba76888 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:51.682157 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 800/1613] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:08:51 2022] POST /identity/v3/users => generated 308 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:51.683466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fdfb4-2235-4e5a-bbcf-65ced7bd1bf7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:51.683750 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fdfb4-2235-4e5a-bbcf-65ced7bd1bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:51.684024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fdfb4-2235-4e5a-bbcf-65ced7bd1bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:51.709156 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7d5fdfb4-2235-4e5a-bbcf-65ced7bd1bf7 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:51.710501 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7d5fdfb4-2235-4e5a-bbcf-65ced7bd1bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:51.720215 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 801/1614] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:51.721648 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23021d71-ad14-4150-b503-5c3c01812fdf None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:51.721760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23021d71-ad14-4150-b503-5c3c01812fdf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:51.721946 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23021d71-ad14-4150-b503-5c3c01812fdf None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:51.723294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 802/1615] 10.222.0.40 () {54 vars in 962 bytes} [Tue Aug 9 07:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:08:51.728988 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23021d71-ad14-4150-b503-5c3c01812fdf None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:51.732883 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 814/1616] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:51.733875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0817f-f2ce-4457-995d-9f0bdcf0aa83 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:51.738181 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0bb0817f-f2ce-4457-995d-9f0bdcf0aa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:51.818312 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23021d71-ad14-4150-b503-5c3c01812fdf None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:51.818575 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0817f-f2ce-4457-995d-9f0bdcf0aa83 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:51.818667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f8d45-d55b-4029-a130-008cb0fa36d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:51.818667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f8d45-d55b-4029-a130-008cb0fa36d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:51.818667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f8d45-d55b-4029-a130-008cb0fa36d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:51.818667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f8d45-d55b-4029-a130-008cb0fa36d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:51.818965 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039b8b8-052b-4262-aefa-2017765b77f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:51.818965 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039b8b8-052b-4262-aefa-2017765b77f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:51.818965 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039b8b8-052b-4262-aefa-2017765b77f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:51.818965 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039b8b8-052b-4262-aefa-2017765b77f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:51.819306 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f8d45-d55b-4029-a130-008cb0fa36d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:51.819392 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039b8b8-052b-4262-aefa-2017765b77f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:51.819479 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f8d45-d55b-4029-a130-008cb0fa36d4 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:51.819555 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039b8b8-052b-4262-aefa-2017765b77f9 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:51.819555 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 815/1617] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:08:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:08:51.819555 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039b8b8-052b-4262-aefa-2017765b77f9 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:51.819770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 803/1618] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:08:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:08:51.819770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a01e0e-064b-4b4d-9a5f-a1fab3068b28 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:51.819770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a01e0e-064b-4b4d-9a5f-a1fab3068b28 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:51.819770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a01e0e-064b-4b4d-9a5f-a1fab3068b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:51.835635 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039b8b8-052b-4262-aefa-2017765b77f9 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:51.859331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d32982-0f3e-4ea3-b8bb-3fc1a16db17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:51.860466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d32982-0f3e-4ea3-b8bb-3fc1a16db17b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:51.861039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d32982-0f3e-4ea3-b8bb-3fc1a16db17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:51.861518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d32982-0f3e-4ea3-b8bb-3fc1a16db17b admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:51.862449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d32982-0f3e-4ea3-b8bb-3fc1a16db17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:51.865006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d32982-0f3e-4ea3-b8bb-3fc1a16db17b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:51.882433 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 816/1619] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:51.883614 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d32982-0f3e-4ea3-b8bb-3fc1a16db17b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:51.905273 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d32982-0f3e-4ea3-b8bb-3fc1a16db17b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:51.917935 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c0df3-4185-4cfe-883e-a62906040493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:51.918688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c0df3-4185-4cfe-883e-a62906040493 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:51.920150 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c0df3-4185-4cfe-883e-a62906040493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:51.920511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c0df3-4185-4cfe-883e-a62906040493 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:51.922273 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c0df3-4185-4cfe-883e-a62906040493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:51.926705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c0df3-4185-4cfe-883e-a62906040493 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:51.939134 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-23a01e0e-064b-4b4d-9a5f-a1fab3068b28 None None] MFA Rules not processed for user `6e949d9666be44a0b6122d510168c7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:51.941054 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-23a01e0e-064b-4b4d-9a5f-a1fab3068b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:51.983979 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:51.994621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 817/1620] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:08:51 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:51.999050 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c0df3-4185-4cfe-883e-a62906040493 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:52.104110 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 804/1621] 10.222.0.40 () {58 vars in 1059 bytes} [Tue Aug 9 07:08:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:52.105540 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a01e0e-064b-4b4d-9a5f-a1fab3068b28 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:52.109471 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c0df3-4185-4cfe-883e-a62906040493 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:52.117573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a01e0e-064b-4b4d-9a5f-a1fab3068b28 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:52.117967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff477264-5e2b-483e-95ef-cc52ebf34e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:52.119474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff477264-5e2b-483e-95ef-cc52ebf34e7b service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:52.119995 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff477264-5e2b-483e-95ef-cc52ebf34e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:52.120931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff477264-5e2b-483e-95ef-cc52ebf34e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:52.186714 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:52.234006 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855ffbd-1bd9-4474-9938-14432a7ae5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:52.235606 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855ffbd-1bd9-4474-9938-14432a7ae5ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:52.236595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855ffbd-1bd9-4474-9938-14432a7ae5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:52.237315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855ffbd-1bd9-4474-9938-14432a7ae5ef admin admin] PATH_INFO: `/v3/projects/1dac5c5124244bdfaf3a8f387c7d09cf/users/ebd6c828c99a4ad3bd681daba4b5f3bb/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:52.247528 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff477264-5e2b-483e-95ef-cc52ebf34e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:52.248954 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff477264-5e2b-483e-95ef-cc52ebf34e7b service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:52.264258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855ffbd-1bd9-4474-9938-14432a7ae5ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dac5c5124244bdfaf3a8f387c7d09cf, user_id=ebd6c828c99a4ad3bd681daba4b5f3bb, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:52.265452 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 818/1622] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:08:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:08:52.266463 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff477264-5e2b-483e-95ef-cc52ebf34e7b service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:52.267646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855ffbd-1bd9-4474-9938-14432a7ae5ef admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:52.277468 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff477264-5e2b-483e-95ef-cc52ebf34e7b service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:52.291481 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 805/1623] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:08:52 2022] PUT /identity/v3/projects/1dac5c5124244bdfaf3a8f387c7d09cf/users/ebd6c828c99a4ad3bd681daba4b5f3bb/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:52.292911 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855ffbd-1bd9-4474-9938-14432a7ae5ef admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:52.351680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c860f9c-72c6-4d22-b86d-2f08135c9b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:52.352397 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c860f9c-72c6-4d22-b86d-2f08135c9b4f admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:52.352787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c860f9c-72c6-4d22-b86d-2f08135c9b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:52.353371 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c860f9c-72c6-4d22-b86d-2f08135c9b4f admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:52.354221 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c860f9c-72c6-4d22-b86d-2f08135c9b4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:52.359050 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c860f9c-72c6-4d22-b86d-2f08135c9b4f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:52.391091 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 819/1624] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:08:52 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:52.391091 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c860f9c-72c6-4d22-b86d-2f08135c9b4f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:52.404714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c860f9c-72c6-4d22-b86d-2f08135c9b4f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:52.411292 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1054b-62f0-42ff-9dc3-b355501b166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:52.412687 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1054b-62f0-42ff-9dc3-b355501b166e admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:52.413060 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1054b-62f0-42ff-9dc3-b355501b166e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:52.413544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1054b-62f0-42ff-9dc3-b355501b166e admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:52.414337 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1054b-62f0-42ff-9dc3-b355501b166e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:52.416277 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1054b-62f0-42ff-9dc3-b355501b166e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:52.417937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855ffbd-1bd9-4474-9938-14432a7ae5ef admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:52.429401 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 820/1625] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:52.430627 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1054b-62f0-42ff-9dc3-b355501b166e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:52.441541 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c721c-90f9-4a10-881c-c5533b3b157d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:52.445460 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1054b-62f0-42ff-9dc3-b355501b166e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:52.448641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c721c-90f9-4a10-881c-c5533b3b157d service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:52.449607 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c721c-90f9-4a10-881c-c5533b3b157d service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:52.451446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee813571-bbbb-4520-8843-f9097ac0e362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:52.452149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee813571-bbbb-4520-8843-f9097ac0e362 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:52.452567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee813571-bbbb-4520-8843-f9097ac0e362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:52.453007 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee813571-bbbb-4520-8843-f9097ac0e362 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:52.453317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c721c-90f9-4a10-881c-c5533b3b157d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:52.453830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee813571-bbbb-4520-8843-f9097ac0e362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:52.455646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee813571-bbbb-4520-8843-f9097ac0e362 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:52.469222 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 821/1626] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:52.470315 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee813571-bbbb-4520-8843-f9097ac0e362 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:52.500059 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee813571-bbbb-4520-8843-f9097ac0e362 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:52.520572 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5db8d-e917-4335-be65-6810d6bef126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:52.523865 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5db8d-e917-4335-be65-6810d6bef126 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:52.524509 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5db8d-e917-4335-be65-6810d6bef126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:52.524609 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5db8d-e917-4335-be65-6810d6bef126 admin admin] PATH_INFO: `/v3/projects/1dac5c5124244bdfaf3a8f387c7d09cf/users/ebd6c828c99a4ad3bd681daba4b5f3bb/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:52.528437 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5db8d-e917-4335-be65-6810d6bef126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dac5c5124244bdfaf3a8f387c7d09cf, user_id=ebd6c828c99a4ad3bd681daba4b5f3bb, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:52.535392 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5db8d-e917-4335-be65-6810d6bef126 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:52.560038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 822/1627] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:08:52 2022] PUT /identity/v3/projects/1dac5c5124244bdfaf3a8f387c7d09cf/users/ebd6c828c99a4ad3bd681daba4b5f3bb/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:52.561205 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5db8d-e917-4335-be65-6810d6bef126 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:52.578647 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:52.637295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c721c-90f9-4a10-881c-c5533b3b157d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:52.642569 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c721c-90f9-4a10-881c-c5533b3b157d service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:52.674211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 806/1628] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:08:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:08:52.677768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854789d3-2542-4df9-8d9b-fac9cb544cb9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:52.678390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854789d3-2542-4df9-8d9b-fac9cb544cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:52.679379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854789d3-2542-4df9-8d9b-fac9cb544cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:52.717559 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5db8d-e917-4335-be65-6810d6bef126 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:52.726003 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e99254-f26e-40c2-a0d1-f303ea49d0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:52.726870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e99254-f26e-40c2-a0d1-f303ea49d0b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:52.727344 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e99254-f26e-40c2-a0d1-f303ea49d0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:52.727726 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e99254-f26e-40c2-a0d1-f303ea49d0b3 admin admin] PATH_INFO: `/v3/projects/7d17f131fb9045c48148a0a722ca1e94/users/80a636ad9e484f419206729faa041f72/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:52.758548 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-854789d3-2542-4df9-8d9b-fac9cb544cb9 None None] MFA Rules not processed for user `ebd6c828c99a4ad3bd681daba4b5f3bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:52.762362 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-854789d3-2542-4df9-8d9b-fac9cb544cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:52.769318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e99254-f26e-40c2-a0d1-f303ea49d0b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d17f131fb9045c48148a0a722ca1e94, user_id=80a636ad9e484f419206729faa041f72, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:52.773600 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e99254-f26e-40c2-a0d1-f303ea49d0b3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:52.802676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 823/1629] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:08:52 2022] PUT /identity/v3/projects/7d17f131fb9045c48148a0a722ca1e94/users/80a636ad9e484f419206729faa041f72/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:52.807808 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e99254-f26e-40c2-a0d1-f303ea49d0b3 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:52.941043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:52.991025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 807/1630] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:52 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:52.999755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e99254-f26e-40c2-a0d1-f303ea49d0b3 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:53.004197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854789d3-2542-4df9-8d9b-fac9cb544cb9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:53.020208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110f021-0013-4ae3-b545-9c45da6019cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:53.021147 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110f021-0013-4ae3-b545-9c45da6019cb admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:53.022639 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110f021-0013-4ae3-b545-9c45da6019cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:53.023614 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110f021-0013-4ae3-b545-9c45da6019cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:53.026936 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110f021-0013-4ae3-b545-9c45da6019cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:53.028685 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110f021-0013-4ae3-b545-9c45da6019cb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:53.053965 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 824/1631] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:53.057242 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110f021-0013-4ae3-b545-9c45da6019cb admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:53.090227 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110f021-0013-4ae3-b545-9c45da6019cb admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:53.093776 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730e95e-0e19-47b0-8a60-9f697c6264db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:53.096192 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730e95e-0e19-47b0-8a60-9f697c6264db admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:53.096568 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730e95e-0e19-47b0-8a60-9f697c6264db admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:53.097715 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730e95e-0e19-47b0-8a60-9f697c6264db admin admin] PATH_INFO: `/v3/projects/7d17f131fb9045c48148a0a722ca1e94/users/80a636ad9e484f419206729faa041f72/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:53.100580 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730e95e-0e19-47b0-8a60-9f697c6264db admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d17f131fb9045c48148a0a722ca1e94, user_id=80a636ad9e484f419206729faa041f72, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:53.104685 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730e95e-0e19-47b0-8a60-9f697c6264db admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:53.117391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854789d3-2542-4df9-8d9b-fac9cb544cb9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:53.126252 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 825/1632] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:08:53 2022] PUT /identity/v3/projects/7d17f131fb9045c48148a0a722ca1e94/users/80a636ad9e484f419206729faa041f72/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:53.127895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3072d-f2cf-4dc3-9856-4e21ccc9bdb5 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:53.128246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3072d-f2cf-4dc3-9856-4e21ccc9bdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:53.128603 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3072d-f2cf-4dc3-9856-4e21ccc9bdb5 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:53.131426 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 826/1633] 10.222.0.40 () {54 vars in 912 bytes} [Tue Aug 9 07:08:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:08:53.138748 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53935e87-1a69-42a0-8b6b-eace619d7cff None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:53.139554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53935e87-1a69-42a0-8b6b-eace619d7cff None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:53.139939 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53935e87-1a69-42a0-8b6b-eace619d7cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:53.184248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-53935e87-1a69-42a0-8b6b-eace619d7cff None None] MFA Rules not processed for user `80a636ad9e484f419206729faa041f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:53.185860 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-53935e87-1a69-42a0-8b6b-eace619d7cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:53.189726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6699ae6-c435-4020-a949-f26989bef7ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:53.190480 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6699ae6-c435-4020-a949-f26989bef7ed service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:53.190900 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6699ae6-c435-4020-a949-f26989bef7ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:53.191406 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6699ae6-c435-4020-a949-f26989bef7ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:53.261741 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6699ae6-c435-4020-a949-f26989bef7ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:53.263510 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6699ae6-c435-4020-a949-f26989bef7ed service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:53.266592 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:53.282971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 808/1634] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:08:53 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:08:53.286125 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aa0a8-1934-48f5-8683-d8460fad1f27 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:53.286388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aa0a8-1934-48f5-8683-d8460fad1f27 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:53.286594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aa0a8-1934-48f5-8683-d8460fad1f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:53.320774 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 827/1635] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:53.322572 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53935e87-1a69-42a0-8b6b-eace619d7cff None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:53.342030 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ca1aa0a8-1934-48f5-8683-d8460fad1f27 None None] MFA Rules not processed for user `6e949d9666be44a0b6122d510168c7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:53.343739 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53935e87-1a69-42a0-8b6b-eace619d7cff None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:53.345170 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ca1aa0a8-1934-48f5-8683-d8460fad1f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:53.363228 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aea08c-c774-4587-9f74-5171df2ef98e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:53.364333 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aea08c-c774-4587-9f74-5171df2ef98e service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:53.364615 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aea08c-c774-4587-9f74-5171df2ef98e service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:53.364927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aea08c-c774-4587-9f74-5171df2ef98e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:53.401903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aea08c-c774-4587-9f74-5171df2ef98e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:53.404196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aea08c-c774-4587-9f74-5171df2ef98e service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:53.426276 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 828/1636] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:08:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:08:53.472686 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:53.523497 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 809/1637] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Aug 9 07:08:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:53.587735 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aea08c-c774-4587-9f74-5171df2ef98e service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:53.599629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aa0a8-1934-48f5-8683-d8460fad1f27 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:53.627003 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aa0a8-1934-48f5-8683-d8460fad1f27 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:53.631811 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb6d10-acd5-42d4-9a33-4ae8aaa816fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:53.632645 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb6d10-acd5-42d4-9a33-4ae8aaa816fd service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:53.635001 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb6d10-acd5-42d4-9a33-4ae8aaa816fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:53.635587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb6d10-acd5-42d4-9a33-4ae8aaa816fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:53.685315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb6d10-acd5-42d4-9a33-4ae8aaa816fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:53.686784 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb6d10-acd5-42d4-9a33-4ae8aaa816fd service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:53.700039 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 810/1638] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:08:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:08:53.701850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb6d10-acd5-42d4-9a33-4ae8aaa816fd service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:53.715566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb6d10-acd5-42d4-9a33-4ae8aaa816fd service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:53.725574 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74893b14-5ddd-4e6c-a9d0-018b0e84d32e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:53.726526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74893b14-5ddd-4e6c-a9d0-018b0e84d32e service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:53.727697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74893b14-5ddd-4e6c-a9d0-018b0e84d32e service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:53.728502 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74893b14-5ddd-4e6c-a9d0-018b0e84d32e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:53.781809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aea08c-c774-4587-9f74-5171df2ef98e service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:53.794537 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dad22-4a46-4c83-8178-c959e860749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:53.795225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dad22-4a46-4c83-8178-c959e860749e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:53.795513 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dad22-4a46-4c83-8178-c959e860749e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:53.795788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dad22-4a46-4c83-8178-c959e860749e admin admin] PATH_INFO: `/v3/users/df0004375b95482fa5d05f17ed9e0632` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:53.800707 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dad22-4a46-4c83-8178-c959e860749e admin admin] RBAC: Authorizing `identity:delete_user(user_id=df0004375b95482fa5d05f17ed9e0632)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:53.804204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dad22-4a46-4c83-8178-c959e860749e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:53.862989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74893b14-5ddd-4e6c-a9d0-018b0e84d32e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:53.864723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74893b14-5ddd-4e6c-a9d0-018b0e84d32e service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:53.889280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 811/1639] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:08:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:08:53.920721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e32dad22-4a46-4c83-8178-c959e860749e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df0004375b95482fa5d05f17ed9e0632'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:53.941662 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e32dad22-4a46-4c83-8178-c959e860749e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df0004375b95482fa5d05f17ed9e0632'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:53.942722 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e32dad22-4a46-4c83-8178-c959e860749e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df0004375b95482fa5d05f17ed9e0632'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:53.985440 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e32dad22-4a46-4c83-8178-c959e860749e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df0004375b95482fa5d05f17ed9e0632'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:54.003850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e32dad22-4a46-4c83-8178-c959e860749e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df0004375b95482fa5d05f17ed9e0632'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:54.016556 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 829/1640] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:08:53 2022] DELETE /identity/v3/users/df0004375b95482fa5d05f17ed9e0632 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:54.021285 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f56df-9c79-43af-ae11-64588148f8bc None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:54.021588 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f56df-9c79-43af-ae11-64588148f8bc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:54.021849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f56df-9c79-43af-ae11-64588148f8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:54.063324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-322f56df-9c79-43af-ae11-64588148f8bc None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:54.063796 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-322f56df-9c79-43af-ae11-64588148f8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:54.185884 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 812/1641] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:54.194280 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dad22-4a46-4c83-8178-c959e860749e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:54.195811 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e32dad22-4a46-4c83-8178-c959e860749e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:54.299682 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b8bc-1f44-4e18-bea2-9d56844db608 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:54.299968 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b8bc-1f44-4e18-bea2-9d56844db608 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:54.300262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b8bc-1f44-4e18-bea2-9d56844db608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:54.340027 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dad22-4a46-4c83-8178-c959e860749e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:54.350114 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1878b8bc-1f44-4e18-bea2-9d56844db608 None None] MFA Rules not processed for user `711f9b1b972b4b74ade8b649d9b8a39a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:54.351419 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1878b8bc-1f44-4e18-bea2-9d56844db608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:54.353368 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268de29a-b87d-40f9-bad7-867b39109d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:54.354279 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268de29a-b87d-40f9-bad7-867b39109d6a service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:54.355310 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268de29a-b87d-40f9-bad7-867b39109d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:54.355596 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268de29a-b87d-40f9-bad7-867b39109d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:54.385225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268de29a-b87d-40f9-bad7-867b39109d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:54.386883 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268de29a-b87d-40f9-bad7-867b39109d6a service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:54.420499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 830/1642] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:08:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:08:54.505068 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 813/1643] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:54 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:08:54.507357 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268de29a-b87d-40f9-bad7-867b39109d6a service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:54.508939 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-268de29a-b87d-40f9-bad7-867b39109d6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:54.528418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:54.553545 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268de29a-b87d-40f9-bad7-867b39109d6a service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:54.567952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43609de-866a-473f-84c9-5c03ea247d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:54.569027 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43609de-866a-473f-84c9-5c03ea247d4e admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:54.569236 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43609de-866a-473f-84c9-5c03ea247d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:54.569561 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43609de-866a-473f-84c9-5c03ea247d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:54.570210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43609de-866a-473f-84c9-5c03ea247d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:54.573328 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43609de-866a-473f-84c9-5c03ea247d4e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:54.630920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 831/1644] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:08:54 2022] POST /identity/v3/projects => generated 403 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:54.632283 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878b8bc-1f44-4e18-bea2-9d56844db608 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:54.639204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:54.652545 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878b8bc-1f44-4e18-bea2-9d56844db608 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:54.774332 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c3265-f1cc-478f-bcf1-2bbf55e1d8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:54.775252 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c3265-f1cc-478f-bcf1-2bbf55e1d8ef admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:54.775713 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c3265-f1cc-478f-bcf1-2bbf55e1d8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:54.776153 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c3265-f1cc-478f-bcf1-2bbf55e1d8ef admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:54.776776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c3265-f1cc-478f-bcf1-2bbf55e1d8ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:54.778828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c3265-f1cc-478f-bcf1-2bbf55e1d8ef admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:54.832317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 814/1645] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:08:54 2022] POST /identity/v3/users => generated 308 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:54.833518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43609de-866a-473f-84c9-5c03ea247d4e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:54.863310 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43609de-866a-473f-84c9-5c03ea247d4e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:54.881816 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718be58e-e932-414b-8f5e-224c4bf696f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:54.882470 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718be58e-e932-414b-8f5e-224c4bf696f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:54.882748 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718be58e-e932-414b-8f5e-224c4bf696f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:54.883194 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718be58e-e932-414b-8f5e-224c4bf696f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:54.887245 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718be58e-e932-414b-8f5e-224c4bf696f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:54.892902 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718be58e-e932-414b-8f5e-224c4bf696f0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:54.930166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 832/1646] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:54.934467 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c3265-f1cc-478f-bcf1-2bbf55e1d8ef admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:54.947888 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c3265-f1cc-478f-bcf1-2bbf55e1d8ef admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:54.969725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817d10e-638d-4393-be8e-0da8e8a814b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:54.972724 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817d10e-638d-4393-be8e-0da8e8a814b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:54.974928 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817d10e-638d-4393-be8e-0da8e8a814b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:54.975514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817d10e-638d-4393-be8e-0da8e8a814b3 admin admin] PATH_INFO: `/v3/projects/cc5807d9d1164d319dbe151733b27432/users/a0ab57f6373b4dd2a689cc9b2463f9ac/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:55.014312 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817d10e-638d-4393-be8e-0da8e8a814b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5807d9d1164d319dbe151733b27432, user_id=a0ab57f6373b4dd2a689cc9b2463f9ac, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:55.029784 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817d10e-638d-4393-be8e-0da8e8a814b3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:55.058977 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 815/1647] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:08:54 2022] PUT /identity/v3/projects/cc5807d9d1164d319dbe151733b27432/users/a0ab57f6373b4dd2a689cc9b2463f9ac/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:55.063116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718be58e-e932-414b-8f5e-224c4bf696f0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:55.077241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718be58e-e932-414b-8f5e-224c4bf696f0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:55.105012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817d10e-638d-4393-be8e-0da8e8a814b3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:55.107228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b817d10e-638d-4393-be8e-0da8e8a814b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:55.185726 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987cc72-e524-474a-b084-6c076a265a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:55.187443 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987cc72-e524-474a-b084-6c076a265a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:55.187978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987cc72-e524-474a-b084-6c076a265a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:55.188635 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987cc72-e524-474a-b084-6c076a265a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:55.189997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987cc72-e524-474a-b084-6c076a265a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:55.192323 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987cc72-e524-474a-b084-6c076a265a2b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:55.206553 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 833/1648] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:55.210430 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987cc72-e524-474a-b084-6c076a265a2b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:55.222668 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987cc72-e524-474a-b084-6c076a265a2b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:55.227620 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea198b2-3c12-4eb2-be64-2dd002ea6e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:55.228423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea198b2-3c12-4eb2-be64-2dd002ea6e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:55.228423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea198b2-3c12-4eb2-be64-2dd002ea6e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:55.229047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea198b2-3c12-4eb2-be64-2dd002ea6e4c admin admin] PATH_INFO: `/v3/projects/cc5807d9d1164d319dbe151733b27432/users/a0ab57f6373b4dd2a689cc9b2463f9ac/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:55.231329 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea198b2-3c12-4eb2-be64-2dd002ea6e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5807d9d1164d319dbe151733b27432, user_id=a0ab57f6373b4dd2a689cc9b2463f9ac, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:55.234101 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea198b2-3c12-4eb2-be64-2dd002ea6e4c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:55.250479 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 834/1649] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:08:55 2022] PUT /identity/v3/projects/cc5807d9d1164d319dbe151733b27432/users/a0ab57f6373b4dd2a689cc9b2463f9ac/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:08:55.265078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817d10e-638d-4393-be8e-0da8e8a814b3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:55.336260 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e84a5-1e48-4d82-bcce-8af4a4d64863 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:55.336611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e84a5-1e48-4d82-bcce-8af4a4d64863 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:55.336799 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e84a5-1e48-4d82-bcce-8af4a4d64863 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:55.340153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 835/1650] 10.222.0.40 () {54 vars in 962 bytes} [Tue Aug 9 07:08:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:08:55.353941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6109365-0958-4465-a318-be657fe11224 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:55.354284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6109365-0958-4465-a318-be657fe11224 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:55.355912 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6109365-0958-4465-a318-be657fe11224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:55.424623 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c6109365-0958-4465-a318-be657fe11224 None None] MFA Rules not processed for user `6e949d9666be44a0b6122d510168c7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:55.443553 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c6109365-0958-4465-a318-be657fe11224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:55.448116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d55534-71d4-473c-90be-e2c4bb2e01de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:55.448813 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d55534-71d4-473c-90be-e2c4bb2e01de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:55.452247 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d55534-71d4-473c-90be-e2c4bb2e01de admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:55.453294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d55534-71d4-473c-90be-e2c4bb2e01de admin admin] PATH_INFO: `/v3/projects/a1482db1de4445468883cf5079e29f9d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:55.455850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d55534-71d4-473c-90be-e2c4bb2e01de admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1482db1de4445468883cf5079e29f9d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:55.466381 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d55534-71d4-473c-90be-e2c4bb2e01de admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:55.537065 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:55.626854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-25d55534-71d4-473c-90be-e2c4bb2e01de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1482db1de4445468883cf5079e29f9d', 'request_id': 'req-25d55534-71d4-473c-90be-e2c4bb2e01de'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:55.634717 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-25d55534-71d4-473c-90be-e2c4bb2e01de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1482db1de4445468883cf5079e29f9d', 'request_id': 'req-25d55534-71d4-473c-90be-e2c4bb2e01de'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:55.644338 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-25d55534-71d4-473c-90be-e2c4bb2e01de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1482db1de4445468883cf5079e29f9d', 'request_id': 'req-25d55534-71d4-473c-90be-e2c4bb2e01de'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:55.670238 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-25d55534-71d4-473c-90be-e2c4bb2e01de admin admin] The token cache is being invalidate because project a1482db1de4445468883cf5079e29f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:08:55.670615 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-25d55534-71d4-473c-90be-e2c4bb2e01de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:55.671367 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-25d55534-71d4-473c-90be-e2c4bb2e01de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:55.675482 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 816/1651] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:08:55 2022] DELETE /identity/v3/projects/a1482db1de4445468883cf5079e29f9d => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:55.678627 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d55534-71d4-473c-90be-e2c4bb2e01de admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:55.680490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-25d55534-71d4-473c-90be-e2c4bb2e01de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:55.682362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 836/1652] 10.222.0.40 () {58 vars in 1059 bytes} [Tue Aug 9 07:08:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:55.688298 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652110da-3711-468d-b5e3-321b2829a7d5 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:55.688585 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652110da-3711-468d-b5e3-321b2829a7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:55.688864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652110da-3711-468d-b5e3-321b2829a7d5 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:55.690653 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 837/1653] 10.222.0.40 () {54 vars in 912 bytes} [Tue Aug 9 07:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 07:08:55.695760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00e3e1-bcb3-43a5-a3d7-ef094ed4c6c4 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:55.696244 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00e3e1-bcb3-43a5-a3d7-ef094ed4c6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:55.697229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00e3e1-bcb3-43a5-a3d7-ef094ed4c6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:55.739413 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1e00e3e1-bcb3-43a5-a3d7-ef094ed4c6c4 None None] MFA Rules not processed for user `6e949d9666be44a0b6122d510168c7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:55.745005 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1e00e3e1-bcb3-43a5-a3d7-ef094ed4c6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:55.779877 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d55534-71d4-473c-90be-e2c4bb2e01de admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:55.785712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556950c7-0db2-4ec7-8f93-30c4507309cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:55.786448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556950c7-0db2-4ec7-8f93-30c4507309cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:55.786790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556950c7-0db2-4ec7-8f93-30c4507309cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:55.788436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556950c7-0db2-4ec7-8f93-30c4507309cb admin admin] PATH_INFO: `/v3/users/ebd6c828c99a4ad3bd681daba4b5f3bb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:55.790825 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556950c7-0db2-4ec7-8f93-30c4507309cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd6c828c99a4ad3bd681daba4b5f3bb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:55.792716 dv-cinder-852514-1-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-556950c7-0db2-4ec7-8f93-30c4507309cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 07:08:55.792716 dv-cinder-852514-1-smb devstack@keystone.service[80234]: warnings.warn(msg) Aug 09 07:08:55.792716 dv-cinder-852514-1-smb devstack@keystone.service[80234]: Aug 09 07:08:55.794648 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556950c7-0db2-4ec7-8f93-30c4507309cb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:55.860894 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:55.998075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-556950c7-0db2-4ec7-8f93-30c4507309cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd6c828c99a4ad3bd681daba4b5f3bb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:56.000087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-556950c7-0db2-4ec7-8f93-30c4507309cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd6c828c99a4ad3bd681daba4b5f3bb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:56.002347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-556950c7-0db2-4ec7-8f93-30c4507309cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd6c828c99a4ad3bd681daba4b5f3bb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:56.004243 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 838/1654] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Aug 9 07:08:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:08:56.027387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00e3e1-bcb3-43a5-a3d7-ef094ed4c6c4 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:56.031218 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1e00e3e1-bcb3-43a5-a3d7-ef094ed4c6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:56.054644 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-556950c7-0db2-4ec7-8f93-30c4507309cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd6c828c99a4ad3bd681daba4b5f3bb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:56.083229 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-556950c7-0db2-4ec7-8f93-30c4507309cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd6c828c99a4ad3bd681daba4b5f3bb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:56.186532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 817/1655] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:08:55 2022] DELETE /identity/v3/users/ebd6c828c99a4ad3bd681daba4b5f3bb => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:56.222639 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00e3e1-bcb3-43a5-a3d7-ef094ed4c6c4 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:56.409628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9694d3b-d4e9-488f-9235-e146a13000e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:56.410264 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9694d3b-d4e9-488f-9235-e146a13000e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:56.410539 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9694d3b-d4e9-488f-9235-e146a13000e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:56.410802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9694d3b-d4e9-488f-9235-e146a13000e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:56.420282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f9694d3b-d4e9-488f-9235-e146a13000e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:56.707858 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9694d3b-d4e9-488f-9235-e146a13000e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:56.717471 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9694d3b-d4e9-488f-9235-e146a13000e6 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:56.775562 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 839/1656] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:08:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 749 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:08:57.296023 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556950c7-0db2-4ec7-8f93-30c4507309cb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:57.298153 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-556950c7-0db2-4ec7-8f93-30c4507309cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:57.369618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:57.508076 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556950c7-0db2-4ec7-8f93-30c4507309cb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:57.522018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044b81c-a27a-4217-ba3b-411d2504a0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:57.523261 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044b81c-a27a-4217-ba3b-411d2504a0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:57.523827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044b81c-a27a-4217-ba3b-411d2504a0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:57.524285 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044b81c-a27a-4217-ba3b-411d2504a0f1 admin admin] PATH_INFO: `/v3/projects/1dac5c5124244bdfaf3a8f387c7d09cf` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:57.526816 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044b81c-a27a-4217-ba3b-411d2504a0f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dac5c5124244bdfaf3a8f387c7d09cf)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:57.531685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044b81c-a27a-4217-ba3b-411d2504a0f1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:57.597920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9694d3b-d4e9-488f-9235-e146a13000e6 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:57.599228 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f9694d3b-d4e9-488f-9235-e146a13000e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:57.640799 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9694d3b-d4e9-488f-9235-e146a13000e6 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:57.640928 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f044b81c-a27a-4217-ba3b-411d2504a0f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dac5c5124244bdfaf3a8f387c7d09cf', 'request_id': 'req-f044b81c-a27a-4217-ba3b-411d2504a0f1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:57.650674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f044b81c-a27a-4217-ba3b-411d2504a0f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dac5c5124244bdfaf3a8f387c7d09cf', 'request_id': 'req-f044b81c-a27a-4217-ba3b-411d2504a0f1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:57.668075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f044b81c-a27a-4217-ba3b-411d2504a0f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dac5c5124244bdfaf3a8f387c7d09cf', 'request_id': 'req-f044b81c-a27a-4217-ba3b-411d2504a0f1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:57.693959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f044b81c-a27a-4217-ba3b-411d2504a0f1 admin admin] The token cache is being invalidate because project 1dac5c5124244bdfaf3a8f387c7d09cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:08:57.694504 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f044b81c-a27a-4217-ba3b-411d2504a0f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:57.695382 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f044b81c-a27a-4217-ba3b-411d2504a0f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:57.698855 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 818/1657] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:08:57 2022] DELETE /identity/v3/projects/1dac5c5124244bdfaf3a8f387c7d09cf => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:57.706218 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:57.707919 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fcdef-b8ae-4a1f-9636-2e855d7cee9d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:57.708198 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fcdef-b8ae-4a1f-9636-2e855d7cee9d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:57.708509 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fcdef-b8ae-4a1f-9636-2e855d7cee9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:57.740396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a28fe5-58f3-4a5d-9d92-109135164149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:57.741846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a28fe5-58f3-4a5d-9d92-109135164149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:57.742291 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a28fe5-58f3-4a5d-9d92-109135164149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:57.742763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a28fe5-58f3-4a5d-9d92-109135164149 admin admin] PATH_INFO: `/v3/users/706a7628801749c490d34e4ce9076f33` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:57.744823 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a28fe5-58f3-4a5d-9d92-109135164149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=706a7628801749c490d34e4ce9076f33)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:57.747405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a28fe5-58f3-4a5d-9d92-109135164149 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:57.752834 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-676fcdef-b8ae-4a1f-9636-2e855d7cee9d None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:57.754087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-676fcdef-b8ae-4a1f-9636-2e855d7cee9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:57.773363 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 819/1658] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:08:57.775410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09882b7-b0f1-4395-b33d-cf75aeeadb4e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:57.775639 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09882b7-b0f1-4395-b33d-cf75aeeadb4e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:57.775930 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09882b7-b0f1-4395-b33d-cf75aeeadb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:57.812129 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f09882b7-b0f1-4395-b33d-cf75aeeadb4e None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:57.813912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f09882b7-b0f1-4395-b33d-cf75aeeadb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:57.843563 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 820/1659] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:08:57.847115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-85a28fe5-58f3-4a5d-9d92-109135164149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '706a7628801749c490d34e4ce9076f33'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:57.848329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09882b7-b0f1-4395-b33d-cf75aeeadb4e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:57.863867 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09882b7-b0f1-4395-b33d-cf75aeeadb4e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:57.868806 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-85a28fe5-58f3-4a5d-9d92-109135164149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '706a7628801749c490d34e4ce9076f33'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:57.869780 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-85a28fe5-58f3-4a5d-9d92-109135164149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '706a7628801749c490d34e4ce9076f33'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:57.881884 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d91e0b-e40d-48df-9dc4-58cd5b83dc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:57.882892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d91e0b-e40d-48df-9dc4-58cd5b83dc26 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:57.884800 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d91e0b-e40d-48df-9dc4-58cd5b83dc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:57.885916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d91e0b-e40d-48df-9dc4-58cd5b83dc26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:57.887822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d91e0b-e40d-48df-9dc4-58cd5b83dc26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:08:57.889187 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d91e0b-e40d-48df-9dc4-58cd5b83dc26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:57.893162 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d91e0b-e40d-48df-9dc4-58cd5b83dc26 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:57.894173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-85a28fe5-58f3-4a5d-9d92-109135164149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '706a7628801749c490d34e4ce9076f33'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:57.916975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-85a28fe5-58f3-4a5d-9d92-109135164149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '706a7628801749c490d34e4ce9076f33'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:08:57.928091 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 821/1660] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 07:08:57.932702 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d91e0b-e40d-48df-9dc4-58cd5b83dc26 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:57.935925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 840/1661] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:08:57 2022] DELETE /identity/v3/users/706a7628801749c490d34e4ce9076f33 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:57.936952 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c6d91e0b-e40d-48df-9dc4-58cd5b83dc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:57.940054 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ea18c-a25e-46d7-a7de-cc0ec685de8d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:57.941284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ea18c-a25e-46d7-a7de-cc0ec685de8d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:57.941940 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ea18c-a25e-46d7-a7de-cc0ec685de8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:57.969480 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d91e0b-e40d-48df-9dc4-58cd5b83dc26 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:57.983769 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-769ea18c-a25e-46d7-a7de-cc0ec685de8d None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:57.985410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-769ea18c-a25e-46d7-a7de-cc0ec685de8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:58.104206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdca592-2160-4496-9731-1c8018cbe79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:58.108026 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdca592-2160-4496-9731-1c8018cbe79e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:58.108388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdca592-2160-4496-9731-1c8018cbe79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:58.110617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdca592-2160-4496-9731-1c8018cbe79e admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:58.113675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdca592-2160-4496-9731-1c8018cbe79e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:58.122892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdca592-2160-4496-9731-1c8018cbe79e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:58.153593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 841/1662] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:58.167762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ea18c-a25e-46d7-a7de-cc0ec685de8d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:58.169757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-769ea18c-a25e-46d7-a7de-cc0ec685de8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:58.185575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 822/1663] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:08:57 2022] POST /identity/v3/projects => generated 387 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:58.191752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdca592-2160-4496-9731-1c8018cbe79e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:58.286071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:58.312537 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ea18c-a25e-46d7-a7de-cc0ec685de8d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:58.318166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:58.465796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63687e8-c63c-4b11-b049-038b97397823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:58.466138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63687e8-c63c-4b11-b049-038b97397823 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:58.466399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63687e8-c63c-4b11-b049-038b97397823 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:58.466670 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63687e8-c63c-4b11-b049-038b97397823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:58.620919 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdca592-2160-4496-9731-1c8018cbe79e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:58.645002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedb4c8-1802-4ecf-a30e-b77fb5e13e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:58.648025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedb4c8-1802-4ecf-a30e-b77fb5e13e42 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:58.648316 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedb4c8-1802-4ecf-a30e-b77fb5e13e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:58.650882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedb4c8-1802-4ecf-a30e-b77fb5e13e42 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:58.651614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedb4c8-1802-4ecf-a30e-b77fb5e13e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:58.666549 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedb4c8-1802-4ecf-a30e-b77fb5e13e42 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:58.702331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63687e8-c63c-4b11-b049-038b97397823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:58.704214 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63687e8-c63c-4b11-b049-038b97397823 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:58.767695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 823/1664] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:08:58 2022] POST /identity/v3/users => generated 294 bytes in 578 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:58.773382 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedb4c8-1802-4ecf-a30e-b77fb5e13e42 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:58.785944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 842/1665] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:08:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:08:58.787517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedb4c8-1802-4ecf-a30e-b77fb5e13e42 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:58.797182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2321d3-df68-478e-a6f1-9dbc0cedc4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:58.797752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2321d3-df68-478e-a6f1-9dbc0cedc4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:58.798012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2321d3-df68-478e-a6f1-9dbc0cedc4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:58.798279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2321d3-df68-478e-a6f1-9dbc0cedc4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:58.798925 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2321d3-df68-478e-a6f1-9dbc0cedc4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:58.800706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2321d3-df68-478e-a6f1-9dbc0cedc4e4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:58.815286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 824/1666] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:58.840396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63687e8-c63c-4b11-b049-038b97397823 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:58.856814 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63687e8-c63c-4b11-b049-038b97397823 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:58.870704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a7d96-7b11-494f-af06-7fddf37da5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:58.871038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a7d96-7b11-494f-af06-7fddf37da5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:58.871322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a7d96-7b11-494f-af06-7fddf37da5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:58.871605 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a7d96-7b11-494f-af06-7fddf37da5e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:58.872352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a7d96-7b11-494f-af06-7fddf37da5e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:58.874016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a7d96-7b11-494f-af06-7fddf37da5e0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:58.887392 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 843/1667] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:08:58.892916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2321d3-df68-478e-a6f1-9dbc0cedc4e4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:58.908003 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2321d3-df68-478e-a6f1-9dbc0cedc4e4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:58.921902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc57891-d5b5-4bb5-b22e-4f10905c6af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:58.922691 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc57891-d5b5-4bb5-b22e-4f10905c6af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:58.923025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc57891-d5b5-4bb5-b22e-4f10905c6af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:58.923470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc57891-d5b5-4bb5-b22e-4f10905c6af5 admin admin] PATH_INFO: `/v3/projects/e1cd822806b2448b8ee58dba352af497/users/82c6e4c3b278432d9f3c3e8ee8068a18/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:58.946308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc57891-d5b5-4bb5-b22e-4f10905c6af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1cd822806b2448b8ee58dba352af497, user_id=82c6e4c3b278432d9f3c3e8ee8068a18, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:58.949825 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc57891-d5b5-4bb5-b22e-4f10905c6af5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:58.973123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 825/1668] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:08:58 2022] PUT /identity/v3/projects/e1cd822806b2448b8ee58dba352af497/users/82c6e4c3b278432d9f3c3e8ee8068a18/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:58.985420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d190b-a167-4cb2-824f-5c15b6910854 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:58.985690 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d190b-a167-4cb2-824f-5c15b6910854 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:58.985900 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d190b-a167-4cb2-824f-5c15b6910854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:59.029881 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ba0d190b-a167-4cb2-824f-5c15b6910854 None None] MFA Rules not processed for user `82c6e4c3b278432d9f3c3e8ee8068a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:08:59.031413 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ba0d190b-a167-4cb2-824f-5c15b6910854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:08:59.182953 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc57891-d5b5-4bb5-b22e-4f10905c6af5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:59.201672 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 844/1669] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:08:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:08:59.336364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc57891-d5b5-4bb5-b22e-4f10905c6af5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:59.343754 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e0368-4545-491e-bdcd-a68c4297a008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:59.344641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e0368-4545-491e-bdcd-a68c4297a008 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:59.345052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e0368-4545-491e-bdcd-a68c4297a008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:59.345453 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e0368-4545-491e-bdcd-a68c4297a008 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:59.346214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e0368-4545-491e-bdcd-a68c4297a008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:59.348799 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e0368-4545-491e-bdcd-a68c4297a008 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:59.408362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d190b-a167-4cb2-824f-5c15b6910854 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:59.411327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 826/1670] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:08:59 2022] POST /identity/v3/projects => generated 387 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:59.425712 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d190b-a167-4cb2-824f-5c15b6910854 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:59.490114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:59.562016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929de01-5e9b-4dd6-b3dd-90bcf6802c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:59.562534 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929de01-5e9b-4dd6-b3dd-90bcf6802c35 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:59.562819 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929de01-5e9b-4dd6-b3dd-90bcf6802c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:59.563977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929de01-5e9b-4dd6-b3dd-90bcf6802c35 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:59.568322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929de01-5e9b-4dd6-b3dd-90bcf6802c35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:59.570798 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929de01-5e9b-4dd6-b3dd-90bcf6802c35 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:59.623583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 845/1671] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:08:59 2022] POST /identity/v3/users => generated 300 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:08:59.632828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e0368-4545-491e-bdcd-a68c4297a008 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:59.648964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e0368-4545-491e-bdcd-a68c4297a008 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:59.660139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c9dc1-e7f6-44a2-942a-0a6d541080d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:59.660924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c9dc1-e7f6-44a2-942a-0a6d541080d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:59.661305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c9dc1-e7f6-44a2-942a-0a6d541080d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:59.661678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c9dc1-e7f6-44a2-942a-0a6d541080d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:59.662451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c9dc1-e7f6-44a2-942a-0a6d541080d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:59.665764 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c9dc1-e7f6-44a2-942a-0a6d541080d3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:59.700668 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 827/1672] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:08:59.705040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929de01-5e9b-4dd6-b3dd-90bcf6802c35 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:59.719201 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929de01-5e9b-4dd6-b3dd-90bcf6802c35 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:59.732218 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064d03c-6cb5-4ef2-9bcc-7601ecb062c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:08:59.733059 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064d03c-6cb5-4ef2-9bcc-7601ecb062c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:08:59.733441 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064d03c-6cb5-4ef2-9bcc-7601ecb062c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:08:59.733835 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064d03c-6cb5-4ef2-9bcc-7601ecb062c6 admin admin] PATH_INFO: `/v3/projects/dad84949a26b4aedacc2fbdd3109457d/users/a640e1dd369c4e63912b080d7a5bfc7e/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:08:59.765449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064d03c-6cb5-4ef2-9bcc-7601ecb062c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad84949a26b4aedacc2fbdd3109457d, user_id=a640e1dd369c4e63912b080d7a5bfc7e, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:08:59.768480 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064d03c-6cb5-4ef2-9bcc-7601ecb062c6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:08:59.798394 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 846/1673] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:08:59 2022] PUT /identity/v3/projects/dad84949a26b4aedacc2fbdd3109457d/users/a640e1dd369c4e63912b080d7a5bfc7e/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:08:59.802201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c9dc1-e7f6-44a2-942a-0a6d541080d3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:08:59.813718 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c9dc1-e7f6-44a2-942a-0a6d541080d3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:08:59.938421 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:00.000981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d3990-a8b6-4410-a907-a5088dd9617a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:00.001628 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d3990-a8b6-4410-a907-a5088dd9617a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:00.001907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d3990-a8b6-4410-a907-a5088dd9617a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:00.002339 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d3990-a8b6-4410-a907-a5088dd9617a admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:00.002993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d3990-a8b6-4410-a907-a5088dd9617a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:00.006228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d3990-a8b6-4410-a907-a5088dd9617a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:00.037484 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064d03c-6cb5-4ef2-9bcc-7601ecb062c6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:00.037953 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 828/1674] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:00.050760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064d03c-6cb5-4ef2-9bcc-7601ecb062c6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:00.067563 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23553938-01c0-41e8-8508-bba88dfaa22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:00.068256 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23553938-01c0-41e8-8508-bba88dfaa22c admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:00.068626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23553938-01c0-41e8-8508-bba88dfaa22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:00.068965 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23553938-01c0-41e8-8508-bba88dfaa22c admin admin] PATH_INFO: `/v3/projects/dad84949a26b4aedacc2fbdd3109457d/users/a640e1dd369c4e63912b080d7a5bfc7e/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:00.072140 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23553938-01c0-41e8-8508-bba88dfaa22c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad84949a26b4aedacc2fbdd3109457d, user_id=a640e1dd369c4e63912b080d7a5bfc7e, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:00.081512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23553938-01c0-41e8-8508-bba88dfaa22c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:00.112657 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 847/1675] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:00 2022] PUT /identity/v3/projects/dad84949a26b4aedacc2fbdd3109457d/users/a640e1dd369c4e63912b080d7a5bfc7e/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:09:00.124144 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c41ae-3592-4006-bbbf-8cb7ff0e4e9d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:00.124427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c41ae-3592-4006-bbbf-8cb7ff0e4e9d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:00.124701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c41ae-3592-4006-bbbf-8cb7ff0e4e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:00.206116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-308c41ae-3592-4006-bbbf-8cb7ff0e4e9d None None] MFA Rules not processed for user `a640e1dd369c4e63912b080d7a5bfc7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:00.207387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-308c41ae-3592-4006-bbbf-8cb7ff0e4e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:00.273548 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e53aaa-2490-40cb-9800-930e898fc403 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:00.273838 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e53aaa-2490-40cb-9800-930e898fc403 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:00.274112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e53aaa-2490-40cb-9800-930e898fc403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:00.339139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f4e53aaa-2490-40cb-9800-930e898fc403 None None] MFA Rules not processed for user `a0ab57f6373b4dd2a689cc9b2463f9ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:00.342492 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f4e53aaa-2490-40cb-9800-930e898fc403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:00.439332 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 829/1676] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:00.455296 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c41ae-3592-4006-bbbf-8cb7ff0e4e9d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:00.457163 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-308c41ae-3592-4006-bbbf-8cb7ff0e4e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:00.565244 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 848/1677] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:00 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:00.588527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c41ae-3592-4006-bbbf-8cb7ff0e4e9d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:00.592248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d632591-f088-4df8-8cb5-8149e3f98252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:00.593028 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d632591-f088-4df8-8cb5-8149e3f98252 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:00.593443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d632591-f088-4df8-8cb5-8149e3f98252 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:00.593757 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d632591-f088-4df8-8cb5-8149e3f98252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:00.604627 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d632591-f088-4df8-8cb5-8149e3f98252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:00.606330 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d632591-f088-4df8-8cb5-8149e3f98252 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:00.626091 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 830/1678] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:09:00.687018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e53aaa-2490-40cb-9800-930e898fc403 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:00.758278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d632591-f088-4df8-8cb5-8149e3f98252 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:00.761477 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2d632591-f088-4df8-8cb5-8149e3f98252 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:00.913127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e53aaa-2490-40cb-9800-930e898fc403 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:00.930405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6fb00-b593-4348-bd8c-eb98e07b66bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:00.931153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6fb00-b593-4348-bd8c-eb98e07b66bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:00.931757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6fb00-b593-4348-bd8c-eb98e07b66bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:00.932046 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6fb00-b593-4348-bd8c-eb98e07b66bd admin admin] PATH_INFO: `/v3/users/82c6e4c3b278432d9f3c3e8ee8068a18` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:00.936306 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6fb00-b593-4348-bd8c-eb98e07b66bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c6e4c3b278432d9f3c3e8ee8068a18)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:00.941408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6fb00-b593-4348-bd8c-eb98e07b66bd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:01.015980 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:01.043318 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d632591-f088-4df8-8cb5-8149e3f98252 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:01.061650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58419b56-9518-4ff9-94f5-7d606cd1a725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:01.062800 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58419b56-9518-4ff9-94f5-7d606cd1a725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:01.065120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58419b56-9518-4ff9-94f5-7d606cd1a725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:01.065452 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58419b56-9518-4ff9-94f5-7d606cd1a725 admin admin] PATH_INFO: `/v3/projects/5906d2c426ee4d0e9477bfa878bc0c08` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:01.070454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58419b56-9518-4ff9-94f5-7d606cd1a725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5906d2c426ee4d0e9477bfa878bc0c08)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:01.084953 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58419b56-9518-4ff9-94f5-7d606cd1a725 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:01.090263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-45d6fb00-b593-4348-bd8c-eb98e07b66bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c6e4c3b278432d9f3c3e8ee8068a18'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:01.115934 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:01.123405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-45d6fb00-b593-4348-bd8c-eb98e07b66bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c6e4c3b278432d9f3c3e8ee8068a18'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:01.124296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-45d6fb00-b593-4348-bd8c-eb98e07b66bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c6e4c3b278432d9f3c3e8ee8068a18'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:01.169697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-45d6fb00-b593-4348-bd8c-eb98e07b66bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c6e4c3b278432d9f3c3e8ee8068a18'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:01.181648 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-45d6fb00-b593-4348-bd8c-eb98e07b66bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c6e4c3b278432d9f3c3e8ee8068a18'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:01.192101 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 849/1679] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:00 2022] DELETE /identity/v3/users/82c6e4c3b278432d9f3c3e8ee8068a18 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:01.199869 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b43c9c-342c-4d13-8e37-75d052ee381c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:01.200397 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b43c9c-342c-4d13-8e37-75d052ee381c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:01.200821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b43c9c-342c-4d13-8e37-75d052ee381c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:01.209570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-58419b56-9518-4ff9-94f5-7d606cd1a725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5906d2c426ee4d0e9477bfa878bc0c08', 'request_id': 'req-58419b56-9518-4ff9-94f5-7d606cd1a725'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:01.218416 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-58419b56-9518-4ff9-94f5-7d606cd1a725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5906d2c426ee4d0e9477bfa878bc0c08', 'request_id': 'req-58419b56-9518-4ff9-94f5-7d606cd1a725'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:01.225217 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-58419b56-9518-4ff9-94f5-7d606cd1a725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5906d2c426ee4d0e9477bfa878bc0c08', 'request_id': 'req-58419b56-9518-4ff9-94f5-7d606cd1a725'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:01.245185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-37b43c9c-342c-4d13-8e37-75d052ee381c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:01.245620 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-58419b56-9518-4ff9-94f5-7d606cd1a725 admin admin] The token cache is being invalidate because project 5906d2c426ee4d0e9477bfa878bc0c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:01.246094 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-58419b56-9518-4ff9-94f5-7d606cd1a725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:01.246810 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-58419b56-9518-4ff9-94f5-7d606cd1a725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:01.249160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 831/1680] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:00 2022] DELETE /identity/v3/projects/5906d2c426ee4d0e9477bfa878bc0c08 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:09:01.251566 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-37b43c9c-342c-4d13-8e37-75d052ee381c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:01.254691 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb154d5-ec6c-41be-be62-02aa7c0bec06 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:01.255210 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb154d5-ec6c-41be-be62-02aa7c0bec06 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:01.255626 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb154d5-ec6c-41be-be62-02aa7c0bec06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:01.316083 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6bb154d5-ec6c-41be-be62-02aa7c0bec06 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:01.317492 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6bb154d5-ec6c-41be-be62-02aa7c0bec06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:01.434996 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 850/1681] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:01.457150 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b43c9c-342c-4d13-8e37-75d052ee381c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:01.459152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-37b43c9c-342c-4d13-8e37-75d052ee381c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:01.529531 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 832/1682] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:01.539912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d8170-fa3e-4744-ac6b-504652f10dd3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:01.540656 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d8170-fa3e-4744-ac6b-504652f10dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:01.542355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d8170-fa3e-4744-ac6b-504652f10dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:01.591517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-010d8170-fa3e-4744-ac6b-504652f10dd3 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:01.595485 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-010d8170-fa3e-4744-ac6b-504652f10dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:01.611079 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b43c9c-342c-4d13-8e37-75d052ee381c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:01.636586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee37b3-d292-4519-a438-8acb1446bfee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:01.637227 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee37b3-d292-4519-a438-8acb1446bfee service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:01.639291 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 833/1683] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:01.639624 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee37b3-d292-4519-a438-8acb1446bfee service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:01.639916 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee37b3-d292-4519-a438-8acb1446bfee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:01.643274 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d8170-fa3e-4744-ac6b-504652f10dd3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:01.661083 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d8170-fa3e-4744-ac6b-504652f10dd3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:01.667839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee37b3-d292-4519-a438-8acb1446bfee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:01.668785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eac49d-f6cd-4ea1-8d76-78f364adc831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:01.669296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee37b3-d292-4519-a438-8acb1446bfee service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:01.669436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eac49d-f6cd-4ea1-8d76-78f364adc831 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:01.669684 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eac49d-f6cd-4ea1-8d76-78f364adc831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:01.669942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eac49d-f6cd-4ea1-8d76-78f364adc831 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:01.670592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eac49d-f6cd-4ea1-8d76-78f364adc831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:09:01.670895 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eac49d-f6cd-4ea1-8d76-78f364adc831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:01.672933 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eac49d-f6cd-4ea1-8d76-78f364adc831 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:01.702558 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 851/1684] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:01.720971 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee37b3-d292-4519-a438-8acb1446bfee service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:01.737283 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 834/1685] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:09:01.757271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee37b3-d292-4519-a438-8acb1446bfee service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:01.773864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b96de-dfe3-405d-9ffc-dc586b61ec30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:01.775108 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b96de-dfe3-405d-9ffc-dc586b61ec30 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:01.775556 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b96de-dfe3-405d-9ffc-dc586b61ec30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:01.775973 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b96de-dfe3-405d-9ffc-dc586b61ec30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:01.777003 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b96de-dfe3-405d-9ffc-dc586b61ec30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:01.779224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b96de-dfe3-405d-9ffc-dc586b61ec30 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:01.834569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 852/1686] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:01 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:09:01.839588 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eac49d-f6cd-4ea1-8d76-78f364adc831 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:01.855008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eac49d-f6cd-4ea1-8d76-78f364adc831 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:01.992089 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625133d-23c3-401e-bf20-d944ab1e382d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:01.993111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625133d-23c3-401e-bf20-d944ab1e382d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:01.994229 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625133d-23c3-401e-bf20-d944ab1e382d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:01.994715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625133d-23c3-401e-bf20-d944ab1e382d admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:01.996406 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625133d-23c3-401e-bf20-d944ab1e382d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:02.000201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625133d-23c3-401e-bf20-d944ab1e382d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:02.044340 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 835/1687] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:01 2022] POST /identity/v3/users => generated 283 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:02.047958 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b96de-dfe3-405d-9ffc-dc586b61ec30 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:02.066279 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b96de-dfe3-405d-9ffc-dc586b61ec30 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:02.072862 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823715bd-cb9c-46b6-8167-53fb887a84f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:02.073686 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823715bd-cb9c-46b6-8167-53fb887a84f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:02.073973 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823715bd-cb9c-46b6-8167-53fb887a84f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:02.075646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823715bd-cb9c-46b6-8167-53fb887a84f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:02.075646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823715bd-cb9c-46b6-8167-53fb887a84f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:02.081142 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823715bd-cb9c-46b6-8167-53fb887a84f5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:02.108001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 853/1688] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:09:02.110609 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625133d-23c3-401e-bf20-d944ab1e382d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:02.125396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625133d-23c3-401e-bf20-d944ab1e382d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:02.143880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa360664-522b-470b-944a-90d1a0d62e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:02.144572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa360664-522b-470b-944a-90d1a0d62e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:02.145701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa360664-522b-470b-944a-90d1a0d62e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:02.147977 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa360664-522b-470b-944a-90d1a0d62e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:02.148157 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa360664-522b-470b-944a-90d1a0d62e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:02.152293 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa360664-522b-470b-944a-90d1a0d62e12 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:02.155022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:02.176716 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 836/1689] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:02.182156 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823715bd-cb9c-46b6-8167-53fb887a84f5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:02.191017 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:02.197210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823715bd-cb9c-46b6-8167-53fb887a84f5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:02.205049 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e503a8f-61b6-480f-b112-9d5c67babc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:02.206118 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e503a8f-61b6-480f-b112-9d5c67babc4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:02.207201 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e503a8f-61b6-480f-b112-9d5c67babc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:02.207598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e503a8f-61b6-480f-b112-9d5c67babc4c admin admin] PATH_INFO: `/v3/projects/ebe7a15cc7a94e3c85a691c8174f5552/users/cf1b7a6b72cd4d55bd3ccb8683faee36/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:02.229325 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e503a8f-61b6-480f-b112-9d5c67babc4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe7a15cc7a94e3c85a691c8174f5552, user_id=cf1b7a6b72cd4d55bd3ccb8683faee36, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:02.234585 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e503a8f-61b6-480f-b112-9d5c67babc4c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:02.262522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 854/1690] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:02 2022] PUT /identity/v3/projects/ebe7a15cc7a94e3c85a691c8174f5552/users/cf1b7a6b72cd4d55bd3ccb8683faee36/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:02.272746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806877d-411b-4254-88b4-375bc181de8e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:02.273076 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806877d-411b-4254-88b4-375bc181de8e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:02.273302 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806877d-411b-4254-88b4-375bc181de8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:02.315863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9806877d-411b-4254-88b4-375bc181de8e None None] MFA Rules not processed for user `cf1b7a6b72cd4d55bd3ccb8683faee36`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:02.318976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9806877d-411b-4254-88b4-375bc181de8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:02.430042 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 837/1691] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:02.434972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e503a8f-61b6-480f-b112-9d5c67babc4c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:02.448887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40fbf9-b664-4b62-9458-b7bce5ad28de None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:02.449085 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40fbf9-b664-4b62-9458-b7bce5ad28de None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:02.449361 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40fbf9-b664-4b62-9458-b7bce5ad28de None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:02.457776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 838/1692] 10.222.0.40 () {54 vars in 921 bytes} [Tue Aug 9 07:09:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:09:02.528195 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4914-6052-4107-a248-a5aad662e0cc None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:02.528821 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4914-6052-4107-a248-a5aad662e0cc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:02.529693 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4914-6052-4107-a248-a5aad662e0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:02.565440 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e503a8f-61b6-480f-b112-9d5c67babc4c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:02.568793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b5fe4914-6052-4107-a248-a5aad662e0cc None None] MFA Rules not processed for user `07d2ee351e734fd09938cea9be3bb08a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:02.575921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b5fe4914-6052-4107-a248-a5aad662e0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:02.579420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d35414-ae3e-4b2f-8335-632bee1ded62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:02.583035 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d35414-ae3e-4b2f-8335-632bee1ded62 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:02.583360 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d35414-ae3e-4b2f-8335-632bee1ded62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:02.583697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d35414-ae3e-4b2f-8335-632bee1ded62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:02.585566 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d35414-ae3e-4b2f-8335-632bee1ded62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:02.598183 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d35414-ae3e-4b2f-8335-632bee1ded62 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:02.711178 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 855/1693] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:02 2022] POST /identity/v3/projects => generated 369 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:02.716407 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d35414-ae3e-4b2f-8335-632bee1ded62 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:02.762840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 839/1694] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Aug 9 07:09:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:02.816782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d35414-ae3e-4b2f-8335-632bee1ded62 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:02.836497 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c0f45-b1c4-4c4a-99ff-c9e7c679f7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:02.837614 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c0f45-b1c4-4c4a-99ff-c9e7c679f7c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:02.838077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c0f45-b1c4-4c4a-99ff-c9e7c679f7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:02.839416 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c0f45-b1c4-4c4a-99ff-c9e7c679f7c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:02.840248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c0f45-b1c4-4c4a-99ff-c9e7c679f7c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:02.843594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c0f45-b1c4-4c4a-99ff-c9e7c679f7c4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:02.894549 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b11c29-b664-43a6-b6e4-4cf0591ad3ac None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:02.895110 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b11c29-b664-43a6-b6e4-4cf0591ad3ac None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:02.895225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b11c29-b664-43a6-b6e4-4cf0591ad3ac None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:02.896493 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 840/1695] 10.222.0.40 () {54 vars in 961 bytes} [Tue Aug 9 07:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 07:09:02.903129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 856/1696] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:02 2022] POST /identity/v3/users => generated 291 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:02.904540 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b11c29-b664-43a6-b6e4-4cf0591ad3ac None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:02.913555 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c68be-be7a-4b08-9b7d-3133ec04d5d7 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:02.913555 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c68be-be7a-4b08-9b7d-3133ec04d5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:02.913555 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c68be-be7a-4b08-9b7d-3133ec04d5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:02.932608 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b11c29-b664-43a6-b6e4-4cf0591ad3ac None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:02.938135 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa7e25-38ed-487c-9e47-8fb55905883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:02.938643 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa7e25-38ed-487c-9e47-8fb55905883c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:02.938923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa7e25-38ed-487c-9e47-8fb55905883c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:02.939236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa7e25-38ed-487c-9e47-8fb55905883c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:02.940148 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa7e25-38ed-487c-9e47-8fb55905883c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:02.941486 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa7e25-38ed-487c-9e47-8fb55905883c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:02.950947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f55c68be-be7a-4b08-9b7d-3133ec04d5d7 None None] MFA Rules not processed for user `07d2ee351e734fd09938cea9be3bb08a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:02.964926 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 841/1697] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:02.969236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa7e25-38ed-487c-9e47-8fb55905883c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:02.986141 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f55c68be-be7a-4b08-9b7d-3133ec04d5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:02.993633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa7e25-38ed-487c-9e47-8fb55905883c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:03.005036 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99516b2c-d41d-4554-95c2-2b75b2d0124c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:03.005726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99516b2c-d41d-4554-95c2-2b75b2d0124c admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:03.006010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99516b2c-d41d-4554-95c2-2b75b2d0124c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:03.006285 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99516b2c-d41d-4554-95c2-2b75b2d0124c admin admin] PATH_INFO: `/v3/projects/f3024256e5bc411e9c345cb8bdc016b7/users/a2cb6aea4dcd440185d18c3cab413a90/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:03.043535 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99516b2c-d41d-4554-95c2-2b75b2d0124c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3024256e5bc411e9c345cb8bdc016b7, user_id=a2cb6aea4dcd440185d18c3cab413a90, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:03.045805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99516b2c-d41d-4554-95c2-2b75b2d0124c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:03.077277 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 842/1698] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:02 2022] PUT /identity/v3/projects/f3024256e5bc411e9c345cb8bdc016b7/users/a2cb6aea4dcd440185d18c3cab413a90/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:09:03.081787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99516b2c-d41d-4554-95c2-2b75b2d0124c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:03.174047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:03.204803 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:03.239079 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99516b2c-d41d-4554-95c2-2b75b2d0124c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:03.255892 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 857/1699] 10.222.0.40 () {58 vars in 1058 bytes} [Tue Aug 9 07:09:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:03.256871 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c68be-be7a-4b08-9b7d-3133ec04d5d7 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:03.264405 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e28551-c7bc-4f51-b900-f4f972a02236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:03.264955 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e28551-c7bc-4f51-b900-f4f972a02236 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:03.266052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e28551-c7bc-4f51-b900-f4f972a02236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:03.266052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e28551-c7bc-4f51-b900-f4f972a02236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:03.266257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e28551-c7bc-4f51-b900-f4f972a02236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:03.267781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e28551-c7bc-4f51-b900-f4f972a02236 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:03.279337 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c68be-be7a-4b08-9b7d-3133ec04d5d7 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:03.292558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 843/1700] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:09:03.293904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e28551-c7bc-4f51-b900-f4f972a02236 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:03.312824 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e28551-c7bc-4f51-b900-f4f972a02236 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:03.335260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fab14c-b96d-4875-befc-1c7470bcf186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:03.335996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fab14c-b96d-4875-befc-1c7470bcf186 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:03.336693 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fab14c-b96d-4875-befc-1c7470bcf186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:03.351752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fab14c-b96d-4875-befc-1c7470bcf186 admin admin] PATH_INFO: `/v3/projects/f3024256e5bc411e9c345cb8bdc016b7/users/a2cb6aea4dcd440185d18c3cab413a90/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:03.359379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fab14c-b96d-4875-befc-1c7470bcf186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3024256e5bc411e9c345cb8bdc016b7, user_id=a2cb6aea4dcd440185d18c3cab413a90, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:03.369152 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fab14c-b96d-4875-befc-1c7470bcf186 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:03.403805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 844/1701] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:03 2022] PUT /identity/v3/projects/f3024256e5bc411e9c345cb8bdc016b7/users/a2cb6aea4dcd440185d18c3cab413a90/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:03.420276 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e448e79-ee93-4794-9f9a-b11a1d37633e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:03.420606 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e448e79-ee93-4794-9f9a-b11a1d37633e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:03.420842 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e448e79-ee93-4794-9f9a-b11a1d37633e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:03.469642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0afa9-4c59-45e1-a26e-5beb1ac2d5f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07d2ee351e734fd09938cea9be3bb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:03.470192 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0afa9-4c59-45e1-a26e-5beb1ac2d5f8 service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:03.470471 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0afa9-4c59-45e1-a26e-5beb1ac2d5f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:03.470743 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0afa9-4c59-45e1-a26e-5beb1ac2d5f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:03.494247 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0e448e79-ee93-4794-9f9a-b11a1d37633e None None] MFA Rules not processed for user `a2cb6aea4dcd440185d18c3cab413a90`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:03.495814 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0e448e79-ee93-4794-9f9a-b11a1d37633e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:03.502305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0afa9-4c59-45e1-a26e-5beb1ac2d5f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:03.505171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0afa9-4c59-45e1-a26e-5beb1ac2d5f8 service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:03.525269 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 858/1702] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:03.742210 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 845/1703] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:03.753642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0afa9-4c59-45e1-a26e-5beb1ac2d5f8 service placement] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:03.755274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a3e0afa9-4c59-45e1-a26e-5beb1ac2d5f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:03.884308 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0afa9-4c59-45e1-a26e-5beb1ac2d5f8 service placement] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:04.042910 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6ff6a-ca34-40bc-a429-685ab713e9d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:04.047040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6ff6a-ca34-40bc-a429-685ab713e9d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:04.047390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6ff6a-ca34-40bc-a429-685ab713e9d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:04.047731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6ff6a-ca34-40bc-a429-685ab713e9d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:04.062608 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6ff6a-ca34-40bc-a429-685ab713e9d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:04.065254 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6ff6a-ca34-40bc-a429-685ab713e9d2 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:04.081991 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 859/1704] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:04.414218 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e448e79-ee93-4794-9f9a-b11a1d37633e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:04.417061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0e448e79-ee93-4794-9f9a-b11a1d37633e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:04.535788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e448e79-ee93-4794-9f9a-b11a1d37633e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:04.549374 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3810a-c6e5-4c85-92da-e39dba925e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:04.551433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3810a-c6e5-4c85-92da-e39dba925e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:04.551718 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3810a-c6e5-4c85-92da-e39dba925e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:04.552657 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3810a-c6e5-4c85-92da-e39dba925e61 admin admin] PATH_INFO: `/v3/users/711f9b1b972b4b74ade8b649d9b8a39a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:04.557526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3810a-c6e5-4c85-92da-e39dba925e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=711f9b1b972b4b74ade8b649d9b8a39a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:04.559686 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3810a-c6e5-4c85-92da-e39dba925e61 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:04.673942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ddd3810a-c6e5-4c85-92da-e39dba925e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '711f9b1b972b4b74ade8b649d9b8a39a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:04.674698 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ddd3810a-c6e5-4c85-92da-e39dba925e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '711f9b1b972b4b74ade8b649d9b8a39a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:04.675263 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ddd3810a-c6e5-4c85-92da-e39dba925e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '711f9b1b972b4b74ade8b649d9b8a39a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:04.691870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574f48d-6787-456c-a271-af210e29a19d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:04.692321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574f48d-6787-456c-a271-af210e29a19d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:04.692420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574f48d-6787-456c-a271-af210e29a19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:04.700657 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ddd3810a-c6e5-4c85-92da-e39dba925e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '711f9b1b972b4b74ade8b649d9b8a39a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:04.703040 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:04.719330 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ddd3810a-c6e5-4c85-92da-e39dba925e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '711f9b1b972b4b74ade8b649d9b8a39a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:04.736882 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6574f48d-6787-456c-a271-af210e29a19d None None] MFA Rules not processed for user `86b1015b309e4b06b21269892fbc8287`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:04.738621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6574f48d-6787-456c-a271-af210e29a19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:04.780251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 846/1705] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:04 2022] DELETE /identity/v3/users/711f9b1b972b4b74ade8b649d9b8a39a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:04.784463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3810a-c6e5-4c85-92da-e39dba925e61 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:04.788161 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ddd3810a-c6e5-4c85-92da-e39dba925e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:04.827101 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:04.898866 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 860/1706] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:04.915820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad335d2-c58e-4bbd-b96b-bd4c6de5c1b4 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:04.916213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad335d2-c58e-4bbd-b96b-bd4c6de5c1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:04.916655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad335d2-c58e-4bbd-b96b-bd4c6de5c1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:05.002587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-fad335d2-c58e-4bbd-b96b-bd4c6de5c1b4 None None] MFA Rules not processed for user `86b1015b309e4b06b21269892fbc8287`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:05.003997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fad335d2-c58e-4bbd-b96b-bd4c6de5c1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:05.025367 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3810a-c6e5-4c85-92da-e39dba925e61 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:05.046926 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b64be-0e75-449d-8c3f-ffd71b38a434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:05.048297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b64be-0e75-449d-8c3f-ffd71b38a434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:05.051129 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b64be-0e75-449d-8c3f-ffd71b38a434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:05.051494 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b64be-0e75-449d-8c3f-ffd71b38a434 admin admin] PATH_INFO: `/v3/projects/e1cd822806b2448b8ee58dba352af497` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:05.053682 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b64be-0e75-449d-8c3f-ffd71b38a434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1cd822806b2448b8ee58dba352af497)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:05.056376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b64be-0e75-449d-8c3f-ffd71b38a434 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:05.229922 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ac3b64be-0e75-449d-8c3f-ffd71b38a434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1cd822806b2448b8ee58dba352af497', 'request_id': 'req-ac3b64be-0e75-449d-8c3f-ffd71b38a434'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:05.239885 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 861/1707] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:05.244690 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ac3b64be-0e75-449d-8c3f-ffd71b38a434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1cd822806b2448b8ee58dba352af497', 'request_id': 'req-ac3b64be-0e75-449d-8c3f-ffd71b38a434'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:05.253697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad335d2-c58e-4bbd-b96b-bd4c6de5c1b4 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:05.255761 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fad335d2-c58e-4bbd-b96b-bd4c6de5c1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:05.263051 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ac3b64be-0e75-449d-8c3f-ffd71b38a434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1cd822806b2448b8ee58dba352af497', 'request_id': 'req-ac3b64be-0e75-449d-8c3f-ffd71b38a434'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:05.293118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ac3b64be-0e75-449d-8c3f-ffd71b38a434 admin admin] The token cache is being invalidate because project e1cd822806b2448b8ee58dba352af497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:05.293411 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ac3b64be-0e75-449d-8c3f-ffd71b38a434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:05.299261 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ac3b64be-0e75-449d-8c3f-ffd71b38a434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:05.310610 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 847/1708] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:04 2022] DELETE /identity/v3/projects/e1cd822806b2448b8ee58dba352af497 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:05.313088 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b64be-0e75-449d-8c3f-ffd71b38a434 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:05.319040 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ac3b64be-0e75-449d-8c3f-ffd71b38a434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:05.446964 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad335d2-c58e-4bbd-b96b-bd4c6de5c1b4 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:05.516635 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b64be-0e75-449d-8c3f-ffd71b38a434 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:05.531408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312872a-fe11-4dfb-b513-b5cca2cc240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:05.532072 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312872a-fe11-4dfb-b513-b5cca2cc240d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:05.532348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312872a-fe11-4dfb-b513-b5cca2cc240d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:05.532616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312872a-fe11-4dfb-b513-b5cca2cc240d admin admin] PATH_INFO: `/v3/users/a640e1dd369c4e63912b080d7a5bfc7e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:05.534102 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312872a-fe11-4dfb-b513-b5cca2cc240d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a640e1dd369c4e63912b080d7a5bfc7e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:05.539370 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312872a-fe11-4dfb-b513-b5cca2cc240d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:05.561180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:05.705921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43e942-ef38-47ca-aba2-323340ec807c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:05.707201 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43e942-ef38-47ca-aba2-323340ec807c service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:05.707730 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43e942-ef38-47ca-aba2-323340ec807c service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:05.708208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43e942-ef38-47ca-aba2-323340ec807c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:05.718603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5312872a-fe11-4dfb-b513-b5cca2cc240d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a640e1dd369c4e63912b080d7a5bfc7e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:05.720993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5312872a-fe11-4dfb-b513-b5cca2cc240d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a640e1dd369c4e63912b080d7a5bfc7e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:05.722367 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5312872a-fe11-4dfb-b513-b5cca2cc240d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a640e1dd369c4e63912b080d7a5bfc7e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:05.737293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9a43e942-ef38-47ca-aba2-323340ec807c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:05.746199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5312872a-fe11-4dfb-b513-b5cca2cc240d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a640e1dd369c4e63912b080d7a5bfc7e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:05.781762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:05.802341 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5312872a-fe11-4dfb-b513-b5cca2cc240d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a640e1dd369c4e63912b080d7a5bfc7e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:05.859159 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 848/1709] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:05 2022] DELETE /identity/v3/users/a640e1dd369c4e63912b080d7a5bfc7e => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:05.860751 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312872a-fe11-4dfb-b513-b5cca2cc240d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:05.863492 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5312872a-fe11-4dfb-b513-b5cca2cc240d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:05.943926 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43e942-ef38-47ca-aba2-323340ec807c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:05.945049 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43e942-ef38-47ca-aba2-323340ec807c service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:06.013826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 862/1710] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:05 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 760 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:06.016858 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae9290-cc87-4002-83cb-5e54fb1c797e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:06.017747 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae9290-cc87-4002-83cb-5e54fb1c797e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:06.020545 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae9290-cc87-4002-83cb-5e54fb1c797e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:06.078118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312872a-fe11-4dfb-b513-b5cca2cc240d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:06.084841 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383b916-54cc-4339-85f8-5f7c294eb14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:06.084841 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383b916-54cc-4339-85f8-5f7c294eb14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:06.084841 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383b916-54cc-4339-85f8-5f7c294eb14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:06.084841 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383b916-54cc-4339-85f8-5f7c294eb14e admin admin] PATH_INFO: `/v3/projects/3241c7228b4a4b699c72f98ddfbbf7c5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:06.087824 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383b916-54cc-4339-85f8-5f7c294eb14e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3241c7228b4a4b699c72f98ddfbbf7c5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:06.089739 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383b916-54cc-4339-85f8-5f7c294eb14e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:06.136118 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f8ae9290-cc87-4002-83cb-5e54fb1c797e None None] MFA Rules not processed for user `a7d50e164ef94115b2a5774480a8155d`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:06.142568 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f8ae9290-cc87-4002-83cb-5e54fb1c797e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:06.186205 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c383b916-54cc-4339-85f8-5f7c294eb14e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3241c7228b4a4b699c72f98ddfbbf7c5', 'request_id': 'req-c383b916-54cc-4339-85f8-5f7c294eb14e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:06.201145 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c383b916-54cc-4339-85f8-5f7c294eb14e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3241c7228b4a4b699c72f98ddfbbf7c5', 'request_id': 'req-c383b916-54cc-4339-85f8-5f7c294eb14e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:06.217749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c383b916-54cc-4339-85f8-5f7c294eb14e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3241c7228b4a4b699c72f98ddfbbf7c5', 'request_id': 'req-c383b916-54cc-4339-85f8-5f7c294eb14e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:06.241292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c383b916-54cc-4339-85f8-5f7c294eb14e admin admin] The token cache is being invalidate because project 3241c7228b4a4b699c72f98ddfbbf7c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:06.242663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c383b916-54cc-4339-85f8-5f7c294eb14e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:06.245152 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c383b916-54cc-4339-85f8-5f7c294eb14e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:06.252814 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 849/1711] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:05 2022] DELETE /identity/v3/projects/3241c7228b4a4b699c72f98ddfbbf7c5 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:06.255007 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383b916-54cc-4339-85f8-5f7c294eb14e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:06.257808 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c383b916-54cc-4339-85f8-5f7c294eb14e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:06.296647 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:06.383454 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 863/1712] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:06.395585 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c09a4-490f-4214-b209-d4d7be6a7231 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:06.395869 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c09a4-490f-4214-b209-d4d7be6a7231 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:06.396145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c09a4-490f-4214-b209-d4d7be6a7231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:06.433308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383b916-54cc-4339-85f8-5f7c294eb14e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:06.442003 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7a2c09a4-490f-4214-b209-d4d7be6a7231 None None] MFA Rules not processed for user `a7d50e164ef94115b2a5774480a8155d`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:06.445918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7a2c09a4-490f-4214-b209-d4d7be6a7231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:06.446206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469faa38-34bc-4b28-8fff-371022acbc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:06.447173 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469faa38-34bc-4b28-8fff-371022acbc1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:06.447315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469faa38-34bc-4b28-8fff-371022acbc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:06.447742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469faa38-34bc-4b28-8fff-371022acbc1e admin admin] PATH_INFO: `/v3/users/a0ab57f6373b4dd2a689cc9b2463f9ac` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:06.450454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469faa38-34bc-4b28-8fff-371022acbc1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ab57f6373b4dd2a689cc9b2463f9ac)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:06.458513 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469faa38-34bc-4b28-8fff-371022acbc1e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:06.580827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-469faa38-34bc-4b28-8fff-371022acbc1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ab57f6373b4dd2a689cc9b2463f9ac'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:06.583606 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-469faa38-34bc-4b28-8fff-371022acbc1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ab57f6373b4dd2a689cc9b2463f9ac'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:06.591503 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-469faa38-34bc-4b28-8fff-371022acbc1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ab57f6373b4dd2a689cc9b2463f9ac'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:06.593669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 864/1713] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:06.605791 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c09a4-490f-4214-b209-d4d7be6a7231 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:06.609441 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-469faa38-34bc-4b28-8fff-371022acbc1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ab57f6373b4dd2a689cc9b2463f9ac'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:06.610765 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7a2c09a4-490f-4214-b209-d4d7be6a7231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:06.630915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-469faa38-34bc-4b28-8fff-371022acbc1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ab57f6373b4dd2a689cc9b2463f9ac'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:06.673391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 850/1714] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:06 2022] DELETE /identity/v3/users/a0ab57f6373b4dd2a689cc9b2463f9ac => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:06.783352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:06.863188 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c09a4-490f-4214-b209-d4d7be6a7231 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:07.140262 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6e2cd-c563-4aa5-a1c4-d4c09be349b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:07.144230 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6e2cd-c563-4aa5-a1c4-d4c09be349b3 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:07.144230 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6e2cd-c563-4aa5-a1c4-d4c09be349b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:07.144230 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6e2cd-c563-4aa5-a1c4-d4c09be349b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:07.148145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-eda6e2cd-c563-4aa5-a1c4-d4c09be349b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:07.327314 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6e2cd-c563-4aa5-a1c4-d4c09be349b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:07.329027 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6e2cd-c563-4aa5-a1c4-d4c09be349b3 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:07.361480 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 865/1715] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:09:07.438370 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469faa38-34bc-4b28-8fff-371022acbc1e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:07.440011 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-469faa38-34bc-4b28-8fff-371022acbc1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:07.538242 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6e2cd-c563-4aa5-a1c4-d4c09be349b3 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:07.539782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-eda6e2cd-c563-4aa5-a1c4-d4c09be349b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:07.623968 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469faa38-34bc-4b28-8fff-371022acbc1e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:07.640257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72686e4-c265-4c5b-82e9-5596c6b27d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:07.641086 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72686e4-c265-4c5b-82e9-5596c6b27d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:07.641376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72686e4-c265-4c5b-82e9-5596c6b27d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:07.641643 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72686e4-c265-4c5b-82e9-5596c6b27d62 admin admin] PATH_INFO: `/v3/users/cf1b7a6b72cd4d55bd3ccb8683faee36` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:07.660760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72686e4-c265-4c5b-82e9-5596c6b27d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1b7a6b72cd4d55bd3ccb8683faee36)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:07.662985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72686e4-c265-4c5b-82e9-5596c6b27d62 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:07.732782 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:07.764090 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a72686e4-c265-4c5b-82e9-5596c6b27d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1b7a6b72cd4d55bd3ccb8683faee36'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:07.765101 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a72686e4-c265-4c5b-82e9-5596c6b27d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1b7a6b72cd4d55bd3ccb8683faee36'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:07.765786 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a72686e4-c265-4c5b-82e9-5596c6b27d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1b7a6b72cd4d55bd3ccb8683faee36'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:07.777132 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a72686e4-c265-4c5b-82e9-5596c6b27d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1b7a6b72cd4d55bd3ccb8683faee36'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:07.791475 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a72686e4-c265-4c5b-82e9-5596c6b27d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1b7a6b72cd4d55bd3ccb8683faee36'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:07.824258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 851/1716] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:07 2022] DELETE /identity/v3/users/cf1b7a6b72cd4d55bd3ccb8683faee36 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:07.828915 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6e2cd-c563-4aa5-a1c4-d4c09be349b3 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:07.831165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a3865-e5ef-464b-a00d-6374e322b86b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:07.831601 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a3865-e5ef-464b-a00d-6374e322b86b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:07.832031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a3865-e5ef-464b-a00d-6374e322b86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:07.890387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-935a3865-e5ef-464b-a00d-6374e322b86b None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:07.892094 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-935a3865-e5ef-464b-a00d-6374e322b86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:07.937047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:08.028752 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648b3f7-d35b-4aa3-b5ab-6f765c82e3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:08.029503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648b3f7-d35b-4aa3-b5ab-6f765c82e3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:08.030076 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648b3f7-d35b-4aa3-b5ab-6f765c82e3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:08.030356 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648b3f7-d35b-4aa3-b5ab-6f765c82e3c6 admin admin] PATH_INFO: `/v3/projects/cc5807d9d1164d319dbe151733b27432` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:08.032284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648b3f7-d35b-4aa3-b5ab-6f765c82e3c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc5807d9d1164d319dbe151733b27432)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:08.033320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-f648b3f7-d35b-4aa3-b5ab-6f765c82e3c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 07:09:08.033320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: warnings.warn(msg) Aug 09 07:09:08.033320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: Aug 09 07:09:08.036568 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648b3f7-d35b-4aa3-b5ab-6f765c82e3c6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:08.073280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 852/1717] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:08.123754 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a3865-e5ef-464b-a00d-6374e322b86b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:08.125225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-935a3865-e5ef-464b-a00d-6374e322b86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:08.172827 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f648b3f7-d35b-4aa3-b5ab-6f765c82e3c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc5807d9d1164d319dbe151733b27432', 'request_id': 'req-f648b3f7-d35b-4aa3-b5ab-6f765c82e3c6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:08.188373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f648b3f7-d35b-4aa3-b5ab-6f765c82e3c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc5807d9d1164d319dbe151733b27432', 'request_id': 'req-f648b3f7-d35b-4aa3-b5ab-6f765c82e3c6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:08.221949 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f648b3f7-d35b-4aa3-b5ab-6f765c82e3c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc5807d9d1164d319dbe151733b27432', 'request_id': 'req-f648b3f7-d35b-4aa3-b5ab-6f765c82e3c6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:08.251978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f648b3f7-d35b-4aa3-b5ab-6f765c82e3c6 admin admin] The token cache is being invalidate because project cc5807d9d1164d319dbe151733b27432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:08.252162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f648b3f7-d35b-4aa3-b5ab-6f765c82e3c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:08.253384 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f648b3f7-d35b-4aa3-b5ab-6f765c82e3c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:08.258052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 866/1718] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:07 2022] DELETE /identity/v3/projects/cc5807d9d1164d319dbe151733b27432 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:08.259238 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a3865-e5ef-464b-a00d-6374e322b86b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:08.264910 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c523329-4f72-43ec-9dfa-0c4fc436be1b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:08.264910 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c523329-4f72-43ec-9dfa-0c4fc436be1b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:08.264910 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c523329-4f72-43ec-9dfa-0c4fc436be1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:08.310632 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7c523329-4f72-43ec-9dfa-0c4fc436be1b None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:08.312367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7c523329-4f72-43ec-9dfa-0c4fc436be1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:08.429770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4562336-d4f4-443f-839a-0fbd765ccf38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:08.432584 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4562336-d4f4-443f-839a-0fbd765ccf38 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:08.433381 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4562336-d4f4-443f-839a-0fbd765ccf38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:08.435209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4562336-d4f4-443f-839a-0fbd765ccf38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:08.447136 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c4562336-d4f4-443f-839a-0fbd765ccf38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:08.486385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 867/1719] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:08.488068 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c523329-4f72-43ec-9dfa-0c4fc436be1b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:08.490284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7c523329-4f72-43ec-9dfa-0c4fc436be1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:08.512503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c523329-4f72-43ec-9dfa-0c4fc436be1b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:08.520924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f73243-e5b5-4c96-aeaa-2ec622efa07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:08.521468 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:08.521983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f73243-e5b5-4c96-aeaa-2ec622efa07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:08.522515 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f73243-e5b5-4c96-aeaa-2ec622efa07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:08.525929 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f73243-e5b5-4c96-aeaa-2ec622efa07a admin admin] PATH_INFO: `/v3/projects/dad84949a26b4aedacc2fbdd3109457d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:08.528316 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f73243-e5b5-4c96-aeaa-2ec622efa07a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad84949a26b4aedacc2fbdd3109457d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:08.530952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f73243-e5b5-4c96-aeaa-2ec622efa07a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:08.659793 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a8f73243-e5b5-4c96-aeaa-2ec622efa07a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad84949a26b4aedacc2fbdd3109457d', 'request_id': 'req-a8f73243-e5b5-4c96-aeaa-2ec622efa07a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:08.673559 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:08.681531 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4562336-d4f4-443f-839a-0fbd765ccf38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:08.684196 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4562336-d4f4-443f-839a-0fbd765ccf38 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:08.686314 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a8f73243-e5b5-4c96-aeaa-2ec622efa07a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad84949a26b4aedacc2fbdd3109457d', 'request_id': 'req-a8f73243-e5b5-4c96-aeaa-2ec622efa07a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:08.707910 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a8f73243-e5b5-4c96-aeaa-2ec622efa07a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad84949a26b4aedacc2fbdd3109457d', 'request_id': 'req-a8f73243-e5b5-4c96-aeaa-2ec622efa07a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:08.721264 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 853/1720] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:08.727383 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3802600-6c82-437c-8b44-5bd1193d75ed None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:08.727383 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3802600-6c82-437c-8b44-5bd1193d75ed None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:08.727899 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3802600-6c82-437c-8b44-5bd1193d75ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:08.740139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a8f73243-e5b5-4c96-aeaa-2ec622efa07a admin admin] The token cache is being invalidate because project dad84949a26b4aedacc2fbdd3109457d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:08.740641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a8f73243-e5b5-4c96-aeaa-2ec622efa07a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:08.741852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a8f73243-e5b5-4c96-aeaa-2ec622efa07a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:08.752406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 868/1721] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:08 2022] DELETE /identity/v3/projects/dad84949a26b4aedacc2fbdd3109457d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:08.754553 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0dfb5-49c5-411e-849e-537ec48efbaa None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:08.757094 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0dfb5-49c5-411e-849e-537ec48efbaa None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:08.759684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0dfb5-49c5-411e-849e-537ec48efbaa None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:08.762374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 869/1722] 10.222.0.40 () {54 vars in 912 bytes} [Tue Aug 9 07:09:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:09:08.765130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f48c55-1a0d-4e89-9cbd-ac4aeac8893f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:08.765772 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f48c55-1a0d-4e89-9cbd-ac4aeac8893f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:08.766389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f48c55-1a0d-4e89-9cbd-ac4aeac8893f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:08.792220 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f3802600-6c82-437c-8b44-5bd1193d75ed None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:08.797178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f3802600-6c82-437c-8b44-5bd1193d75ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:08.802587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-71f48c55-1a0d-4e89-9cbd-ac4aeac8893f None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:08.804837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-71f48c55-1a0d-4e89-9cbd-ac4aeac8893f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:08.928256 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 870/1723] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:08.930925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1afb3e-c3c3-41fc-a9ae-75453dead673 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:08.931346 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1afb3e-c3c3-41fc-a9ae-75453dead673 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:08.931732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1afb3e-c3c3-41fc-a9ae-75453dead673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:08.990952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ed1afb3e-c3c3-41fc-a9ae-75453dead673 None None] MFA Rules not processed for user `8d75da9360ef490f910fabc3920c8ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:08.992556 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ed1afb3e-c3c3-41fc-a9ae-75453dead673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:09.009382 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 854/1724] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:09.011201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae6514-9f58-45fa-8097-b50c874e6659 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:09.011582 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae6514-9f58-45fa-8097-b50c874e6659 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:09.011859 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae6514-9f58-45fa-8097-b50c874e6659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:09.055497 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a3ae6514-9f58-45fa-8097-b50c874e6659 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:09.057140 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a3ae6514-9f58-45fa-8097-b50c874e6659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:09.088297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 855/1725] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:09.089153 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae6514-9f58-45fa-8097-b50c874e6659 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:09.097951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 871/1726] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Aug 9 07:09:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:09.106504 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae6514-9f58-45fa-8097-b50c874e6659 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:09.109391 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283d729-1d16-4d48-8ae7-b6214233c654 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:09.118898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279f26e-eb49-42ae-abcb-cd267759a900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:09.119563 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279f26e-eb49-42ae-abcb-cd267759a900 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:09.119844 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279f26e-eb49-42ae-abcb-cd267759a900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:09.120117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279f26e-eb49-42ae-abcb-cd267759a900 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:09.120784 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279f26e-eb49-42ae-abcb-cd267759a900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:09:09.121301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283d729-1d16-4d48-8ae7-b6214233c654 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:09.121420 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279f26e-eb49-42ae-abcb-cd267759a900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:09.122019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283d729-1d16-4d48-8ae7-b6214233c654 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:09.123011 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279f26e-eb49-42ae-abcb-cd267759a900 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:09.124994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 872/1727] 10.222.0.40 () {54 vars in 912 bytes} [Tue Aug 9 07:09:09 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:09:09.126200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283d729-1d16-4d48-8ae7-b6214233c654 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:09.151851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283d729-1d16-4d48-8ae7-b6214233c654 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:09.158302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925935b2-6e76-4023-852e-a43a74f42d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:09.163438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 856/1728] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:09:09.163438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb7791-1f24-4c34-995f-987fecdfe8b6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:09.163438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb7791-1f24-4c34-995f-987fecdfe8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:09.163438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb7791-1f24-4c34-995f-987fecdfe8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:09.164541 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925935b2-6e76-4023-852e-a43a74f42d58 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:09.166231 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925935b2-6e76-4023-852e-a43a74f42d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:09.166948 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925935b2-6e76-4023-852e-a43a74f42d58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:09.167976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925935b2-6e76-4023-852e-a43a74f42d58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:09:09.168616 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925935b2-6e76-4023-852e-a43a74f42d58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:09.182550 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925935b2-6e76-4023-852e-a43a74f42d58 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:09.208704 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cecb7791-1f24-4c34-995f-987fecdfe8b6 None None] MFA Rules not processed for user `8d75da9360ef490f910fabc3920c8ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:09.209937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cecb7791-1f24-4c34-995f-987fecdfe8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:09.223070 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 873/1729] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:09:09.224741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925935b2-6e76-4023-852e-a43a74f42d58 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:09.230568 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 857/1730] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Aug 9 07:09:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:09.231428 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb7791-1f24-4c34-995f-987fecdfe8b6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:09.235480 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-925935b2-6e76-4023-852e-a43a74f42d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:09.261350 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb7791-1f24-4c34-995f-987fecdfe8b6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:09.272186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925935b2-6e76-4023-852e-a43a74f42d58 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:09.275889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940aad8-d45e-4006-98c7-189fc845450c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:09.276791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940aad8-d45e-4006-98c7-189fc845450c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:09.276791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940aad8-d45e-4006-98c7-189fc845450c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:09.277064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940aad8-d45e-4006-98c7-189fc845450c admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:09.277706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940aad8-d45e-4006-98c7-189fc845450c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:09.279812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940aad8-d45e-4006-98c7-189fc845450c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:09.284051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4bef4-1edf-42c2-9bf8-45f99d227e92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:09.286489 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4bef4-1edf-42c2-9bf8-45f99d227e92 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:09.286489 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4bef4-1edf-42c2-9bf8-45f99d227e92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:09.287036 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4bef4-1edf-42c2-9bf8-45f99d227e92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:09.310961 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4bef4-1edf-42c2-9bf8-45f99d227e92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:09.315760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4bef4-1edf-42c2-9bf8-45f99d227e92 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:09.338974 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 874/1731] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:09.343064 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4bef4-1edf-42c2-9bf8-45f99d227e92 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:09.348744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 858/1732] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:09 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:09.349620 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940aad8-d45e-4006-98c7-189fc845450c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:09.353555 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3940aad8-d45e-4006-98c7-189fc845450c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:09.378861 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4bef4-1edf-42c2-9bf8-45f99d227e92 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:09.492767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940aad8-d45e-4006-98c7-189fc845450c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:09.506950 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7e23b-5bf8-4f37-bae9-77328b51e8ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:09.507646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7e23b-5bf8-4f37-bae9-77328b51e8ef service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:09.507969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7e23b-5bf8-4f37-bae9-77328b51e8ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:09.508241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7e23b-5bf8-4f37-bae9-77328b51e8ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:09.536439 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:09.547973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7e23b-5bf8-4f37-bae9-77328b51e8ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:09.549477 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7e23b-5bf8-4f37-bae9-77328b51e8ef service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:09.574048 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc267320-7f4b-4a10-96ac-cfa94aea4983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:09.574931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc267320-7f4b-4a10-96ac-cfa94aea4983 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:09.576758 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 859/1733] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:09.579284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc267320-7f4b-4a10-96ac-cfa94aea4983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:09.579637 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc267320-7f4b-4a10-96ac-cfa94aea4983 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:09.580300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc267320-7f4b-4a10-96ac-cfa94aea4983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:09.582010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7e23b-5bf8-4f37-bae9-77328b51e8ef service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:09.590743 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc267320-7f4b-4a10-96ac-cfa94aea4983 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:09.623590 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7e23b-5bf8-4f37-bae9-77328b51e8ef service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:09.644093 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86a2ff-aa25-4291-b567-040b61f475a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:09.644727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86a2ff-aa25-4291-b567-040b61f475a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:09.645269 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86a2ff-aa25-4291-b567-040b61f475a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:09.645556 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86a2ff-aa25-4291-b567-040b61f475a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:09.646268 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86a2ff-aa25-4291-b567-040b61f475a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:09.648284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86a2ff-aa25-4291-b567-040b61f475a4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:09.680012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 875/1734] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:09 2022] POST /identity/v3/projects => generated 377 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:09.682676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc267320-7f4b-4a10-96ac-cfa94aea4983 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:09.684342 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:09.709616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 860/1735] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:09 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:09.713493 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86a2ff-aa25-4291-b567-040b61f475a4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:09.733701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86a2ff-aa25-4291-b567-040b61f475a4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:09.812099 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc267320-7f4b-4a10-96ac-cfa94aea4983 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:09.819435 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee4d94-7abc-4cd4-94a5-9d9ffccef258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:09.831651 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee4d94-7abc-4cd4-94a5-9d9ffccef258 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:09.832180 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee4d94-7abc-4cd4-94a5-9d9ffccef258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:09.832695 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee4d94-7abc-4cd4-94a5-9d9ffccef258 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:09.834672 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee4d94-7abc-4cd4-94a5-9d9ffccef258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:09.842389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee4d94-7abc-4cd4-94a5-9d9ffccef258 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:09.889561 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d7171-43c6-45b7-b092-efd7937230db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:09.889561 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d7171-43c6-45b7-b092-efd7937230db admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:09.889561 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d7171-43c6-45b7-b092-efd7937230db admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:09.889561 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d7171-43c6-45b7-b092-efd7937230db admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:09.889978 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d7171-43c6-45b7-b092-efd7937230db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:09.889978 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d7171-43c6-45b7-b092-efd7937230db admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:09.891185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 876/1736] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:09 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:09.892456 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee4d94-7abc-4cd4-94a5-9d9ffccef258 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:09.903784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee4d94-7abc-4cd4-94a5-9d9ffccef258 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:09.909163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243d2aa-57bd-4963-afda-3efb55b49747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:09.910001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243d2aa-57bd-4963-afda-3efb55b49747 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:09.910476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 861/1737] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:09:09.911120 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243d2aa-57bd-4963-afda-3efb55b49747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:09.911559 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243d2aa-57bd-4963-afda-3efb55b49747 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:09.912358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243d2aa-57bd-4963-afda-3efb55b49747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:09.914251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d7171-43c6-45b7-b092-efd7937230db admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:09.914389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243d2aa-57bd-4963-afda-3efb55b49747 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:09.927499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 877/1738] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:09.932372 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243d2aa-57bd-4963-afda-3efb55b49747 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:09.935667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d7171-43c6-45b7-b092-efd7937230db admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:09.950406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243d2aa-57bd-4963-afda-3efb55b49747 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:09.953233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d2cec-90ae-4a94-8ae0-0ba024c56e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:09.953861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d2cec-90ae-4a94-8ae0-0ba024c56e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:09.954495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d2cec-90ae-4a94-8ae0-0ba024c56e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:09.954495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d2cec-90ae-4a94-8ae0-0ba024c56e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:09.955041 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d2cec-90ae-4a94-8ae0-0ba024c56e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:09.957157 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d2cec-90ae-4a94-8ae0-0ba024c56e77 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:09.959113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6718978-d5b2-4608-a54a-4f3d797e6ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:09.960222 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6718978-d5b2-4608-a54a-4f3d797e6ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:09.960659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6718978-d5b2-4608-a54a-4f3d797e6ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:09.961079 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6718978-d5b2-4608-a54a-4f3d797e6ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:09.962504 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6718978-d5b2-4608-a54a-4f3d797e6ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:09.966407 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6718978-d5b2-4608-a54a-4f3d797e6ed8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:09.982455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 862/1739] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:09.984695 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 878/1740] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:09:09.985030 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d2cec-90ae-4a94-8ae0-0ba024c56e77 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:09.990350 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6718978-d5b2-4608-a54a-4f3d797e6ed8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:10.005717 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d2cec-90ae-4a94-8ae0-0ba024c56e77 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:10.017465 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971aad2-4bd9-45cc-9436-1cdac5b57881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:10.018036 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6718978-d5b2-4608-a54a-4f3d797e6ed8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:10.018173 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971aad2-4bd9-45cc-9436-1cdac5b57881 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:10.018411 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971aad2-4bd9-45cc-9436-1cdac5b57881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:10.018696 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971aad2-4bd9-45cc-9436-1cdac5b57881 admin admin] PATH_INFO: `/v3/projects/6b29cba47bda4693bf53d0bbaaa40847/users/8c0f76775c8a404986c8486a59bab7f6/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:10.030787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c9166-641f-49e3-a0d7-377b96f5a2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:10.031985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c9166-641f-49e3-a0d7-377b96f5a2b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:10.032436 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c9166-641f-49e3-a0d7-377b96f5a2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:10.033400 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c9166-641f-49e3-a0d7-377b96f5a2b5 admin admin] PATH_INFO: `/v3/projects/4b73155275d04769b74eec4778c47993/users/fd3374a159f24c149803b45269243523/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:10.071814 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971aad2-4bd9-45cc-9436-1cdac5b57881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b29cba47bda4693bf53d0bbaaa40847, user_id=8c0f76775c8a404986c8486a59bab7f6, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:10.074318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c9166-641f-49e3-a0d7-377b96f5a2b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b73155275d04769b74eec4778c47993, user_id=fd3374a159f24c149803b45269243523, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:10.077739 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971aad2-4bd9-45cc-9436-1cdac5b57881 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:10.078514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c9166-641f-49e3-a0d7-377b96f5a2b5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:10.100698 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 879/1741] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:09 2022] PUT /identity/v3/projects/4b73155275d04769b74eec4778c47993/users/fd3374a159f24c149803b45269243523/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:10.112403 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480734c-bcda-495a-83f9-6bd5b7d863c7 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:10.113370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480734c-bcda-495a-83f9-6bd5b7d863c7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:10.113627 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480734c-bcda-495a-83f9-6bd5b7d863c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:10.117638 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 863/1742] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:09 2022] PUT /identity/v3/projects/6b29cba47bda4693bf53d0bbaaa40847/users/8c0f76775c8a404986c8486a59bab7f6/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:10.137725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4ba07-ae92-4ee2-971a-c33988b6e37e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:10.142015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4ba07-ae92-4ee2-971a-c33988b6e37e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:10.142491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4ba07-ae92-4ee2-971a-c33988b6e37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:10.205153 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-01a4ba07-ae92-4ee2-971a-c33988b6e37e None None] MFA Rules not processed for user `8c0f76775c8a404986c8486a59bab7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:10.207197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-01a4ba07-ae92-4ee2-971a-c33988b6e37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:10.210005 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0480734c-bcda-495a-83f9-6bd5b7d863c7 None None] MFA Rules not processed for user `fd3374a159f24c149803b45269243523`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:10.212510 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0480734c-bcda-495a-83f9-6bd5b7d863c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:10.318331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 880/1743] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:10.323631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480734c-bcda-495a-83f9-6bd5b7d863c7 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:10.353072 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:10.393020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 864/1744] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:10.398041 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4ba07-ae92-4ee2-971a-c33988b6e37e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:10.551580 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:10.574268 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480734c-bcda-495a-83f9-6bd5b7d863c7 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:10.580782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95e72f-9ac6-4c71-8e3e-1a50b584068a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:10.581458 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95e72f-9ac6-4c71-8e3e-1a50b584068a admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:10.581748 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95e72f-9ac6-4c71-8e3e-1a50b584068a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:10.582959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95e72f-9ac6-4c71-8e3e-1a50b584068a admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:10.583670 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95e72f-9ac6-4c71-8e3e-1a50b584068a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:10.587658 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95e72f-9ac6-4c71-8e3e-1a50b584068a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:10.612253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4ba07-ae92-4ee2-971a-c33988b6e37e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:10.631639 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82541916-2e0c-411e-845a-fed03c99b6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:10.632406 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82541916-2e0c-411e-845a-fed03c99b6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:10.632756 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82541916-2e0c-411e-845a-fed03c99b6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:10.634466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82541916-2e0c-411e-845a-fed03c99b6a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:10.636050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82541916-2e0c-411e-845a-fed03c99b6a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:10.645879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82541916-2e0c-411e-845a-fed03c99b6a8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:10.648627 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 881/1745] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:10 2022] POST /identity/v3/projects => generated 379 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:10.655136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95e72f-9ac6-4c71-8e3e-1a50b584068a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:10.744188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 865/1746] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:10 2022] POST /identity/v3/projects => generated 373 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:10.750224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82541916-2e0c-411e-845a-fed03c99b6a8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:10.866388 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95e72f-9ac6-4c71-8e3e-1a50b584068a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:11.171213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82541916-2e0c-411e-845a-fed03c99b6a8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:11.216069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e3559-2c18-46cb-963b-44e520f7e6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:11.216843 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e3559-2c18-46cb-963b-44e520f7e6ef admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:11.217128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e3559-2c18-46cb-963b-44e520f7e6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:11.217404 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e3559-2c18-46cb-963b-44e520f7e6ef admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:11.218063 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e3559-2c18-46cb-963b-44e520f7e6ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:11.226529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e3559-2c18-46cb-963b-44e520f7e6ef admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:11.239797 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6b70d-89dd-49e1-ab0d-7a4cee35034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:11.242994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6b70d-89dd-49e1-ab0d-7a4cee35034c admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:11.243467 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6b70d-89dd-49e1-ab0d-7a4cee35034c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:11.243583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6b70d-89dd-49e1-ab0d-7a4cee35034c admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:11.244205 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6b70d-89dd-49e1-ab0d-7a4cee35034c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:11.246143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6b70d-89dd-49e1-ab0d-7a4cee35034c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:11.308468 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 882/1747] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:10 2022] POST /identity/v3/users => generated 296 bytes in 659 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:11.313952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6b70d-89dd-49e1-ab0d-7a4cee35034c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:11.330487 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 866/1748] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:10 2022] POST /identity/v3/users => generated 293 bytes in 579 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:11.332591 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e3559-2c18-46cb-963b-44e520f7e6ef admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:11.343508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6b70d-89dd-49e1-ab0d-7a4cee35034c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:11.353591 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c06e3559-2c18-46cb-963b-44e520f7e6ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:11.376545 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b49c3c-afff-4784-908b-b8a6bec53b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:11.377341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b49c3c-afff-4784-908b-b8a6bec53b28 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:11.377627 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b49c3c-afff-4784-908b-b8a6bec53b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:11.386912 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b49c3c-afff-4784-908b-b8a6bec53b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:11.388325 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b49c3c-afff-4784-908b-b8a6bec53b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:11.389974 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b49c3c-afff-4784-908b-b8a6bec53b28 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:11.407989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 883/1749] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:11.408541 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b49c3c-afff-4784-908b-b8a6bec53b28 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:11.419728 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b49c3c-afff-4784-908b-b8a6bec53b28 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:11.426139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d010858-1cea-41df-83c4-3c2e07f1438e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:11.426758 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d010858-1cea-41df-83c4-3c2e07f1438e admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:11.427030 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d010858-1cea-41df-83c4-3c2e07f1438e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:11.427339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d010858-1cea-41df-83c4-3c2e07f1438e admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:11.427979 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d010858-1cea-41df-83c4-3c2e07f1438e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:11.429572 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d010858-1cea-41df-83c4-3c2e07f1438e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:11.442106 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 884/1750] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:11.446590 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d010858-1cea-41df-83c4-3c2e07f1438e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:11.451672 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6d010858-1cea-41df-83c4-3c2e07f1438e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:11.466055 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d010858-1cea-41df-83c4-3c2e07f1438e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:11.478013 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44092f-153c-4b91-af07-dfdc581901fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:11.478968 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44092f-153c-4b91-af07-dfdc581901fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:11.479281 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44092f-153c-4b91-af07-dfdc581901fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:11.479548 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44092f-153c-4b91-af07-dfdc581901fa admin admin] PATH_INFO: `/v3/projects/ebe7a15cc7a94e3c85a691c8174f5552` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:11.483866 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44092f-153c-4b91-af07-dfdc581901fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe7a15cc7a94e3c85a691c8174f5552)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:11.484662 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44092f-153c-4b91-af07-dfdc581901fa admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:11.488349 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:11.501828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e3559-2c18-46cb-963b-44e520f7e6ef admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:11.519306 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832cb02-5150-4041-9f58-7b197f2bb409 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07d2ee351e734fd09938cea9be3bb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:11.519949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832cb02-5150-4041-9f58-7b197f2bb409 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:11.520509 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832cb02-5150-4041-9f58-7b197f2bb409 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:11.520796 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832cb02-5150-4041-9f58-7b197f2bb409 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:11.542336 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2832cb02-5150-4041-9f58-7b197f2bb409 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:11.578711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832cb02-5150-4041-9f58-7b197f2bb409 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:11.584869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832cb02-5150-4041-9f58-7b197f2bb409 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:11.628336 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 867/1751] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:11.629607 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832cb02-5150-4041-9f58-7b197f2bb409 service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:11.632174 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2832cb02-5150-4041-9f58-7b197f2bb409 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:11.638522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ad44092f-153c-4b91-af07-dfdc581901fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe7a15cc7a94e3c85a691c8174f5552', 'request_id': 'req-ad44092f-153c-4b91-af07-dfdc581901fa'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:11.708443 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ad44092f-153c-4b91-af07-dfdc581901fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe7a15cc7a94e3c85a691c8174f5552', 'request_id': 'req-ad44092f-153c-4b91-af07-dfdc581901fa'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:11.733462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832cb02-5150-4041-9f58-7b197f2bb409 service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:11.736284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ad44092f-153c-4b91-af07-dfdc581901fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe7a15cc7a94e3c85a691c8174f5552', 'request_id': 'req-ad44092f-153c-4b91-af07-dfdc581901fa'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:11.799997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ad44092f-153c-4b91-af07-dfdc581901fa admin admin] The token cache is being invalidate because project ebe7a15cc7a94e3c85a691c8174f5552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:11.800809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ad44092f-153c-4b91-af07-dfdc581901fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:11.802876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ad44092f-153c-4b91-af07-dfdc581901fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:11.813470 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 885/1752] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:11 2022] DELETE /identity/v3/projects/ebe7a15cc7a94e3c85a691c8174f5552 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:11.814771 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44092f-153c-4b91-af07-dfdc581901fa admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:11.818787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ad44092f-153c-4b91-af07-dfdc581901fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:11.916699 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:11.967821 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f593ea7-6291-46ed-9152-5e56e5e3d9f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07d2ee351e734fd09938cea9be3bb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:11.968921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f593ea7-6291-46ed-9152-5e56e5e3d9f5 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:11.969409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f593ea7-6291-46ed-9152-5e56e5e3d9f5 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:11.969886 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f593ea7-6291-46ed-9152-5e56e5e3d9f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:11.974501 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3f593ea7-6291-46ed-9152-5e56e5e3d9f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:12.027175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f593ea7-6291-46ed-9152-5e56e5e3d9f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:12.028976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f593ea7-6291-46ed-9152-5e56e5e3d9f5 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:12.037759 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44092f-153c-4b91-af07-dfdc581901fa admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:12.062700 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 868/1753] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:12.063612 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f593ea7-6291-46ed-9152-5e56e5e3d9f5 service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:12.072715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3f593ea7-6291-46ed-9152-5e56e5e3d9f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:12.074719 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02c441-c833-4d70-b522-682a8b0a3354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:12.076925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02c441-c833-4d70-b522-682a8b0a3354 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:12.079463 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02c441-c833-4d70-b522-682a8b0a3354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:12.080661 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02c441-c833-4d70-b522-682a8b0a3354 admin admin] PATH_INFO: `/v3/projects/8aabc5ae88d14c17a794c3f7aa20aea7/users/3a8055957b164fa880aa13d856a831d3/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:12.139045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02c441-c833-4d70-b522-682a8b0a3354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aabc5ae88d14c17a794c3f7aa20aea7, user_id=3a8055957b164fa880aa13d856a831d3, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:12.148160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f593ea7-6291-46ed-9152-5e56e5e3d9f5 service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:12.150566 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02c441-c833-4d70-b522-682a8b0a3354 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:12.166666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603e237-5fd7-4cb8-8950-91aa82d036ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:12.167314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603e237-5fd7-4cb8-8950-91aa82d036ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:12.180925 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603e237-5fd7-4cb8-8950-91aa82d036ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:12.181362 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603e237-5fd7-4cb8-8950-91aa82d036ff admin admin] PATH_INFO: `/v3/projects/6a17f83b6a5144aab4c765995a9a1d4e/users/059da3a13f994c0fb8dbeec63e9a4656/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:12.199935 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 886/1754] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:11 2022] PUT /identity/v3/projects/8aabc5ae88d14c17a794c3f7aa20aea7/users/3a8055957b164fa880aa13d856a831d3/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:12.203118 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607e576-1c78-4e4b-9c07-4a530e91aa6e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:12.203409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607e576-1c78-4e4b-9c07-4a530e91aa6e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:12.203684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607e576-1c78-4e4b-9c07-4a530e91aa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:12.265296 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603e237-5fd7-4cb8-8950-91aa82d036ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a17f83b6a5144aab4c765995a9a1d4e, user_id=059da3a13f994c0fb8dbeec63e9a4656, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:12.272366 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7607e576-1c78-4e4b-9c07-4a530e91aa6e None None] MFA Rules not processed for user `86b1015b309e4b06b21269892fbc8287`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:12.278484 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7607e576-1c78-4e4b-9c07-4a530e91aa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:12.289196 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603e237-5fd7-4cb8-8950-91aa82d036ff admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:12.344553 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 869/1755] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:12 2022] PUT /identity/v3/projects/6a17f83b6a5144aab4c765995a9a1d4e/users/059da3a13f994c0fb8dbeec63e9a4656/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:12.346914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603e237-5fd7-4cb8-8950-91aa82d036ff admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:12.358721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d603e237-5fd7-4cb8-8950-91aa82d036ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:12.551513 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 887/1756] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:12.566676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607e576-1c78-4e4b-9c07-4a530e91aa6e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:12.667055 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:12.681632 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603e237-5fd7-4cb8-8950-91aa82d036ff admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:12.718292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb200b73-a8f6-4f90-bf0f-a3716eb9595a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:12.720711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb200b73-a8f6-4f90-bf0f-a3716eb9595a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:12.725016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb200b73-a8f6-4f90-bf0f-a3716eb9595a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:12.726504 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb200b73-a8f6-4f90-bf0f-a3716eb9595a admin admin] PATH_INFO: `/v3/users/a2cb6aea4dcd440185d18c3cab413a90` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:12.734071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb200b73-a8f6-4f90-bf0f-a3716eb9595a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2cb6aea4dcd440185d18c3cab413a90)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:12.745855 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb200b73-a8f6-4f90-bf0f-a3716eb9595a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:12.921038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607e576-1c78-4e4b-9c07-4a530e91aa6e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:12.943400 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe6681-ae0d-4b9d-9025-4f924bd6d54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:12.951197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe6681-ae0d-4b9d-9025-4f924bd6d54a admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:12.951535 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe6681-ae0d-4b9d-9025-4f924bd6d54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:12.951711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb200b73-a8f6-4f90-bf0f-a3716eb9595a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2cb6aea4dcd440185d18c3cab413a90'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:12.952229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe6681-ae0d-4b9d-9025-4f924bd6d54a admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:12.953265 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb200b73-a8f6-4f90-bf0f-a3716eb9595a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2cb6aea4dcd440185d18c3cab413a90'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:12.954434 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb200b73-a8f6-4f90-bf0f-a3716eb9595a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2cb6aea4dcd440185d18c3cab413a90'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:12.955687 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe6681-ae0d-4b9d-9025-4f924bd6d54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:12.966124 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe6681-ae0d-4b9d-9025-4f924bd6d54a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:12.983814 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb200b73-a8f6-4f90-bf0f-a3716eb9595a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2cb6aea4dcd440185d18c3cab413a90'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:13.007792 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb200b73-a8f6-4f90-bf0f-a3716eb9595a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2cb6aea4dcd440185d18c3cab413a90'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:13.019858 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 888/1757] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:13.020908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe6681-ae0d-4b9d-9025-4f924bd6d54a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:13.022824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7bbe6681-ae0d-4b9d-9025-4f924bd6d54a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:13.038549 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe6681-ae0d-4b9d-9025-4f924bd6d54a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:13.046174 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779e1e4-f156-424c-ad5a-e9a2558ee432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:13.047182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779e1e4-f156-424c-ad5a-e9a2558ee432 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:13.047648 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779e1e4-f156-424c-ad5a-e9a2558ee432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:13.048053 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779e1e4-f156-424c-ad5a-e9a2558ee432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:13.049189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779e1e4-f156-424c-ad5a-e9a2558ee432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:13.051687 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779e1e4-f156-424c-ad5a-e9a2558ee432 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:13.067231 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 889/1758] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:13.068997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd9e87-91f8-4f10-a0f7-f7e20ccbf998 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:13.069426 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd9e87-91f8-4f10-a0f7-f7e20ccbf998 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:13.069908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd9e87-91f8-4f10-a0f7-f7e20ccbf998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:13.077567 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 870/1759] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:12 2022] DELETE /identity/v3/users/a2cb6aea4dcd440185d18c3cab413a90 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:13.080078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb200b73-a8f6-4f90-bf0f-a3716eb9595a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:13.100041 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cb200b73-a8f6-4f90-bf0f-a3716eb9595a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:13.177392 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-94fd9e87-91f8-4f10-a0f7-f7e20ccbf998 None None] MFA Rules not processed for user `6cead1e7fb98489fbe122f9bff8a63b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:13.178620 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-94fd9e87-91f8-4f10-a0f7-f7e20ccbf998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:13.240625 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:13.299612 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb200b73-a8f6-4f90-bf0f-a3716eb9595a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:13.318616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24367d6-33d7-4943-945c-ed060c1aa74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:13.319338 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24367d6-33d7-4943-945c-ed060c1aa74a admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:13.319616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24367d6-33d7-4943-945c-ed060c1aa74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:13.319908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24367d6-33d7-4943-945c-ed060c1aa74a admin admin] PATH_INFO: `/v3/projects/8aabc5ae88d14c17a794c3f7aa20aea7/users/3a8055957b164fa880aa13d856a831d3/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:13.328539 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24367d6-33d7-4943-945c-ed060c1aa74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aabc5ae88d14c17a794c3f7aa20aea7, user_id=3a8055957b164fa880aa13d856a831d3, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:13.333685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24367d6-33d7-4943-945c-ed060c1aa74a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:13.374321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 871/1760] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:13 2022] PUT /identity/v3/projects/8aabc5ae88d14c17a794c3f7aa20aea7/users/3a8055957b164fa880aa13d856a831d3/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:13.388559 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24367d6-33d7-4943-945c-ed060c1aa74a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:13.505268 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 890/1761] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:13.506680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f60e7-4b22-4cd5-816a-2e94ed0c7d52 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:13.506963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f60e7-4b22-4cd5-816a-2e94ed0c7d52 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:13.507258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f60e7-4b22-4cd5-816a-2e94ed0c7d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:13.628360 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c43f60e7-4b22-4cd5-816a-2e94ed0c7d52 None None] MFA Rules not processed for user `3a8055957b164fa880aa13d856a831d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:13.629734 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c43f60e7-4b22-4cd5-816a-2e94ed0c7d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:13.681255 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24367d6-33d7-4943-945c-ed060c1aa74a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:13.698941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b342a46-b7b4-43af-824c-c2fb0352b5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:13.699964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b342a46-b7b4-43af-824c-c2fb0352b5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:13.700394 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b342a46-b7b4-43af-824c-c2fb0352b5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:13.700663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b342a46-b7b4-43af-824c-c2fb0352b5b8 admin admin] PATH_INFO: `/v3/projects/6a17f83b6a5144aab4c765995a9a1d4e/users/059da3a13f994c0fb8dbeec63e9a4656/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:13.704901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b342a46-b7b4-43af-824c-c2fb0352b5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a17f83b6a5144aab4c765995a9a1d4e, user_id=059da3a13f994c0fb8dbeec63e9a4656, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:13.709669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b342a46-b7b4-43af-824c-c2fb0352b5b8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:13.738188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 872/1762] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:13 2022] PUT /identity/v3/projects/6a17f83b6a5144aab4c765995a9a1d4e/users/059da3a13f994c0fb8dbeec63e9a4656/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:13.742017 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b342a46-b7b4-43af-824c-c2fb0352b5b8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:13.745745 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3b342a46-b7b4-43af-824c-c2fb0352b5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:13.803539 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 891/1763] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:13.805596 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0cf56-643e-4bf1-aefb-2be166d078a8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:13.806227 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0cf56-643e-4bf1-aefb-2be166d078a8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:13.806745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0cf56-643e-4bf1-aefb-2be166d078a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:13.896001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-cda0cf56-643e-4bf1-aefb-2be166d078a8 None None] MFA Rules not processed for user `059da3a13f994c0fb8dbeec63e9a4656`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:13.897782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cda0cf56-643e-4bf1-aefb-2be166d078a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:13.921012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:13.923447 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b342a46-b7b4-43af-824c-c2fb0352b5b8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:13.947530 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d1a40-513b-4a73-a9d6-981d3ee489b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:13.948172 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d1a40-513b-4a73-a9d6-981d3ee489b1 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:13.948440 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d1a40-513b-4a73-a9d6-981d3ee489b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:13.948695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d1a40-513b-4a73-a9d6-981d3ee489b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:14.133150 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 892/1764] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:14.135503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0cf56-643e-4bf1-aefb-2be166d078a8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:14.153221 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cda0cf56-643e-4bf1-aefb-2be166d078a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:14.198212 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d1a40-513b-4a73-a9d6-981d3ee489b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:14.204610 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d1a40-513b-4a73-a9d6-981d3ee489b1 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:14.218065 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:14.236337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 873/1765] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:14.237858 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d1a40-513b-4a73-a9d6-981d3ee489b1 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:14.240898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3c4d1a40-513b-4a73-a9d6-981d3ee489b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:14.349752 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0cf56-643e-4bf1-aefb-2be166d078a8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:14.354004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce944a-9c73-4483-bbf3-9dd53eb56cbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:14.354711 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce944a-9c73-4483-bbf3-9dd53eb56cbe service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:14.354993 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce944a-9c73-4483-bbf3-9dd53eb56cbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:14.355287 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce944a-9c73-4483-bbf3-9dd53eb56cbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:14.361964 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-88ce944a-9c73-4483-bbf3-9dd53eb56cbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:14.369965 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d1a40-513b-4a73-a9d6-981d3ee489b1 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:14.376274 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cff08-6a12-44f9-90e5-57d09869b9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:14.377270 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cff08-6a12-44f9-90e5-57d09869b9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:14.377760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cff08-6a12-44f9-90e5-57d09869b9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:14.378239 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cff08-6a12-44f9-90e5-57d09869b9b0 admin admin] PATH_INFO: `/v3/projects/f3024256e5bc411e9c345cb8bdc016b7` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:14.379780 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685cff08-6a12-44f9-90e5-57d09869b9b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3024256e5bc411e9c345cb8bdc016b7)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:14.382327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685cff08-6a12-44f9-90e5-57d09869b9b0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:14.514601 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-685cff08-6a12-44f9-90e5-57d09869b9b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3024256e5bc411e9c345cb8bdc016b7', 'request_id': 'req-685cff08-6a12-44f9-90e5-57d09869b9b0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:14.518757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce944a-9c73-4483-bbf3-9dd53eb56cbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:14.521343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce944a-9c73-4483-bbf3-9dd53eb56cbe service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:14.537745 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-685cff08-6a12-44f9-90e5-57d09869b9b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3024256e5bc411e9c345cb8bdc016b7', 'request_id': 'req-685cff08-6a12-44f9-90e5-57d09869b9b0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:14.554331 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-685cff08-6a12-44f9-90e5-57d09869b9b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3024256e5bc411e9c345cb8bdc016b7', 'request_id': 'req-685cff08-6a12-44f9-90e5-57d09869b9b0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:14.566001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 893/1766] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:14.571906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce944a-9c73-4483-bbf3-9dd53eb56cbe service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:14.580495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-88ce944a-9c73-4483-bbf3-9dd53eb56cbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:14.584217 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-685cff08-6a12-44f9-90e5-57d09869b9b0 admin admin] The token cache is being invalidate because project f3024256e5bc411e9c345cb8bdc016b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:14.584513 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-685cff08-6a12-44f9-90e5-57d09869b9b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:14.588348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-685cff08-6a12-44f9-90e5-57d09869b9b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:14.591598 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 874/1767] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:14 2022] DELETE /identity/v3/projects/f3024256e5bc411e9c345cb8bdc016b7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:14.596948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457da69-d6cd-4c99-b3ee-f1d179a127ee None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:14.597968 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457da69-d6cd-4c99-b3ee-f1d179a127ee None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:14.598528 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457da69-d6cd-4c99-b3ee-f1d179a127ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:14.631825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce944a-9c73-4483-bbf3-9dd53eb56cbe service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:14.761936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c457da69-d6cd-4c99-b3ee-f1d179a127ee None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:14.763214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c457da69-d6cd-4c99-b3ee-f1d179a127ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:14.861483 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2505fef-c435-46e4-9036-7df4dc97263e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:14.862459 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2505fef-c435-46e4-9036-7df4dc97263e service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:14.862861 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2505fef-c435-46e4-9036-7df4dc97263e service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:14.863468 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2505fef-c435-46e4-9036-7df4dc97263e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:14.866673 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d2505fef-c435-46e4-9036-7df4dc97263e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:14.899942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:15.064196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2505fef-c435-46e4-9036-7df4dc97263e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:15.065928 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2505fef-c435-46e4-9036-7df4dc97263e service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:15.099446 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 875/1768] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:15.112583 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85617a-067e-47bc-b28e-407895703564 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:15.112898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85617a-067e-47bc-b28e-407895703564 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:15.113137 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85617a-067e-47bc-b28e-407895703564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:15.138919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 894/1769] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:15.223689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-af85617a-067e-47bc-b28e-407895703564 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:15.228037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538af52-2e49-4da3-b9d2-6a8c25957ed0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:15.228037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538af52-2e49-4da3-b9d2-6a8c25957ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:15.228037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538af52-2e49-4da3-b9d2-6a8c25957ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:15.228332 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-af85617a-067e-47bc-b28e-407895703564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:15.254888 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 876/1770] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:15.262324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85617a-067e-47bc-b28e-407895703564 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:15.289219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85617a-067e-47bc-b28e-407895703564 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:15.322576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67308348-d9da-4542-b7df-245f1a9810a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:15.323263 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67308348-d9da-4542-b7df-245f1a9810a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:15.323546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67308348-d9da-4542-b7df-245f1a9810a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:15.323810 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67308348-d9da-4542-b7df-245f1a9810a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:15.324803 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67308348-d9da-4542-b7df-245f1a9810a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:09:15.325107 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67308348-d9da-4542-b7df-245f1a9810a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:15.327766 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67308348-d9da-4542-b7df-245f1a9810a7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:15.342239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6538af52-2e49-4da3-b9d2-6a8c25957ed0 None None] MFA Rules not processed for user `4c652bdbf6fb432eb25b6be62b5b5077`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:15.345252 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6538af52-2e49-4da3-b9d2-6a8c25957ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:15.402936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 877/1771] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:09:15.414179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67308348-d9da-4542-b7df-245f1a9810a7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:15.468004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67308348-d9da-4542-b7df-245f1a9810a7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:15.482639 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5b0d6-0d29-42f2-8da2-c0b2aff884dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:15.483701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5b0d6-0d29-42f2-8da2-c0b2aff884dc admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:15.484199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5b0d6-0d29-42f2-8da2-c0b2aff884dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:15.485219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5b0d6-0d29-42f2-8da2-c0b2aff884dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:15.486103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5b0d6-0d29-42f2-8da2-c0b2aff884dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:15.488841 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5b0d6-0d29-42f2-8da2-c0b2aff884dc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:15.517107 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:15.532127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 895/1772] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:15.557556 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538af52-2e49-4da3-b9d2-6a8c25957ed0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:15.559602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6538af52-2e49-4da3-b9d2-6a8c25957ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:15.577807 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 878/1773] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:15 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:15.598056 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5b0d6-0d29-42f2-8da2-c0b2aff884dc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:15.976398 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538af52-2e49-4da3-b9d2-6a8c25957ed0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:15.989876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5b0d6-0d29-42f2-8da2-c0b2aff884dc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:16.001310 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3271e1-2ff7-4bf3-8bbf-29ed447a60fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:16.004825 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3271e1-2ff7-4bf3-8bbf-29ed447a60fc admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:16.005387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3271e1-2ff7-4bf3-8bbf-29ed447a60fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:16.006042 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3271e1-2ff7-4bf3-8bbf-29ed447a60fc admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:16.007348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3271e1-2ff7-4bf3-8bbf-29ed447a60fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:16.021140 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3271e1-2ff7-4bf3-8bbf-29ed447a60fc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:16.069793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 879/1774] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:15 2022] POST /identity/v3/users => generated 289 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:16.076862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3271e1-2ff7-4bf3-8bbf-29ed447a60fc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:16.103726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3271e1-2ff7-4bf3-8bbf-29ed447a60fc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:16.121563 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1dc7a-58cc-4d2d-8b78-b671ab8baa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:16.123367 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1dc7a-58cc-4d2d-8b78-b671ab8baa38 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:16.123752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1dc7a-58cc-4d2d-8b78-b671ab8baa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:16.124128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1dc7a-58cc-4d2d-8b78-b671ab8baa38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:16.124943 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1dc7a-58cc-4d2d-8b78-b671ab8baa38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:16.136902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1dc7a-58cc-4d2d-8b78-b671ab8baa38 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:16.172229 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 880/1775] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:16.174461 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1dc7a-58cc-4d2d-8b78-b671ab8baa38 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:16.212533 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1dc7a-58cc-4d2d-8b78-b671ab8baa38 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:16.250081 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4e686-a48a-4c82-b913-f42255eda07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:16.251468 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4e686-a48a-4c82-b913-f42255eda07c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:16.252469 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4e686-a48a-4c82-b913-f42255eda07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:16.254495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4e686-a48a-4c82-b913-f42255eda07c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:16.256967 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4e686-a48a-4c82-b913-f42255eda07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:16.269168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4e686-a48a-4c82-b913-f42255eda07c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:16.292412 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:16.324187 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 881/1776] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:16.325561 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4e686-a48a-4c82-b913-f42255eda07c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:16.371254 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4e686-a48a-4c82-b913-f42255eda07c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:16.389197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ffbf3-82e9-46f9-b8c2-af90a154a220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:16.390224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ffbf3-82e9-46f9-b8c2-af90a154a220 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:16.390839 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ffbf3-82e9-46f9-b8c2-af90a154a220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:16.391257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ffbf3-82e9-46f9-b8c2-af90a154a220 admin admin] PATH_INFO: `/v3/projects/451ff2058c574bf1badeab5140d307e4/users/0d8b0fbb78314df8bd11a25f97df4eb8/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:16.449207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33990af6-41f0-4b5b-842e-24c7d6ac5561 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:16.450116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33990af6-41f0-4b5b-842e-24c7d6ac5561 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:16.450407 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33990af6-41f0-4b5b-842e-24c7d6ac5561 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:16.452151 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ffbf3-82e9-46f9-b8c2-af90a154a220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451ff2058c574bf1badeab5140d307e4, user_id=0d8b0fbb78314df8bd11a25f97df4eb8, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:16.452841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33990af6-41f0-4b5b-842e-24c7d6ac5561 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:16.456339 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ffbf3-82e9-46f9-b8c2-af90a154a220 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:16.511311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 882/1777] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:16 2022] PUT /identity/v3/projects/451ff2058c574bf1badeab5140d307e4/users/0d8b0fbb78314df8bd11a25f97df4eb8/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:16.515073 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae336cc-01b7-40c2-8d3d-b15a8b5fc2a4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:16.520529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae336cc-01b7-40c2-8d3d-b15a8b5fc2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:16.521038 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae336cc-01b7-40c2-8d3d-b15a8b5fc2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:16.626532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2ae336cc-01b7-40c2-8d3d-b15a8b5fc2a4 None None] MFA Rules not processed for user `0d8b0fbb78314df8bd11a25f97df4eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:16.636669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2ae336cc-01b7-40c2-8d3d-b15a8b5fc2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:16.715884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33990af6-41f0-4b5b-842e-24c7d6ac5561 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:16.724595 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33990af6-41f0-4b5b-842e-24c7d6ac5561 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:16.768621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 896/1778] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 1211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:16.771128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33990af6-41f0-4b5b-842e-24c7d6ac5561 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:16.781184 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-33990af6-41f0-4b5b-842e-24c7d6ac5561 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:16.846792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33990af6-41f0-4b5b-842e-24c7d6ac5561 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:16.893972 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 883/1779] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:16.899282 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae336cc-01b7-40c2-8d3d-b15a8b5fc2a4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:16.962316 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:16.991275 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a32d42-2c55-42b1-abfd-9d491e37ce1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:16.991931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a32d42-2c55-42b1-abfd-9d491e37ce1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:16.992215 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a32d42-2c55-42b1-abfd-9d491e37ce1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:16.992995 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a32d42-2c55-42b1-abfd-9d491e37ce1e admin admin] PATH_INFO: `/v3/users/8c0f76775c8a404986c8486a59bab7f6` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:16.995701 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a32d42-2c55-42b1-abfd-9d491e37ce1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c0f76775c8a404986c8486a59bab7f6)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:17.011102 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a32d42-2c55-42b1-abfd-9d491e37ce1e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:17.061576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae336cc-01b7-40c2-8d3d-b15a8b5fc2a4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:17.077304 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07338b99-a187-4c01-b219-c024c2fdf4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:17.078197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07338b99-a187-4c01-b219-c024c2fdf4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:17.078697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07338b99-a187-4c01-b219-c024c2fdf4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:17.079215 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07338b99-a187-4c01-b219-c024c2fdf4f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:17.080064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07338b99-a187-4c01-b219-c024c2fdf4f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:17.082372 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07338b99-a187-4c01-b219-c024c2fdf4f8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:17.143128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 884/1780] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:16 2022] POST /identity/v3/projects => generated 375 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:17.144696 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f51ea1-080a-4082-b38a-5d44921d0f56 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:17.147401 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f51ea1-080a-4082-b38a-5d44921d0f56 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:17.147802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f51ea1-080a-4082-b38a-5d44921d0f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:17.195263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-29a32d42-2c55-42b1-abfd-9d491e37ce1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c0f76775c8a404986c8486a59bab7f6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:17.238558 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-29a32d42-2c55-42b1-abfd-9d491e37ce1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c0f76775c8a404986c8486a59bab7f6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:17.240289 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-29a32d42-2c55-42b1-abfd-9d491e37ce1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c0f76775c8a404986c8486a59bab7f6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:17.281139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-20f51ea1-080a-4082-b38a-5d44921d0f56 None None] MFA Rules not processed for user `664e4353726c42c9bfb80b1701d35aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:17.282369 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-20f51ea1-080a-4082-b38a-5d44921d0f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:17.293921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-29a32d42-2c55-42b1-abfd-9d491e37ce1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c0f76775c8a404986c8486a59bab7f6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:17.307499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:17.316425 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-29a32d42-2c55-42b1-abfd-9d491e37ce1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c0f76775c8a404986c8486a59bab7f6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:17.372056 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 897/1781] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:16 2022] DELETE /identity/v3/users/8c0f76775c8a404986c8486a59bab7f6 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:17.374297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a32d42-2c55-42b1-abfd-9d491e37ce1e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:17.378361 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-29a32d42-2c55-42b1-abfd-9d491e37ce1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:17.473573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 885/1782] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Aug 9 07:09:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:17.474503 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f51ea1-080a-4082-b38a-5d44921d0f56 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:17.480456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-20f51ea1-080a-4082-b38a-5d44921d0f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:17.561704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a32d42-2c55-42b1-abfd-9d491e37ce1e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:17.574294 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f8d7f-7795-4951-a8bf-5dc297120830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:17.575694 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f8d7f-7795-4951-a8bf-5dc297120830 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:17.576441 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f8d7f-7795-4951-a8bf-5dc297120830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:17.576781 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f8d7f-7795-4951-a8bf-5dc297120830 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:17.577636 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f8d7f-7795-4951-a8bf-5dc297120830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:17.581724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f8d7f-7795-4951-a8bf-5dc297120830 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:17.623076 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 898/1783] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:17 2022] POST /identity/v3/users => generated 294 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:17.624832 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd513ac-62a3-4f72-8779-87da98d0c34d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:17.625333 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd513ac-62a3-4f72-8779-87da98d0c34d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:17.625814 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd513ac-62a3-4f72-8779-87da98d0c34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:17.635113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f51ea1-080a-4082-b38a-5d44921d0f56 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:17.674647 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3bd513ac-62a3-4f72-8779-87da98d0c34d None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:17.677422 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3bd513ac-62a3-4f72-8779-87da98d0c34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:17.698973 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 899/1784] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:17.700178 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd513ac-62a3-4f72-8779-87da98d0c34d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:17.723908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd513ac-62a3-4f72-8779-87da98d0c34d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:17.740440 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa3495-80af-433c-89ce-02c2821cb621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:17.741402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa3495-80af-433c-89ce-02c2821cb621 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:17.741809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa3495-80af-433c-89ce-02c2821cb621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:17.742300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa3495-80af-433c-89ce-02c2821cb621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:17.743732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa3495-80af-433c-89ce-02c2821cb621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:17.749024 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa3495-80af-433c-89ce-02c2821cb621 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:17.771067 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:17.781393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 900/1785] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:17.785669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa3495-80af-433c-89ce-02c2821cb621 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:17.790133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3aaa3495-80af-433c-89ce-02c2821cb621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:17.824750 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510fc79-603d-4105-8b6d-a3d6b72a6204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:17.825539 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510fc79-603d-4105-8b6d-a3d6b72a6204 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:17.825674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510fc79-603d-4105-8b6d-a3d6b72a6204 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:17.825918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510fc79-603d-4105-8b6d-a3d6b72a6204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:17.827832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8510fc79-603d-4105-8b6d-a3d6b72a6204 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:17.905521 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa3495-80af-433c-89ce-02c2821cb621 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:17.915794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea268f-fa17-499c-96a4-222593173ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:17.917002 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea268f-fa17-499c-96a4-222593173ede service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:17.917002 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea268f-fa17-499c-96a4-222593173ede service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:17.917274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea268f-fa17-499c-96a4-222593173ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:17.940062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea268f-fa17-499c-96a4-222593173ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:17.943709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea268f-fa17-499c-96a4-222593173ede service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:17.970399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 901/1786] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:17.971536 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea268f-fa17-499c-96a4-222593173ede service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:17.974393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-22ea268f-fa17-499c-96a4-222593173ede service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:18.014773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510fc79-603d-4105-8b6d-a3d6b72a6204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:18.016487 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510fc79-603d-4105-8b6d-a3d6b72a6204 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:18.028969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 886/1787] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:18.030278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510fc79-603d-4105-8b6d-a3d6b72a6204 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:18.047964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510fc79-603d-4105-8b6d-a3d6b72a6204 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:18.070215 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a746b-d57f-46c9-80c1-abc7ba7ae359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:18.072770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a746b-d57f-46c9-80c1-abc7ba7ae359 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:18.073579 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a746b-d57f-46c9-80c1-abc7ba7ae359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:18.073894 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a746b-d57f-46c9-80c1-abc7ba7ae359 admin admin] PATH_INFO: `/v3/projects/d52886dd44c243f79c9db68bec1a3c33/users/34deebee004244db838973ade99467c0/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:18.097788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a746b-d57f-46c9-80c1-abc7ba7ae359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52886dd44c243f79c9db68bec1a3c33, user_id=34deebee004244db838973ade99467c0, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:18.101320 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a746b-d57f-46c9-80c1-abc7ba7ae359 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:18.127354 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 887/1788] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:18 2022] PUT /identity/v3/projects/d52886dd44c243f79c9db68bec1a3c33/users/34deebee004244db838973ade99467c0/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:18.132353 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a746b-d57f-46c9-80c1-abc7ba7ae359 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:18.158317 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:18.262781 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea268f-fa17-499c-96a4-222593173ede service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:18.273204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a746b-d57f-46c9-80c1-abc7ba7ae359 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:18.284912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0258872-aa38-4412-be58-4ad3a0f8f207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:18.285551 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0258872-aa38-4412-be58-4ad3a0f8f207 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:18.288803 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0258872-aa38-4412-be58-4ad3a0f8f207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:18.289120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0258872-aa38-4412-be58-4ad3a0f8f207 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:18.293688 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0258872-aa38-4412-be58-4ad3a0f8f207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:18.297484 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0258872-aa38-4412-be58-4ad3a0f8f207 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:18.322786 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 888/1789] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:09:18.327639 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0258872-aa38-4412-be58-4ad3a0f8f207 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:18.351192 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0258872-aa38-4412-be58-4ad3a0f8f207 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:18.363839 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cac199-9530-45dd-ada7-862944492bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:18.364525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cac199-9530-45dd-ada7-862944492bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:18.364826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cac199-9530-45dd-ada7-862944492bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:18.365162 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cac199-9530-45dd-ada7-862944492bdb admin admin] PATH_INFO: `/v3/projects/d52886dd44c243f79c9db68bec1a3c33/users/34deebee004244db838973ade99467c0/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:18.372026 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cac199-9530-45dd-ada7-862944492bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52886dd44c243f79c9db68bec1a3c33, user_id=34deebee004244db838973ade99467c0, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:18.374837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cac199-9530-45dd-ada7-862944492bdb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:18.399823 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 889/1790] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:18 2022] PUT /identity/v3/projects/d52886dd44c243f79c9db68bec1a3c33/users/34deebee004244db838973ade99467c0/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:18.410132 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceecbcd-0b4d-4d24-b6a4-06ba7727337a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:18.410556 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceecbcd-0b4d-4d24-b6a4-06ba7727337a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:18.410847 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceecbcd-0b4d-4d24-b6a4-06ba7727337a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:18.465896 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9a138-5d42-4086-9639-6853a3129482 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f19a17424c44eea58efb957246cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:18.466645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9a138-5d42-4086-9639-6853a3129482 service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:18.466936 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9a138-5d42-4086-9639-6853a3129482 service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:18.467251 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9a138-5d42-4086-9639-6853a3129482 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:18.491740 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3ceecbcd-0b4d-4d24-b6a4-06ba7727337a None None] MFA Rules not processed for user `34deebee004244db838973ade99467c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:18.494641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3ceecbcd-0b4d-4d24-b6a4-06ba7727337a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:18.616893 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:18.690735 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9a138-5d42-4086-9639-6853a3129482 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:18.701449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9a138-5d42-4086-9639-6853a3129482 service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:18.750142 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 902/1791] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Aug 9 07:09:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 779 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 07:09:18.765939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 890/1792] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:18.787137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9a138-5d42-4086-9639-6853a3129482 service swift] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:18.788977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5ff9a138-5d42-4086-9639-6853a3129482 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:18.929236 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9a138-5d42-4086-9639-6853a3129482 service swift] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:19.102460 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:19.130062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaec36-7ce1-43ef-aa4a-b7f959807666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:19.131170 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaec36-7ce1-43ef-aa4a-b7f959807666 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:19.132499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaec36-7ce1-43ef-aa4a-b7f959807666 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:19.135192 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaec36-7ce1-43ef-aa4a-b7f959807666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:19.143209 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8aeaec36-7ce1-43ef-aa4a-b7f959807666 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:19.350105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeaec36-7ce1-43ef-aa4a-b7f959807666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:19.352032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeaec36-7ce1-43ef-aa4a-b7f959807666 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:19.389563 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 903/1793] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:20.974049 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ab07d-911c-421f-8152-88298199fe7c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:20.974783 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ab07d-911c-421f-8152-88298199fe7c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:20.974783 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ab07d-911c-421f-8152-88298199fe7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:21.036057 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7b3ab07d-911c-421f-8152-88298199fe7c None None] MFA Rules not processed for user `8d75da9360ef490f910fabc3920c8ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:21.037391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7b3ab07d-911c-421f-8152-88298199fe7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:21.209111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 891/1794] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Aug 9 07:09:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:21.249873 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaec36-7ce1-43ef-aa4a-b7f959807666 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:21.274734 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaec36-7ce1-43ef-aa4a-b7f959807666 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:21.328197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad59dc-27f0-45c8-a0ff-4818ae2bfc20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:21.330578 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad59dc-27f0-45c8-a0ff-4818ae2bfc20 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:21.331625 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad59dc-27f0-45c8-a0ff-4818ae2bfc20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:21.334500 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad59dc-27f0-45c8-a0ff-4818ae2bfc20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:21.388077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad59dc-27f0-45c8-a0ff-4818ae2bfc20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:21.393474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad59dc-27f0-45c8-a0ff-4818ae2bfc20 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:21.434547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 904/1795] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:09:21.624325 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ab07d-911c-421f-8152-88298199fe7c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:21.625923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7b3ab07d-911c-421f-8152-88298199fe7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:21.653328 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ab07d-911c-421f-8152-88298199fe7c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:21.663312 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6443ce7-c94f-4b99-a915-47e502aa2082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:21.664049 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6443ce7-c94f-4b99-a915-47e502aa2082 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:21.674833 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6443ce7-c94f-4b99-a915-47e502aa2082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:21.675385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6443ce7-c94f-4b99-a915-47e502aa2082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:21.707064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6443ce7-c94f-4b99-a915-47e502aa2082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:21.713327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6443ce7-c94f-4b99-a915-47e502aa2082 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:21.760627 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 892/1796] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:21.957172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad59dc-27f0-45c8-a0ff-4818ae2bfc20 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:21.958690 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-aaad59dc-27f0-45c8-a0ff-4818ae2bfc20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:22.169584 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f0702-d39c-4f86-89a8-6bd0e5f71aa7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:22.170181 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f0702-d39c-4f86-89a8-6bd0e5f71aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:22.170181 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f0702-d39c-4f86-89a8-6bd0e5f71aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:22.276020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-892f0702-d39c-4f86-89a8-6bd0e5f71aa7 None None] MFA Rules not processed for user `6cead1e7fb98489fbe122f9bff8a63b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:22.277583 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-892f0702-d39c-4f86-89a8-6bd0e5f71aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:22.293467 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad59dc-27f0-45c8-a0ff-4818ae2bfc20 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:22.360952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10a50e-1278-4b35-b503-9d5d2893eb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:22.361610 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10a50e-1278-4b35-b503-9d5d2893eb99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:22.361903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10a50e-1278-4b35-b503-9d5d2893eb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:22.362192 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10a50e-1278-4b35-b503-9d5d2893eb99 admin admin] PATH_INFO: `/v3/projects/6b29cba47bda4693bf53d0bbaaa40847` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:22.385430 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10a50e-1278-4b35-b503-9d5d2893eb99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b29cba47bda4693bf53d0bbaaa40847)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:22.411558 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10a50e-1278-4b35-b503-9d5d2893eb99 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:22.663344 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dd10a50e-1278-4b35-b503-9d5d2893eb99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b29cba47bda4693bf53d0bbaaa40847', 'request_id': 'req-dd10a50e-1278-4b35-b503-9d5d2893eb99'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:22.679060 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dd10a50e-1278-4b35-b503-9d5d2893eb99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b29cba47bda4693bf53d0bbaaa40847', 'request_id': 'req-dd10a50e-1278-4b35-b503-9d5d2893eb99'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:22.690553 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 893/1797] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 525 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:22.697432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dd10a50e-1278-4b35-b503-9d5d2893eb99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b29cba47bda4693bf53d0bbaaa40847', 'request_id': 'req-dd10a50e-1278-4b35-b503-9d5d2893eb99'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:22.761227 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dd10a50e-1278-4b35-b503-9d5d2893eb99 admin admin] The token cache is being invalidate because project 6b29cba47bda4693bf53d0bbaaa40847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:22.764593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dd10a50e-1278-4b35-b503-9d5d2893eb99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:22.766158 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dd10a50e-1278-4b35-b503-9d5d2893eb99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:22.784484 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 905/1798] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:21 2022] DELETE /identity/v3/projects/6b29cba47bda4693bf53d0bbaaa40847 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:22.788999 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f0702-d39c-4f86-89a8-6bd0e5f71aa7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:22.809998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f0702-d39c-4f86-89a8-6bd0e5f71aa7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:23.025156 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b5c9c-1846-45f1-b9fe-717649090277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:23.025907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b5c9c-1846-45f1-b9fe-717649090277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:23.026141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b5c9c-1846-45f1-b9fe-717649090277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:23.028137 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b5c9c-1846-45f1-b9fe-717649090277 admin admin] PATH_INFO: `/v3/users/059da3a13f994c0fb8dbeec63e9a4656` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:23.028384 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b5c9c-1846-45f1-b9fe-717649090277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=059da3a13f994c0fb8dbeec63e9a4656)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:23.030410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b5c9c-1846-45f1-b9fe-717649090277 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:23.053488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:23.156599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10a50e-1278-4b35-b503-9d5d2893eb99 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:23.159608 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-dd10a50e-1278-4b35-b503-9d5d2893eb99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:23.159918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fa8b5c9c-1846-45f1-b9fe-717649090277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '059da3a13f994c0fb8dbeec63e9a4656'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:23.163407 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fa8b5c9c-1846-45f1-b9fe-717649090277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '059da3a13f994c0fb8dbeec63e9a4656'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:23.165545 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fa8b5c9c-1846-45f1-b9fe-717649090277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '059da3a13f994c0fb8dbeec63e9a4656'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:23.188694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fa8b5c9c-1846-45f1-b9fe-717649090277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '059da3a13f994c0fb8dbeec63e9a4656'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:23.206618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fa8b5c9c-1846-45f1-b9fe-717649090277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '059da3a13f994c0fb8dbeec63e9a4656'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:23.231892 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:23.287963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 894/1799] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:22 2022] DELETE /identity/v3/users/059da3a13f994c0fb8dbeec63e9a4656 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:23.403007 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10a50e-1278-4b35-b503-9d5d2893eb99 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:23.559065 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df8c46-32b1-402e-8ff8-c9f925079a58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:23.560447 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df8c46-32b1-402e-8ff8-c9f925079a58 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:23.560447 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df8c46-32b1-402e-8ff8-c9f925079a58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:23.560447 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df8c46-32b1-402e-8ff8-c9f925079a58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:23.578039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-41df8c46-32b1-402e-8ff8-c9f925079a58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:23.901150 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df8c46-32b1-402e-8ff8-c9f925079a58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:23.909500 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df8c46-32b1-402e-8ff8-c9f925079a58 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:23.944045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 906/1800] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 788 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:24.202638 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b5c9c-1846-45f1-b9fe-717649090277 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:24.204164 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fa8b5c9c-1846-45f1-b9fe-717649090277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:24.471699 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b5c9c-1846-45f1-b9fe-717649090277 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:24.498565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a0f22-a056-45a3-a6c5-46138b825112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:24.499453 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a0f22-a056-45a3-a6c5-46138b825112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:24.499835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a0f22-a056-45a3-a6c5-46138b825112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:24.500346 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a0f22-a056-45a3-a6c5-46138b825112 admin admin] PATH_INFO: `/v3/users/fd3374a159f24c149803b45269243523` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:24.506432 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a0f22-a056-45a3-a6c5-46138b825112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd3374a159f24c149803b45269243523)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:24.509746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a0f22-a056-45a3-a6c5-46138b825112 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:24.547259 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df8c46-32b1-402e-8ff8-c9f925079a58 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:24.549295 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-41df8c46-32b1-402e-8ff8-c9f925079a58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:24.608987 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df8c46-32b1-402e-8ff8-c9f925079a58 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:24.641433 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472226c-3ce6-407c-bdcd-b4bb8c65abd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:24.643633 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472226c-3ce6-407c-bdcd-b4bb8c65abd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:24.643918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472226c-3ce6-407c-bdcd-b4bb8c65abd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:24.644203 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472226c-3ce6-407c-bdcd-b4bb8c65abd8 admin admin] PATH_INFO: `/v3/projects/6a17f83b6a5144aab4c765995a9a1d4e` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:24.650236 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472226c-3ce6-407c-bdcd-b4bb8c65abd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a17f83b6a5144aab4c765995a9a1d4e)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:24.656484 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472226c-3ce6-407c-bdcd-b4bb8c65abd8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:24.691758 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2f1a0f22-a056-45a3-a6c5-46138b825112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd3374a159f24c149803b45269243523'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:24.694426 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2f1a0f22-a056-45a3-a6c5-46138b825112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd3374a159f24c149803b45269243523'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:24.696755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2f1a0f22-a056-45a3-a6c5-46138b825112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd3374a159f24c149803b45269243523'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:24.723154 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2f1a0f22-a056-45a3-a6c5-46138b825112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd3374a159f24c149803b45269243523'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:24.741884 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2f1a0f22-a056-45a3-a6c5-46138b825112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd3374a159f24c149803b45269243523'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:24.805830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 895/1801] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:24 2022] DELETE /identity/v3/users/fd3374a159f24c149803b45269243523 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:24.812091 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d52bdc-381b-47cc-9884-b9ff19baa85c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:24.812699 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d52bdc-381b-47cc-9884-b9ff19baa85c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:24.813336 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d52bdc-381b-47cc-9884-b9ff19baa85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:24.853794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9472226c-3ce6-407c-bdcd-b4bb8c65abd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a17f83b6a5144aab4c765995a9a1d4e', 'request_id': 'req-9472226c-3ce6-407c-bdcd-b4bb8c65abd8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:24.873122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9472226c-3ce6-407c-bdcd-b4bb8c65abd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a17f83b6a5144aab4c765995a9a1d4e', 'request_id': 'req-9472226c-3ce6-407c-bdcd-b4bb8c65abd8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:24.874366 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-62d52bdc-381b-47cc-9884-b9ff19baa85c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:24.876417 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-62d52bdc-381b-47cc-9884-b9ff19baa85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:24.890535 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:24.892188 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9472226c-3ce6-407c-bdcd-b4bb8c65abd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a17f83b6a5144aab4c765995a9a1d4e', 'request_id': 'req-9472226c-3ce6-407c-bdcd-b4bb8c65abd8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:24.933933 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9472226c-3ce6-407c-bdcd-b4bb8c65abd8 admin admin] The token cache is being invalidate because project 6a17f83b6a5144aab4c765995a9a1d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:24.934643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9472226c-3ce6-407c-bdcd-b4bb8c65abd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:24.935718 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9472226c-3ce6-407c-bdcd-b4bb8c65abd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:24.941317 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 907/1802] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:24 2022] DELETE /identity/v3/projects/6a17f83b6a5144aab4c765995a9a1d4e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:09:24.945856 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a3da6-96a4-4ba1-a397-8987fb56aa67 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:24.948104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a3da6-96a4-4ba1-a397-8987fb56aa67 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:24.948700 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a3da6-96a4-4ba1-a397-8987fb56aa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:25.003332 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1a7a3da6-96a4-4ba1-a397-8987fb56aa67 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:25.006790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1a7a3da6-96a4-4ba1-a397-8987fb56aa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:25.020542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:25.079795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 896/1803] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:25.159827 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 908/1804] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:25.161173 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876671-b7ac-4594-b552-397db1f9ad48 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:25.161467 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876671-b7ac-4594-b552-397db1f9ad48 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:25.161792 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876671-b7ac-4594-b552-397db1f9ad48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:25.203960 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-39876671-b7ac-4594-b552-397db1f9ad48 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:25.205488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-39876671-b7ac-4594-b552-397db1f9ad48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:25.217802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 897/1805] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:25.223281 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a3da6-96a4-4ba1-a397-8987fb56aa67 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:25.235643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a3da6-96a4-4ba1-a397-8987fb56aa67 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:25.241029 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546898b-609d-4811-ae85-b0028ee84e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:25.241742 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546898b-609d-4811-ae85-b0028ee84e85 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:25.242090 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546898b-609d-4811-ae85-b0028ee84e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:25.242968 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546898b-609d-4811-ae85-b0028ee84e85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:25.244512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546898b-609d-4811-ae85-b0028ee84e85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:09:25.244970 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546898b-609d-4811-ae85-b0028ee84e85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:25.246719 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546898b-609d-4811-ae85-b0028ee84e85 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:25.252232 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39876671-b7ac-4594-b552-397db1f9ad48 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:25.253804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-39876671-b7ac-4594-b552-397db1f9ad48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:25.302206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 909/1806] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:09:25.303206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546898b-609d-4811-ae85-b0028ee84e85 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:25.331663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546898b-609d-4811-ae85-b0028ee84e85 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:25.343196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0febc2-3d00-4e15-9c3a-55cf73f2280a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:25.347953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0febc2-3d00-4e15-9c3a-55cf73f2280a admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:25.348336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0febc2-3d00-4e15-9c3a-55cf73f2280a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:25.348695 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0febc2-3d00-4e15-9c3a-55cf73f2280a admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:25.352789 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0febc2-3d00-4e15-9c3a-55cf73f2280a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:25.355899 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0febc2-3d00-4e15-9c3a-55cf73f2280a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:25.438632 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39876671-b7ac-4594-b552-397db1f9ad48 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:25.440030 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 910/1807] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:25 2022] POST /identity/v3/projects => generated 357 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:25.441419 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0febc2-3d00-4e15-9c3a-55cf73f2280a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:25.597059 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed208611-3129-4dc6-9ae6-8df610cf5e3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:25.598770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed208611-3129-4dc6-9ae6-8df610cf5e3c service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:25.599054 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed208611-3129-4dc6-9ae6-8df610cf5e3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:25.599357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed208611-3129-4dc6-9ae6-8df610cf5e3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:25.605717 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0febc2-3d00-4e15-9c3a-55cf73f2280a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:25.615682 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000307c2-4898-45ef-b22c-f832e8f0a1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:25.617855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000307c2-4898-45ef-b22c-f832e8f0a1ba admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:25.618800 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000307c2-4898-45ef-b22c-f832e8f0a1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:25.619316 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000307c2-4898-45ef-b22c-f832e8f0a1ba admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:25.620294 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000307c2-4898-45ef-b22c-f832e8f0a1ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:25.623270 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000307c2-4898-45ef-b22c-f832e8f0a1ba admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:25.659404 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 911/1808] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:25 2022] POST /identity/v3/users => generated 279 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:25.661158 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000307c2-4898-45ef-b22c-f832e8f0a1ba admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:25.661666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed208611-3129-4dc6-9ae6-8df610cf5e3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:25.663700 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed208611-3129-4dc6-9ae6-8df610cf5e3c service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:25.676319 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000307c2-4898-45ef-b22c-f832e8f0a1ba admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:25.678077 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 898/1809] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:25.684609 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39483b3-0afc-4053-bd03-5db0be8fce50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:25.685871 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39483b3-0afc-4053-bd03-5db0be8fce50 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:25.686398 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39483b3-0afc-4053-bd03-5db0be8fce50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:25.686831 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39483b3-0afc-4053-bd03-5db0be8fce50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:25.689249 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39483b3-0afc-4053-bd03-5db0be8fce50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:25.691926 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39483b3-0afc-4053-bd03-5db0be8fce50 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:25.712742 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 912/1810] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:25.713593 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed208611-3129-4dc6-9ae6-8df610cf5e3c service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:25.744312 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed208611-3129-4dc6-9ae6-8df610cf5e3c service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:25.753778 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae7e12-43ce-4dca-a424-5afa080ae186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:25.754868 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae7e12-43ce-4dca-a424-5afa080ae186 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:25.755424 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae7e12-43ce-4dca-a424-5afa080ae186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:25.756130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae7e12-43ce-4dca-a424-5afa080ae186 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:25.757131 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae7e12-43ce-4dca-a424-5afa080ae186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:25.761160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae7e12-43ce-4dca-a424-5afa080ae186 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:25.794837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 899/1811] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:09:25.796638 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39483b3-0afc-4053-bd03-5db0be8fce50 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:25.832664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39483b3-0afc-4053-bd03-5db0be8fce50 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:25.840488 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fc0f1-e2af-4164-aaad-1c6eb20622d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:25.841754 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fc0f1-e2af-4164-aaad-1c6eb20622d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:25.842232 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fc0f1-e2af-4164-aaad-1c6eb20622d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:25.842733 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fc0f1-e2af-4164-aaad-1c6eb20622d3 admin admin] PATH_INFO: `/v3/projects/d4a076c028c5491f85880f72714524f5/users/449bc78f66bc44919813905cc1682d29/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:25.922144 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fc0f1-e2af-4164-aaad-1c6eb20622d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a076c028c5491f85880f72714524f5, user_id=449bc78f66bc44919813905cc1682d29, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:25.925096 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fc0f1-e2af-4164-aaad-1c6eb20622d3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:25.962886 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 913/1812] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:25 2022] PUT /identity/v3/projects/d4a076c028c5491f85880f72714524f5/users/449bc78f66bc44919813905cc1682d29/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:25.963607 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bfa5d-f05c-460a-846b-792f434066c4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:25.963884 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bfa5d-f05c-460a-846b-792f434066c4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:25.964162 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bfa5d-f05c-460a-846b-792f434066c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:26.049164 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-055bfa5d-f05c-460a-846b-792f434066c4 None None] MFA Rules not processed for user `449bc78f66bc44919813905cc1682d29`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:26.050431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-055bfa5d-f05c-460a-846b-792f434066c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:26.174181 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:26.244657 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 900/1813] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:26.249505 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fc0f1-e2af-4164-aaad-1c6eb20622d3 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:26.363951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:26.463261 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fc0f1-e2af-4164-aaad-1c6eb20622d3 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:26.483992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597b500-64fa-495f-906e-a0af1c6e0761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:26.484554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597b500-64fa-495f-906e-a0af1c6e0761 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:26.484836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597b500-64fa-495f-906e-a0af1c6e0761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:26.485131 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597b500-64fa-495f-906e-a0af1c6e0761 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:26.485815 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597b500-64fa-495f-906e-a0af1c6e0761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:26.487720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597b500-64fa-495f-906e-a0af1c6e0761 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:26.526196 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe065858-e492-4c93-90fd-0a9fb4e81f60 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:26.526487 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe065858-e492-4c93-90fd-0a9fb4e81f60 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:26.526794 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe065858-e492-4c93-90fd-0a9fb4e81f60 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:26.528162 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 901/1814] 10.222.0.40 () {54 vars in 921 bytes} [Tue Aug 9 07:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:09:26.574871 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe065858-e492-4c93-90fd-0a9fb4e81f60 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:26.575499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 914/1815] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:26 2022] POST /identity/v3/projects => generated 355 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:26.748185 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe065858-e492-4c93-90fd-0a9fb4e81f60 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:26.765378 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5fabc-4e50-4676-abee-e90f8160e141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:26.766029 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5fabc-4e50-4676-abee-e90f8160e141 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:26.766333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5fabc-4e50-4676-abee-e90f8160e141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:26.766571 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5fabc-4e50-4676-abee-e90f8160e141 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:26.767260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5fabc-4e50-4676-abee-e90f8160e141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:26.769234 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5fabc-4e50-4676-abee-e90f8160e141 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:26.817530 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cba04-1c4f-42e1-b8a3-eeaad413e762 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:26.818111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cba04-1c4f-42e1-b8a3-eeaad413e762 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:26.818393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cba04-1c4f-42e1-b8a3-eeaad413e762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:26.834702 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 902/1816] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:26 2022] POST /identity/v3/users => generated 284 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:26.839133 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5fabc-4e50-4676-abee-e90f8160e141 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:26.855446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b50cba04-1c4f-42e1-b8a3-eeaad413e762 None None] MFA Rules not processed for user `6e949d9666be44a0b6122d510168c7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:26.856819 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b50cba04-1c4f-42e1-b8a3-eeaad413e762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:26.867804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5fabc-4e50-4676-abee-e90f8160e141 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:26.875004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ba3d5-97c5-418f-bbb8-c394b38bca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:26.876244 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ba3d5-97c5-418f-bbb8-c394b38bca9c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:26.876244 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ba3d5-97c5-418f-bbb8-c394b38bca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:26.877232 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ba3d5-97c5-418f-bbb8-c394b38bca9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:26.878370 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ba3d5-97c5-418f-bbb8-c394b38bca9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:26.881491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ba3d5-97c5-418f-bbb8-c394b38bca9c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:26.920665 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 903/1817] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:26.921914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ba3d5-97c5-418f-bbb8-c394b38bca9c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:26.942428 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ba3d5-97c5-418f-bbb8-c394b38bca9c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:26.956714 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b8f8a-4256-435d-8022-dc6c41296cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:26.962350 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b8f8a-4256-435d-8022-dc6c41296cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:26.963426 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b8f8a-4256-435d-8022-dc6c41296cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:26.963711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b8f8a-4256-435d-8022-dc6c41296cd3 admin admin] PATH_INFO: `/v3/projects/b3a63cf1a1e545a8a74462b72e3982ac/users/e4fa9167f9fd424881cad73a99ca6abb/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:27.051946 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b8f8a-4256-435d-8022-dc6c41296cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a63cf1a1e545a8a74462b72e3982ac, user_id=e4fa9167f9fd424881cad73a99ca6abb, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:27.061990 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b8f8a-4256-435d-8022-dc6c41296cd3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:27.097031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 904/1818] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:26 2022] PUT /identity/v3/projects/b3a63cf1a1e545a8a74462b72e3982ac/users/e4fa9167f9fd424881cad73a99ca6abb/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:27.100739 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b8f8a-4256-435d-8022-dc6c41296cd3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:27.145145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 915/1819] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Aug 9 07:09:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:27.288524 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b8f8a-4256-435d-8022-dc6c41296cd3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:27.305630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43f835-c89f-4c84-9a1a-24e2db6cb953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:27.306667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43f835-c89f-4c84-9a1a-24e2db6cb953 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:27.307053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43f835-c89f-4c84-9a1a-24e2db6cb953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:27.307553 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43f835-c89f-4c84-9a1a-24e2db6cb953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:27.308534 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43f835-c89f-4c84-9a1a-24e2db6cb953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:27.315918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43f835-c89f-4c84-9a1a-24e2db6cb953 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:27.353156 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 905/1820] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:27.357120 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cba04-1c4f-42e1-b8a3-eeaad413e762 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:27.381386 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cba04-1c4f-42e1-b8a3-eeaad413e762 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:27.440838 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4f459-40fb-4edf-b553-dec734170150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:27.441754 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4f459-40fb-4edf-b553-dec734170150 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:27.442232 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4f459-40fb-4edf-b553-dec734170150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:27.442665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4f459-40fb-4edf-b553-dec734170150 admin admin] PATH_INFO: `/v3/projects/b3a63cf1a1e545a8a74462b72e3982ac/users/e4fa9167f9fd424881cad73a99ca6abb/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:27.445103 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4f459-40fb-4edf-b553-dec734170150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a63cf1a1e545a8a74462b72e3982ac, user_id=e4fa9167f9fd424881cad73a99ca6abb, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:27.449260 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4f459-40fb-4edf-b553-dec734170150 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:27.479469 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 916/1821] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:27 2022] PUT /identity/v3/projects/b3a63cf1a1e545a8a74462b72e3982ac/users/e4fa9167f9fd424881cad73a99ca6abb/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:27.485230 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc8f53-adcd-4826-bb52-9b83515a47c7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:27.486111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc8f53-adcd-4826-bb52-9b83515a47c7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:27.486564 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc8f53-adcd-4826-bb52-9b83515a47c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:27.589025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e5bc8f53-adcd-4826-bb52-9b83515a47c7 None None] MFA Rules not processed for user `e4fa9167f9fd424881cad73a99ca6abb`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:27.590264 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e5bc8f53-adcd-4826-bb52-9b83515a47c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:27.600063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4efb28-fcc8-4992-bb09-f6bd87cdc3a8 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:27.600786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4efb28-fcc8-4992-bb09-f6bd87cdc3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:27.601242 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4efb28-fcc8-4992-bb09-f6bd87cdc3a8 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:27.604351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 917/1822] 10.222.0.40 () {54 vars in 921 bytes} [Tue Aug 9 07:09:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:09:27.656954 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:27.686247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ccb79-45fd-4635-aa10-9fc0478c8313 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:27.686880 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ccb79-45fd-4635-aa10-9fc0478c8313 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:27.687336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ccb79-45fd-4635-aa10-9fc0478c8313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:27.741483 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-855ccb79-45fd-4635-aa10-9fc0478c8313 None None] MFA Rules not processed for user `6e949d9666be44a0b6122d510168c7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:27.744462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-855ccb79-45fd-4635-aa10-9fc0478c8313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:27.903746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 906/1823] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:27.904741 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc8f53-adcd-4826-bb52-9b83515a47c7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:27.909752 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e5bc8f53-adcd-4826-bb52-9b83515a47c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:28.119989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 918/1824] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Aug 9 07:09:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:28.124339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ccb79-45fd-4635-aa10-9fc0478c8313 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:28.148867 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-855ccb79-45fd-4635-aa10-9fc0478c8313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:28.227519 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc8f53-adcd-4826-bb52-9b83515a47c7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:28.265135 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e77439-9937-45ea-a33c-c031ca6e6612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:28.266136 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e77439-9937-45ea-a33c-c031ca6e6612 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:28.267771 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e77439-9937-45ea-a33c-c031ca6e6612 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:28.269767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e77439-9937-45ea-a33c-c031ca6e6612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:28.271979 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:28.356653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e77439-9937-45ea-a33c-c031ca6e6612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:28.363769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e77439-9937-45ea-a33c-c031ca6e6612 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:28.373812 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ccb79-45fd-4635-aa10-9fc0478c8313 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:28.385390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51701bd0-8118-4f79-84fc-e22e491757d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:28.387231 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51701bd0-8118-4f79-84fc-e22e491757d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:28.387522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51701bd0-8118-4f79-84fc-e22e491757d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:28.388800 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51701bd0-8118-4f79-84fc-e22e491757d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:28.436595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 907/1825] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:28.447204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51701bd0-8118-4f79-84fc-e22e491757d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:28.457651 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51701bd0-8118-4f79-84fc-e22e491757d7 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:28.498887 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 919/1826] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:28.666560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e77439-9937-45ea-a33c-c031ca6e6612 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:28.690275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e77439-9937-45ea-a33c-c031ca6e6612 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:28.712822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11015d-c3ac-4d0a-9f0d-98637a6439d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:28.713441 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11015d-c3ac-4d0a-9f0d-98637a6439d1 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:28.713868 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11015d-c3ac-4d0a-9f0d-98637a6439d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:28.714039 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11015d-c3ac-4d0a-9f0d-98637a6439d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:28.736571 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11015d-c3ac-4d0a-9f0d-98637a6439d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:28.739631 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11015d-c3ac-4d0a-9f0d-98637a6439d1 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:28.766855 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 908/1827] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:28.874122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51701bd0-8118-4f79-84fc-e22e491757d7 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:28.875735 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-51701bd0-8118-4f79-84fc-e22e491757d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:28.900545 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51701bd0-8118-4f79-84fc-e22e491757d7 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:28.914823 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd20df3-fc45-420b-b7fa-befb2f4ec0dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:28.915804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd20df3-fc45-420b-b7fa-befb2f4ec0dc service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:28.916309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd20df3-fc45-420b-b7fa-befb2f4ec0dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:28.916781 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd20df3-fc45-420b-b7fa-befb2f4ec0dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:28.954715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11015d-c3ac-4d0a-9f0d-98637a6439d1 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:28.956370 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ae11015d-c3ac-4d0a-9f0d-98637a6439d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:29.228016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd20df3-fc45-420b-b7fa-befb2f4ec0dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:29.236300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd20df3-fc45-420b-b7fa-befb2f4ec0dc service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:29.275355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11015d-c3ac-4d0a-9f0d-98637a6439d1 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:29.281396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e7c25-eacb-4c6e-9c4d-2c6ad4365039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:29.282886 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e7c25-eacb-4c6e-9c4d-2c6ad4365039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:29.283260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e7c25-eacb-4c6e-9c4d-2c6ad4365039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:29.283549 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e7c25-eacb-4c6e-9c4d-2c6ad4365039 admin admin] PATH_INFO: `/v3/projects/4b73155275d04769b74eec4778c47993` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:29.285231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e7c25-eacb-4c6e-9c4d-2c6ad4365039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b73155275d04769b74eec4778c47993)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:29.287702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 920/1828] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:29.289835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e7c25-eacb-4c6e-9c4d-2c6ad4365039 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:29.384964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:29.440636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a15e7c25-eacb-4c6e-9c4d-2c6ad4365039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b73155275d04769b74eec4778c47993', 'request_id': 'req-a15e7c25-eacb-4c6e-9c4d-2c6ad4365039'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:29.463880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a15e7c25-eacb-4c6e-9c4d-2c6ad4365039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b73155275d04769b74eec4778c47993', 'request_id': 'req-a15e7c25-eacb-4c6e-9c4d-2c6ad4365039'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:29.480240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a15e7c25-eacb-4c6e-9c4d-2c6ad4365039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b73155275d04769b74eec4778c47993', 'request_id': 'req-a15e7c25-eacb-4c6e-9c4d-2c6ad4365039'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:29.508706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a15e7c25-eacb-4c6e-9c4d-2c6ad4365039 admin admin] The token cache is being invalidate because project 4b73155275d04769b74eec4778c47993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:29.509179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a15e7c25-eacb-4c6e-9c4d-2c6ad4365039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:29.510410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a15e7c25-eacb-4c6e-9c4d-2c6ad4365039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:29.514786 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 909/1829] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:28 2022] DELETE /identity/v3/projects/4b73155275d04769b74eec4778c47993 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:09:29.516449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd20df3-fc45-420b-b7fa-befb2f4ec0dc service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:29.544114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd20df3-fc45-420b-b7fa-befb2f4ec0dc service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:29.758743 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdbe1a-ad55-4d95-9996-5d645a89a28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:29.759517 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdbe1a-ad55-4d95-9996-5d645a89a28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:29.759840 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdbe1a-ad55-4d95-9996-5d645a89a28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:29.760308 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdbe1a-ad55-4d95-9996-5d645a89a28c admin admin] PATH_INFO: `/v3/users/3a8055957b164fa880aa13d856a831d3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:29.761765 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdbe1a-ad55-4d95-9996-5d645a89a28c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a8055957b164fa880aa13d856a831d3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:29.764119 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdbe1a-ad55-4d95-9996-5d645a89a28c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:29.840457 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dafdbe1a-ad55-4d95-9996-5d645a89a28c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a8055957b164fa880aa13d856a831d3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:29.849970 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dafdbe1a-ad55-4d95-9996-5d645a89a28c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a8055957b164fa880aa13d856a831d3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:29.851003 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dafdbe1a-ad55-4d95-9996-5d645a89a28c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a8055957b164fa880aa13d856a831d3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:29.884908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:29.888393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dafdbe1a-ad55-4d95-9996-5d645a89a28c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a8055957b164fa880aa13d856a831d3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:29.911407 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dafdbe1a-ad55-4d95-9996-5d645a89a28c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a8055957b164fa880aa13d856a831d3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:29.922151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 921/1830] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:29 2022] DELETE /identity/v3/users/3a8055957b164fa880aa13d856a831d3 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:30.686861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e7c25-eacb-4c6e-9c4d-2c6ad4365039 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:30.688317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a15e7c25-eacb-4c6e-9c4d-2c6ad4365039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:30.766642 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e7c25-eacb-4c6e-9c4d-2c6ad4365039 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:30.995771 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ef731-6847-4e48-93b6-95267aef8ed4 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:30.996557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ef731-6847-4e48-93b6-95267aef8ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:30.996557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ef731-6847-4e48-93b6-95267aef8ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:31.015012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0917fd3-6677-4837-a1f1-6080a97a551c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:31.015940 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0917fd3-6677-4837-a1f1-6080a97a551c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:31.016514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0917fd3-6677-4837-a1f1-6080a97a551c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:31.017043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0917fd3-6677-4837-a1f1-6080a97a551c admin admin] PATH_INFO: `/v3/projects/8aabc5ae88d14c17a794c3f7aa20aea7` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:31.019839 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0917fd3-6677-4837-a1f1-6080a97a551c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aabc5ae88d14c17a794c3f7aa20aea7)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:31.022227 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0917fd3-6677-4837-a1f1-6080a97a551c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:31.076737 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-800ef731-6847-4e48-93b6-95267aef8ed4 None None] MFA Rules not processed for user `4c652bdbf6fb432eb25b6be62b5b5077`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:31.082381 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-800ef731-6847-4e48-93b6-95267aef8ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:31.227777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a0917fd3-6677-4837-a1f1-6080a97a551c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aabc5ae88d14c17a794c3f7aa20aea7', 'request_id': 'req-a0917fd3-6677-4837-a1f1-6080a97a551c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:31.250919 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a0917fd3-6677-4837-a1f1-6080a97a551c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aabc5ae88d14c17a794c3f7aa20aea7', 'request_id': 'req-a0917fd3-6677-4837-a1f1-6080a97a551c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:31.274081 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a0917fd3-6677-4837-a1f1-6080a97a551c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aabc5ae88d14c17a794c3f7aa20aea7', 'request_id': 'req-a0917fd3-6677-4837-a1f1-6080a97a551c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:31.304227 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a0917fd3-6677-4837-a1f1-6080a97a551c admin admin] The token cache is being invalidate because project 8aabc5ae88d14c17a794c3f7aa20aea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:31.305313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a0917fd3-6677-4837-a1f1-6080a97a551c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:31.307148 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a0917fd3-6677-4837-a1f1-6080a97a551c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:31.318636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 910/1831] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:30 2022] DELETE /identity/v3/projects/8aabc5ae88d14c17a794c3f7aa20aea7 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:31.323699 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b27ef7-500e-4e50-ad02-d3becb392df4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:31.323980 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b27ef7-500e-4e50-ad02-d3becb392df4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:31.324250 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b27ef7-500e-4e50-ad02-d3becb392df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:31.339284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 922/1832] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:31.399492 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-10b27ef7-500e-4e50-ad02-d3becb392df4 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:31.409630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-10b27ef7-500e-4e50-ad02-d3becb392df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:31.720411 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:31.769298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 911/1833] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:31.777863 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7def505-0f8f-453b-92c1-d17ab8e8bf7d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:31.778187 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7def505-0f8f-453b-92c1-d17ab8e8bf7d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:31.779549 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7def505-0f8f-453b-92c1-d17ab8e8bf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:31.828057 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a7def505-0f8f-453b-92c1-d17ab8e8bf7d None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:31.833247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a7def505-0f8f-453b-92c1-d17ab8e8bf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:31.858855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 923/1834] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:31.862867 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b27ef7-500e-4e50-ad02-d3becb392df4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:31.892344 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b27ef7-500e-4e50-ad02-d3becb392df4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:31.911717 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c9056-2971-4720-812c-004694362859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:31.920180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c9056-2971-4720-812c-004694362859 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:31.921441 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c9056-2971-4720-812c-004694362859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:31.923570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c9056-2971-4720-812c-004694362859 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:31.925529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c9056-2971-4720-812c-004694362859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:09:31.927739 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c9056-2971-4720-812c-004694362859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:31.936081 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c9056-2971-4720-812c-004694362859 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:31.985594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 912/1835] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 07:09:31.991548 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7def505-0f8f-453b-92c1-d17ab8e8bf7d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:32.008446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7def505-0f8f-453b-92c1-d17ab8e8bf7d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:32.029094 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007400b9-47f3-4594-baba-d1b2a1d0ca5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:32.033284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007400b9-47f3-4594-baba-d1b2a1d0ca5e admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:32.033684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007400b9-47f3-4594-baba-d1b2a1d0ca5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:32.034324 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007400b9-47f3-4594-baba-d1b2a1d0ca5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:32.036597 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007400b9-47f3-4594-baba-d1b2a1d0ca5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:32.044336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007400b9-47f3-4594-baba-d1b2a1d0ca5e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:32.083357 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 924/1836] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:31 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:32.088448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c9056-2971-4720-812c-004694362859 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:32.108164 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c9056-2971-4720-812c-004694362859 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:32.261161 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc74e0-e63e-48e0-a217-292e3510733c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:32.262728 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc74e0-e63e-48e0-a217-292e3510733c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:32.264606 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc74e0-e63e-48e0-a217-292e3510733c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:32.266442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc74e0-e63e-48e0-a217-292e3510733c admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:32.267380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc74e0-e63e-48e0-a217-292e3510733c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:32.271773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc74e0-e63e-48e0-a217-292e3510733c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:32.327333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 913/1837] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:32 2022] POST /identity/v3/users => generated 291 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:09:32.329821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007400b9-47f3-4594-baba-d1b2a1d0ca5e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:32.356534 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007400b9-47f3-4594-baba-d1b2a1d0ca5e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:32.371030 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f32095-aad0-4eb1-8b43-c33852517f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:32.372006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f32095-aad0-4eb1-8b43-c33852517f45 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:32.373085 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f32095-aad0-4eb1-8b43-c33852517f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:32.373509 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f32095-aad0-4eb1-8b43-c33852517f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:32.374327 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f32095-aad0-4eb1-8b43-c33852517f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:32.381206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f32095-aad0-4eb1-8b43-c33852517f45 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:32.408750 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 925/1838] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:32.412324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc74e0-e63e-48e0-a217-292e3510733c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:32.430706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc74e0-e63e-48e0-a217-292e3510733c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:32.436813 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd405c4f-dfb0-48d4-8d23-7079627991d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:32.437696 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd405c4f-dfb0-48d4-8d23-7079627991d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:32.438047 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd405c4f-dfb0-48d4-8d23-7079627991d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:32.438536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd405c4f-dfb0-48d4-8d23-7079627991d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:32.439358 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd405c4f-dfb0-48d4-8d23-7079627991d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:32.441083 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd405c4f-dfb0-48d4-8d23-7079627991d6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:32.472121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 914/1839] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:32.483662 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f32095-aad0-4eb1-8b43-c33852517f45 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:32.497141 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f32095-aad0-4eb1-8b43-c33852517f45 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:32.505638 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b80186-0f79-4d0e-ad7f-d9a93a0b09a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:32.507120 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b80186-0f79-4d0e-ad7f-d9a93a0b09a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:32.508532 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b80186-0f79-4d0e-ad7f-d9a93a0b09a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:32.509027 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b80186-0f79-4d0e-ad7f-d9a93a0b09a4 admin admin] PATH_INFO: `/v3/projects/2406f43bbbf1409cb4e16c566364b496/users/b944a841063a4b269d9efa776b7939e2/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:32.528283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b80186-0f79-4d0e-ad7f-d9a93a0b09a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2406f43bbbf1409cb4e16c566364b496, user_id=b944a841063a4b269d9efa776b7939e2, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:32.532280 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b80186-0f79-4d0e-ad7f-d9a93a0b09a4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:32.556727 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 926/1840] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:32 2022] PUT /identity/v3/projects/2406f43bbbf1409cb4e16c566364b496/users/b944a841063a4b269d9efa776b7939e2/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:32.565622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7d072-941c-4acb-ac72-e8029effd603 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:32.566392 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7d072-941c-4acb-ac72-e8029effd603 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:32.566879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7d072-941c-4acb-ac72-e8029effd603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:32.603283 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f2b7d072-941c-4acb-ac72-e8029effd603 None None] MFA Rules not processed for user `b944a841063a4b269d9efa776b7939e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:32.605749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f2b7d072-941c-4acb-ac72-e8029effd603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:32.702300 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 915/1841] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:32.707262 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b80186-0f79-4d0e-ad7f-d9a93a0b09a4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:32.815693 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b80186-0f79-4d0e-ad7f-d9a93a0b09a4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:32.822836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191ec7c-9021-4a78-805d-125b88468095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:32.824013 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191ec7c-9021-4a78-805d-125b88468095 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:32.824986 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191ec7c-9021-4a78-805d-125b88468095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:32.825683 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191ec7c-9021-4a78-805d-125b88468095 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:32.826210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d191ec7c-9021-4a78-805d-125b88468095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:32.828134 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d191ec7c-9021-4a78-805d-125b88468095 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:32.867728 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 927/1842] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:32 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:09:32.871910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7d072-941c-4acb-ac72-e8029effd603 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:32.888017 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7d072-941c-4acb-ac72-e8029effd603 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:32.938664 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:32.956360 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37421f59-be76-48fc-8642-d7b0e7b593dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:32.956978 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37421f59-be76-48fc-8642-d7b0e7b593dd admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:32.957258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37421f59-be76-48fc-8642-d7b0e7b593dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:32.957545 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37421f59-be76-48fc-8642-d7b0e7b593dd admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:32.958147 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37421f59-be76-48fc-8642-d7b0e7b593dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:32.960213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37421f59-be76-48fc-8642-d7b0e7b593dd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:32.985301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 916/1843] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:32 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:32.989280 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191ec7c-9021-4a78-805d-125b88468095 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:33.000277 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191ec7c-9021-4a78-805d-125b88468095 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:33.005013 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b56e41-ada4-4a19-b8ba-963371771f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:33.005793 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b56e41-ada4-4a19-b8ba-963371771f59 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:33.006392 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b56e41-ada4-4a19-b8ba-963371771f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:33.006801 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b56e41-ada4-4a19-b8ba-963371771f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:33.008244 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b56e41-ada4-4a19-b8ba-963371771f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:33.010126 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b56e41-ada4-4a19-b8ba-963371771f59 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:33.015598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:33.022139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 928/1844] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:33.027372 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37421f59-be76-48fc-8642-d7b0e7b593dd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:33.052229 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37421f59-be76-48fc-8642-d7b0e7b593dd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:33.060701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc3825-f680-4aa2-a90f-cddcdace7108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:33.061706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc3825-f680-4aa2-a90f-cddcdace7108 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:33.061992 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc3825-f680-4aa2-a90f-cddcdace7108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:33.062278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc3825-f680-4aa2-a90f-cddcdace7108 admin admin] PATH_INFO: `/v3/projects/ff734260b2ff43738e7aea9297628a79/users/ad85c0e2764e460d8b05ca604b14cb83/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:33.084558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc3825-f680-4aa2-a90f-cddcdace7108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff734260b2ff43738e7aea9297628a79, user_id=ad85c0e2764e460d8b05ca604b14cb83, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:33.088136 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc3825-f680-4aa2-a90f-cddcdace7108 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:33.106049 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 917/1845] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:33 2022] PUT /identity/v3/projects/ff734260b2ff43738e7aea9297628a79/users/ad85c0e2764e460d8b05ca604b14cb83/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:33.110063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b56e41-ada4-4a19-b8ba-963371771f59 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:33.128839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b56e41-ada4-4a19-b8ba-963371771f59 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:33.220519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f0586-36df-4131-9756-c81043736aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:33.221327 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f0586-36df-4131-9756-c81043736aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:33.221928 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f0586-36df-4131-9756-c81043736aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:33.222361 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f0586-36df-4131-9756-c81043736aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:33.223594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f0586-36df-4131-9756-c81043736aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:33.225579 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f0586-36df-4131-9756-c81043736aa1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:33.239331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 929/1846] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:33.241662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc3825-f680-4aa2-a90f-cddcdace7108 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:33.260678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc3825-f680-4aa2-a90f-cddcdace7108 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:33.268634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5a53b-6b10-4869-991b-81b975ee026c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:33.269404 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5a53b-6b10-4869-991b-81b975ee026c admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:33.269804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5a53b-6b10-4869-991b-81b975ee026c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:33.270159 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5a53b-6b10-4869-991b-81b975ee026c admin admin] PATH_INFO: `/v3/projects/ff734260b2ff43738e7aea9297628a79/users/ad85c0e2764e460d8b05ca604b14cb83/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:33.272645 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5a53b-6b10-4869-991b-81b975ee026c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff734260b2ff43738e7aea9297628a79, user_id=ad85c0e2764e460d8b05ca604b14cb83, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:33.276318 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5a53b-6b10-4869-991b-81b975ee026c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:33.288882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 918/1847] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:33 2022] PUT /identity/v3/projects/ff734260b2ff43738e7aea9297628a79/users/ad85c0e2764e460d8b05ca604b14cb83/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:33.300941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605daccf-a6f0-44ec-a78d-4b4984a27dd8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:33.301317 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605daccf-a6f0-44ec-a78d-4b4984a27dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:33.301663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605daccf-a6f0-44ec-a78d-4b4984a27dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:33.332307 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-605daccf-a6f0-44ec-a78d-4b4984a27dd8 None None] MFA Rules not processed for user `ad85c0e2764e460d8b05ca604b14cb83`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:33.333956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-605daccf-a6f0-44ec-a78d-4b4984a27dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:33.408191 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 930/1848] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:33.420544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5a53b-6b10-4869-991b-81b975ee026c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:33.422238 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-85d5a53b-6b10-4869-991b-81b975ee026c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:33.484862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5a53b-6b10-4869-991b-81b975ee026c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:33.488495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3fa01-8f91-4e11-b13b-68e962e3c895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:33.489096 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3fa01-8f91-4e11-b13b-68e962e3c895 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:33.489371 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3fa01-8f91-4e11-b13b-68e962e3c895 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:33.489632 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3fa01-8f91-4e11-b13b-68e962e3c895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:33.499378 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3fa01-8f91-4e11-b13b-68e962e3c895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:33.500789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3fa01-8f91-4e11-b13b-68e962e3c895 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:33.510475 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 919/1849] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:33.885418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605daccf-a6f0-44ec-a78d-4b4984a27dd8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:33.894955 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605daccf-a6f0-44ec-a78d-4b4984a27dd8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:33.899843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a66871-bc96-4b74-8b5d-2f22ef5cef2f tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad85c0e2764e460d8b05ca604b14cb83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff734260b2ff43738e7aea9297628a79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:33.900476 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a66871-bc96-4b74-8b5d-2f22ef5cef2f tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:33.900755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a66871-bc96-4b74-8b5d-2f22ef5cef2f tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:33.901025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a66871-bc96-4b74-8b5d-2f22ef5cef2f tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:33.901667 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a66871-bc96-4b74-8b5d-2f22ef5cef2f tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:09:33.901974 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a66871-bc96-4b74-8b5d-2f22ef5cef2f tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:33.903569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a66871-bc96-4b74-8b5d-2f22ef5cef2f tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:33.917298 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 931/1850] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:09:33.921287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3fa01-8f91-4e11-b13b-68e962e3c895 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:33.932191 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3fa01-8f91-4e11-b13b-68e962e3c895 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:33.937155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a6e94-35af-4050-9ee8-dc042158f07c tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad85c0e2764e460d8b05ca604b14cb83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff734260b2ff43738e7aea9297628a79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:33.937899 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a6e94-35af-4050-9ee8-dc042158f07c tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:33.938023 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a6e94-35af-4050-9ee8-dc042158f07c tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:33.938299 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a6e94-35af-4050-9ee8-dc042158f07c tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:33.938932 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a6e94-35af-4050-9ee8-dc042158f07c tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:33.941129 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a6e94-35af-4050-9ee8-dc042158f07c tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:33.968456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 920/1851] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:33 2022] POST /identity/v3/projects => generated 354 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:33.976755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a66871-bc96-4b74-8b5d-2f22ef5cef2f tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:33.986621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a66871-bc96-4b74-8b5d-2f22ef5cef2f tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:34.044737 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbfd652-397d-483c-9698-e33e5e9b9d6b tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad85c0e2764e460d8b05ca604b14cb83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff734260b2ff43738e7aea9297628a79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:34.045494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfd652-397d-483c-9698-e33e5e9b9d6b tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:34.045977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfd652-397d-483c-9698-e33e5e9b9d6b tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:34.046319 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfd652-397d-483c-9698-e33e5e9b9d6b tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:34.046967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbfd652-397d-483c-9698-e33e5e9b9d6b tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:09:34.047411 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbfd652-397d-483c-9698-e33e5e9b9d6b tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:34.049028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbfd652-397d-483c-9698-e33e5e9b9d6b tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:34.062237 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 932/1852] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:09:34.112263 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a6e94-35af-4050-9ee8-dc042158f07c tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:34.125282 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a6e94-35af-4050-9ee8-dc042158f07c tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:34.129981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce8175-a505-4e21-8036-76934a9fe7f3 tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad85c0e2764e460d8b05ca604b14cb83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff734260b2ff43738e7aea9297628a79', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:34.130620 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce8175-a505-4e21-8036-76934a9fe7f3 tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:34.130901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce8175-a505-4e21-8036-76934a9fe7f3 tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:34.131259 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce8175-a505-4e21-8036-76934a9fe7f3 tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] PATH_INFO: `/v3/projects/1e1036fa19634c30b6eb86c810a295db` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:34.133163 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce8175-a505-4e21-8036-76934a9fe7f3 tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1e1036fa19634c30b6eb86c810a295db)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:34.136558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce8175-a505-4e21-8036-76934a9fe7f3 tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:34.201291 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4bce8175-a505-4e21-8036-76934a9fe7f3 tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1036fa19634c30b6eb86c810a295db', 'request_id': 'req-4bce8175-a505-4e21-8036-76934a9fe7f3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:34.207898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4bce8175-a505-4e21-8036-76934a9fe7f3 tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1036fa19634c30b6eb86c810a295db', 'request_id': 'req-4bce8175-a505-4e21-8036-76934a9fe7f3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:34.214352 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4bce8175-a505-4e21-8036-76934a9fe7f3 tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1036fa19634c30b6eb86c810a295db', 'request_id': 'req-4bce8175-a505-4e21-8036-76934a9fe7f3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:34.225577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:34.231353 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4bce8175-a505-4e21-8036-76934a9fe7f3 tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] The token cache is being invalidate because project 1e1036fa19634c30b6eb86c810a295db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:34.231650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4bce8175-a505-4e21-8036-76934a9fe7f3 tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:34.232600 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4bce8175-a505-4e21-8036-76934a9fe7f3 tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:34.234720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 921/1853] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:34 2022] DELETE /identity/v3/projects/1e1036fa19634c30b6eb86c810a295db => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:34.580915 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbfd652-397d-483c-9698-e33e5e9b9d6b tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:34.583009 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8dbfd652-397d-483c-9698-e33e5e9b9d6b tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:34.589553 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:34.691298 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbfd652-397d-483c-9698-e33e5e9b9d6b tempest-VolumeQuotaClassesTest-1107636982 tempest-VolumeQuotaClassesTest-1107636982-project-admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:34.773212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d736359-2a45-45e0-ad9b-dc417852b297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:34.774025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d736359-2a45-45e0-ad9b-dc417852b297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:34.774317 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d736359-2a45-45e0-ad9b-dc417852b297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:34.774594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d736359-2a45-45e0-ad9b-dc417852b297 admin admin] PATH_INFO: `/v3/users/b944a841063a4b269d9efa776b7939e2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:34.775788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d736359-2a45-45e0-ad9b-dc417852b297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b944a841063a4b269d9efa776b7939e2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:34.778040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d736359-2a45-45e0-ad9b-dc417852b297 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:34.857114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0d736359-2a45-45e0-ad9b-dc417852b297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b944a841063a4b269d9efa776b7939e2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:34.868413 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0d736359-2a45-45e0-ad9b-dc417852b297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b944a841063a4b269d9efa776b7939e2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:34.869042 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0d736359-2a45-45e0-ad9b-dc417852b297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b944a841063a4b269d9efa776b7939e2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:34.937441 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0d736359-2a45-45e0-ad9b-dc417852b297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b944a841063a4b269d9efa776b7939e2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:34.966914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0d736359-2a45-45e0-ad9b-dc417852b297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b944a841063a4b269d9efa776b7939e2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:34.987781 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 933/1854] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:34 2022] DELETE /identity/v3/users/b944a841063a4b269d9efa776b7939e2 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:34.989839 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36095-de1e-46e5-a023-1f28d6ab10b5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:34.990714 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36095-de1e-46e5-a023-1f28d6ab10b5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:34.991275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36095-de1e-46e5-a023-1f28d6ab10b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:35.013033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f7c36095-de1e-46e5-a023-1f28d6ab10b5 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:35.014753 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f7c36095-de1e-46e5-a023-1f28d6ab10b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:35.120327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 922/1855] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:35.142168 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d736359-2a45-45e0-ad9b-dc417852b297 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:35.143807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0d736359-2a45-45e0-ad9b-dc417852b297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:35.183748 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:35.221955 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d736359-2a45-45e0-ad9b-dc417852b297 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:35.228153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568beed-5835-429c-b6be-ea67a62e87ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:35.228868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568beed-5835-429c-b6be-ea67a62e87ad service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:35.229218 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568beed-5835-429c-b6be-ea67a62e87ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:35.229664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568beed-5835-429c-b6be-ea67a62e87ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:35.245560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568beed-5835-429c-b6be-ea67a62e87ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:35.247909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568beed-5835-429c-b6be-ea67a62e87ad service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:35.264013 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 934/1856] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:09:35.725171 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c36095-de1e-46e5-a023-1f28d6ab10b5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:35.728655 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f7c36095-de1e-46e5-a023-1f28d6ab10b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:35.756594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c36095-de1e-46e5-a023-1f28d6ab10b5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:35.787445 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01b3a1-b7a2-4186-8122-4aa735a260b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:35.792822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01b3a1-b7a2-4186-8122-4aa735a260b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:35.794768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01b3a1-b7a2-4186-8122-4aa735a260b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:35.795120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01b3a1-b7a2-4186-8122-4aa735a260b0 admin admin] PATH_INFO: `/v3/projects/2406f43bbbf1409cb4e16c566364b496` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:35.808038 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01b3a1-b7a2-4186-8122-4aa735a260b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2406f43bbbf1409cb4e16c566364b496)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:35.812604 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01b3a1-b7a2-4186-8122-4aa735a260b0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:35.883627 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8a01b3a1-b7a2-4186-8122-4aa735a260b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2406f43bbbf1409cb4e16c566364b496', 'request_id': 'req-8a01b3a1-b7a2-4186-8122-4aa735a260b0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:35.893225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8a01b3a1-b7a2-4186-8122-4aa735a260b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2406f43bbbf1409cb4e16c566364b496', 'request_id': 'req-8a01b3a1-b7a2-4186-8122-4aa735a260b0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:35.902719 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8a01b3a1-b7a2-4186-8122-4aa735a260b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2406f43bbbf1409cb4e16c566364b496', 'request_id': 'req-8a01b3a1-b7a2-4186-8122-4aa735a260b0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:35.927818 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8a01b3a1-b7a2-4186-8122-4aa735a260b0 admin admin] The token cache is being invalidate because project 2406f43bbbf1409cb4e16c566364b496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:35.928118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8a01b3a1-b7a2-4186-8122-4aa735a260b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:35.929105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8a01b3a1-b7a2-4186-8122-4aa735a260b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:35.931460 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 923/1857] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:35 2022] DELETE /identity/v3/projects/2406f43bbbf1409cb4e16c566364b496 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:35.936209 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568beed-5835-429c-b6be-ea67a62e87ad service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:35.948180 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568beed-5835-429c-b6be-ea67a62e87ad service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:36.014573 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007e167-e0ae-40b6-9091-d284825d6a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:36.015265 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007e167-e0ae-40b6-9091-d284825d6a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:36.015546 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007e167-e0ae-40b6-9091-d284825d6a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:36.015958 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007e167-e0ae-40b6-9091-d284825d6a6e admin admin] PATH_INFO: `/v3/users/ad85c0e2764e460d8b05ca604b14cb83` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:36.017090 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007e167-e0ae-40b6-9091-d284825d6a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad85c0e2764e460d8b05ca604b14cb83)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:36.019025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007e167-e0ae-40b6-9091-d284825d6a6e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:36.067180 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a007e167-e0ae-40b6-9091-d284825d6a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad85c0e2764e460d8b05ca604b14cb83'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:36.075145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a007e167-e0ae-40b6-9091-d284825d6a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad85c0e2764e460d8b05ca604b14cb83'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:36.075757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a007e167-e0ae-40b6-9091-d284825d6a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad85c0e2764e460d8b05ca604b14cb83'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:36.087615 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a007e167-e0ae-40b6-9091-d284825d6a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad85c0e2764e460d8b05ca604b14cb83'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:36.094245 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a007e167-e0ae-40b6-9091-d284825d6a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad85c0e2764e460d8b05ca604b14cb83'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:36.100000 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 935/1858] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:35 2022] DELETE /identity/v3/users/ad85c0e2764e460d8b05ca604b14cb83 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:36.375652 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01b3a1-b7a2-4186-8122-4aa735a260b0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:36.377238 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8a01b3a1-b7a2-4186-8122-4aa735a260b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:36.405755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01b3a1-b7a2-4186-8122-4aa735a260b0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:36.485135 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29404332-4b64-41a1-afd6-02365028c82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:36.485769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29404332-4b64-41a1-afd6-02365028c82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:36.486276 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29404332-4b64-41a1-afd6-02365028c82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:36.486551 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29404332-4b64-41a1-afd6-02365028c82c admin admin] PATH_INFO: `/v3/projects/ff734260b2ff43738e7aea9297628a79` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:36.488111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29404332-4b64-41a1-afd6-02365028c82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff734260b2ff43738e7aea9297628a79)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:36.490568 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29404332-4b64-41a1-afd6-02365028c82c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:36.529024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:36.556933 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-29404332-4b64-41a1-afd6-02365028c82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff734260b2ff43738e7aea9297628a79', 'request_id': 'req-29404332-4b64-41a1-afd6-02365028c82c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:36.563424 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-29404332-4b64-41a1-afd6-02365028c82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff734260b2ff43738e7aea9297628a79', 'request_id': 'req-29404332-4b64-41a1-afd6-02365028c82c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:36.575693 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-29404332-4b64-41a1-afd6-02365028c82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff734260b2ff43738e7aea9297628a79', 'request_id': 'req-29404332-4b64-41a1-afd6-02365028c82c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:36.590550 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-29404332-4b64-41a1-afd6-02365028c82c admin admin] The token cache is being invalidate because project ff734260b2ff43738e7aea9297628a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:36.590841 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-29404332-4b64-41a1-afd6-02365028c82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:36.591469 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-29404332-4b64-41a1-afd6-02365028c82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:36.593012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 924/1859] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:36 2022] DELETE /identity/v3/projects/ff734260b2ff43738e7aea9297628a79 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:36.597968 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1877-e9c8-467e-8e7b-b4fcda0bbf1a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:36.598458 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1877-e9c8-467e-8e7b-b4fcda0bbf1a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:36.598571 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1877-e9c8-467e-8e7b-b4fcda0bbf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:36.619703 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8f2a1877-e9c8-467e-8e7b-b4fcda0bbf1a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:36.623006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8f2a1877-e9c8-467e-8e7b-b4fcda0bbf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:36.680445 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:36.704449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 936/1860] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:36.712776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7af0a-940a-42a8-a056-47003a611b6c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:36.713064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7af0a-940a-42a8-a056-47003a611b6c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:36.713335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7af0a-940a-42a8-a056-47003a611b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:36.740684 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-27c7af0a-940a-42a8-a056-47003a611b6c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:36.743013 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-27c7af0a-940a-42a8-a056-47003a611b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:36.752401 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 925/1861] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:36.756918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a1877-e9c8-467e-8e7b-b4fcda0bbf1a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:36.768482 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a1877-e9c8-467e-8e7b-b4fcda0bbf1a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:36.775264 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f583fb-80d4-4f96-983d-8a66c547264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:36.775954 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f583fb-80d4-4f96-983d-8a66c547264b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:36.776297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f583fb-80d4-4f96-983d-8a66c547264b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:36.776631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f583fb-80d4-4f96-983d-8a66c547264b admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:36.777348 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f583fb-80d4-4f96-983d-8a66c547264b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:09:36.777715 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f583fb-80d4-4f96-983d-8a66c547264b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:36.779439 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f583fb-80d4-4f96-983d-8a66c547264b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:36.792520 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 937/1862] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:09:36.799338 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7af0a-940a-42a8-a056-47003a611b6c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:36.809718 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7af0a-940a-42a8-a056-47003a611b6c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:36.815202 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d32a2-1715-49f5-a0b2-5a40a9a2b772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:36.815810 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d32a2-1715-49f5-a0b2-5a40a9a2b772 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:36.816247 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d32a2-1715-49f5-a0b2-5a40a9a2b772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:36.816523 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d32a2-1715-49f5-a0b2-5a40a9a2b772 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:36.817280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d32a2-1715-49f5-a0b2-5a40a9a2b772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:36.819106 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d32a2-1715-49f5-a0b2-5a40a9a2b772 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:36.858846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 926/1863] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:36 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:36.865507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f583fb-80d4-4f96-983d-8a66c547264b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:36.877360 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f583fb-80d4-4f96-983d-8a66c547264b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:36.947980 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a405d-0b61-4c25-9d2f-3394845f34eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:36.948826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a405d-0b61-4c25-9d2f-3394845f34eb admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:36.949117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a405d-0b61-4c25-9d2f-3394845f34eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:36.949841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a405d-0b61-4c25-9d2f-3394845f34eb admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:36.950547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a405d-0b61-4c25-9d2f-3394845f34eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:36.953508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a405d-0b61-4c25-9d2f-3394845f34eb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:36.980969 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 938/1864] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:36 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:36.985530 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d32a2-1715-49f5-a0b2-5a40a9a2b772 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:36.999110 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d32a2-1715-49f5-a0b2-5a40a9a2b772 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:37.004677 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac96dc2-3ca4-4e38-b35c-3c46d35a6707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:37.005353 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac96dc2-3ca4-4e38-b35c-3c46d35a6707 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:37.005876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac96dc2-3ca4-4e38-b35c-3c46d35a6707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:37.006220 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac96dc2-3ca4-4e38-b35c-3c46d35a6707 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:37.006937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac96dc2-3ca4-4e38-b35c-3c46d35a6707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:37.008623 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac96dc2-3ca4-4e38-b35c-3c46d35a6707 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:37.022110 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 927/1865] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:09:37.026244 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a405d-0b61-4c25-9d2f-3394845f34eb admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:37.058359 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a405d-0b61-4c25-9d2f-3394845f34eb admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:37.075391 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7e603-75cb-46bd-b6f7-022be467a06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:37.076479 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7e603-75cb-46bd-b6f7-022be467a06b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:37.076939 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7e603-75cb-46bd-b6f7-022be467a06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:37.077416 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7e603-75cb-46bd-b6f7-022be467a06b admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:37.078408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7e603-75cb-46bd-b6f7-022be467a06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:37.080129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7e603-75cb-46bd-b6f7-022be467a06b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:37.092063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 939/1866] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:37.097056 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac96dc2-3ca4-4e38-b35c-3c46d35a6707 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:37.113694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac96dc2-3ca4-4e38-b35c-3c46d35a6707 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:37.120194 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0e97c-ccec-46b4-9dad-575220a8f6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:37.121276 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0e97c-ccec-46b4-9dad-575220a8f6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:37.121276 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0e97c-ccec-46b4-9dad-575220a8f6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:37.121466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0e97c-ccec-46b4-9dad-575220a8f6f2 admin admin] PATH_INFO: `/v3/projects/2c0e292595484e6782b5d55a4cffa2c9/users/2f5e6461f7f94de58ec526d5ee2709cf/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:37.138267 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0e97c-ccec-46b4-9dad-575220a8f6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0e292595484e6782b5d55a4cffa2c9, user_id=2f5e6461f7f94de58ec526d5ee2709cf, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:37.141365 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0e97c-ccec-46b4-9dad-575220a8f6f2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:37.160751 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 928/1867] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:37 2022] PUT /identity/v3/projects/2c0e292595484e6782b5d55a4cffa2c9/users/2f5e6461f7f94de58ec526d5ee2709cf/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:37.173615 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d68bf5-2a64-4e8b-b442-670571b5bcb0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:37.174124 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d68bf5-2a64-4e8b-b442-670571b5bcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:37.174674 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d68bf5-2a64-4e8b-b442-670571b5bcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:37.220090 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-32d68bf5-2a64-4e8b-b442-670571b5bcb0 None None] MFA Rules not processed for user `2f5e6461f7f94de58ec526d5ee2709cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:37.221730 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-32d68bf5-2a64-4e8b-b442-670571b5bcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:37.296924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 940/1868] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:37.301555 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0e97c-ccec-46b4-9dad-575220a8f6f2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:37.397363 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0e97c-ccec-46b4-9dad-575220a8f6f2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:37.403390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41015929-0f58-4eb3-8f43-c6529eaa3e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:37.404192 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41015929-0f58-4eb3-8f43-c6529eaa3e67 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:37.404467 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41015929-0f58-4eb3-8f43-c6529eaa3e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:37.404734 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41015929-0f58-4eb3-8f43-c6529eaa3e67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:37.405401 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41015929-0f58-4eb3-8f43-c6529eaa3e67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:37.407272 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41015929-0f58-4eb3-8f43-c6529eaa3e67 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:37.439420 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 929/1869] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:37 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:37.443267 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d68bf5-2a64-4e8b-b442-670571b5bcb0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:37.452502 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d68bf5-2a64-4e8b-b442-670571b5bcb0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:37.509103 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:37.524589 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccff63-def6-4f6a-b6fa-fafbddfbebf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:37.525207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccff63-def6-4f6a-b6fa-fafbddfbebf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:37.525494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccff63-def6-4f6a-b6fa-fafbddfbebf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:37.525771 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccff63-def6-4f6a-b6fa-fafbddfbebf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:37.526407 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccff63-def6-4f6a-b6fa-fafbddfbebf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:37.528512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccff63-def6-4f6a-b6fa-fafbddfbebf4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:37.554602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 941/1870] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:37 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:37.559048 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41015929-0f58-4eb3-8f43-c6529eaa3e67 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:37.570278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41015929-0f58-4eb3-8f43-c6529eaa3e67 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:37.575404 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39161bc7-c9bf-4a32-9076-ea2b934ae0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:37.576004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39161bc7-c9bf-4a32-9076-ea2b934ae0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:37.576287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39161bc7-c9bf-4a32-9076-ea2b934ae0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:37.576559 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39161bc7-c9bf-4a32-9076-ea2b934ae0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:37.577196 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39161bc7-c9bf-4a32-9076-ea2b934ae0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:37.578774 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39161bc7-c9bf-4a32-9076-ea2b934ae0b5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:37.590570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 930/1871] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:37.594058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccff63-def6-4f6a-b6fa-fafbddfbebf4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:37.604017 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccff63-def6-4f6a-b6fa-fafbddfbebf4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:37.608638 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ceb59-7679-4ed3-9326-b6c293d8d6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:37.609285 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ceb59-7679-4ed3-9326-b6c293d8d6e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:37.609564 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ceb59-7679-4ed3-9326-b6c293d8d6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:37.609842 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ceb59-7679-4ed3-9326-b6c293d8d6e9 admin admin] PATH_INFO: `/v3/projects/16c15289112649eebf22dd8bfb770313/users/3c08ae7726f94ec18dc983f725da4797/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:37.627591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ceb59-7679-4ed3-9326-b6c293d8d6e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16c15289112649eebf22dd8bfb770313, user_id=3c08ae7726f94ec18dc983f725da4797, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:37.631151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ceb59-7679-4ed3-9326-b6c293d8d6e9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:37.647716 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 942/1872] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:37 2022] PUT /identity/v3/projects/16c15289112649eebf22dd8bfb770313/users/3c08ae7726f94ec18dc983f725da4797/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:37.653042 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39161bc7-c9bf-4a32-9076-ea2b934ae0b5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:37.662892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39161bc7-c9bf-4a32-9076-ea2b934ae0b5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:37.683935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:37.723890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1aa09b-b079-48ed-9fe2-c59488bc0c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:37.724535 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aa09b-b079-48ed-9fe2-c59488bc0c9a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:37.724813 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aa09b-b079-48ed-9fe2-c59488bc0c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:37.725085 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aa09b-b079-48ed-9fe2-c59488bc0c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:37.725726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1aa09b-b079-48ed-9fe2-c59488bc0c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:37.728029 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1aa09b-b079-48ed-9fe2-c59488bc0c9a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:37.738435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 931/1873] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:37.742887 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ceb59-7679-4ed3-9326-b6c293d8d6e9 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:37.753383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ceb59-7679-4ed3-9326-b6c293d8d6e9 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:37.758460 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d270998-111f-42d2-9cd3-4cf0b08d556d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:37.759135 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d270998-111f-42d2-9cd3-4cf0b08d556d admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:37.759665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d270998-111f-42d2-9cd3-4cf0b08d556d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:37.760149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d270998-111f-42d2-9cd3-4cf0b08d556d admin admin] PATH_INFO: `/v3/projects/16c15289112649eebf22dd8bfb770313/users/3c08ae7726f94ec18dc983f725da4797/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:37.762102 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d270998-111f-42d2-9cd3-4cf0b08d556d admin admin] RBAC: Authorizing `identity:create_grant(project_id=16c15289112649eebf22dd8bfb770313, user_id=3c08ae7726f94ec18dc983f725da4797, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:37.764908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d270998-111f-42d2-9cd3-4cf0b08d556d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:37.776979 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 943/1874] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:37 2022] PUT /identity/v3/projects/16c15289112649eebf22dd8bfb770313/users/3c08ae7726f94ec18dc983f725da4797/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:09:37.789132 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f99b3-97b0-4519-b011-75ae810ef345 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:37.789604 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f99b3-97b0-4519-b011-75ae810ef345 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:37.789886 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f99b3-97b0-4519-b011-75ae810ef345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:37.818327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-770f99b3-97b0-4519-b011-75ae810ef345 None None] MFA Rules not processed for user `3c08ae7726f94ec18dc983f725da4797`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:37.819567 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-770f99b3-97b0-4519-b011-75ae810ef345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:37.899733 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 932/1875] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:37.911389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d270998-111f-42d2-9cd3-4cf0b08d556d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:37.913348 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2d270998-111f-42d2-9cd3-4cf0b08d556d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:37.995260 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d270998-111f-42d2-9cd3-4cf0b08d556d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:38.000209 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56337e-cd01-4571-b8d2-0d7410751bc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:38.000668 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56337e-cd01-4571-b8d2-0d7410751bc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:38.001578 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56337e-cd01-4571-b8d2-0d7410751bc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:38.001858 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56337e-cd01-4571-b8d2-0d7410751bc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:38.015662 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56337e-cd01-4571-b8d2-0d7410751bc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:38.017227 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56337e-cd01-4571-b8d2-0d7410751bc6 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:38.027905 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 944/1876] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:38.119386 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f99b3-97b0-4519-b011-75ae810ef345 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:38.129431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f99b3-97b0-4519-b011-75ae810ef345 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:38.133760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29f1b7-d105-451c-986b-8093b0ec7436 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:38.134437 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29f1b7-d105-451c-986b-8093b0ec7436 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:38.134751 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29f1b7-d105-451c-986b-8093b0ec7436 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:38.134980 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29f1b7-d105-451c-986b-8093b0ec7436 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:38.184393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56337e-cd01-4571-b8d2-0d7410751bc6 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:38.185957 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ad56337e-cd01-4571-b8d2-0d7410751bc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:38.210945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29f1b7-d105-451c-986b-8093b0ec7436 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:38.212672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29f1b7-d105-451c-986b-8093b0ec7436 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:38.221890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 933/1877] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:38.258747 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56337e-cd01-4571-b8d2-0d7410751bc6 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:38.264525 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eedc24-a5f3-4ac3-9bfc-25ec6a0c99fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:38.265160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eedc24-a5f3-4ac3-9bfc-25ec6a0c99fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:38.265434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eedc24-a5f3-4ac3-9bfc-25ec6a0c99fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:38.265786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eedc24-a5f3-4ac3-9bfc-25ec6a0c99fa admin admin] PATH_INFO: `/v3/users/4fc757089f7845bebcbea574dc61bbac` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:38.268212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eedc24-a5f3-4ac3-9bfc-25ec6a0c99fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc757089f7845bebcbea574dc61bbac)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:38.269506 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eedc24-a5f3-4ac3-9bfc-25ec6a0c99fa admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:38.316145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:38.318453 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b2eedc24-a5f3-4ac3-9bfc-25ec6a0c99fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc757089f7845bebcbea574dc61bbac'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:38.328346 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b2eedc24-a5f3-4ac3-9bfc-25ec6a0c99fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc757089f7845bebcbea574dc61bbac'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:38.329077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b2eedc24-a5f3-4ac3-9bfc-25ec6a0c99fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc757089f7845bebcbea574dc61bbac'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:38.346605 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b2eedc24-a5f3-4ac3-9bfc-25ec6a0c99fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc757089f7845bebcbea574dc61bbac'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:38.356339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b2eedc24-a5f3-4ac3-9bfc-25ec6a0c99fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc757089f7845bebcbea574dc61bbac'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:38.363723 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 945/1878] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:38 2022] DELETE /identity/v3/users/4fc757089f7845bebcbea574dc61bbac => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:09:38.369583 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf67ca3-4b21-46fb-a5e3-12d76cd1cfea None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:38.369973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf67ca3-4b21-46fb-a5e3-12d76cd1cfea None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:38.370422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf67ca3-4b21-46fb-a5e3-12d76cd1cfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:38.389941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ecf67ca3-4b21-46fb-a5e3-12d76cd1cfea None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:38.391321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ecf67ca3-4b21-46fb-a5e3-12d76cd1cfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:38.443037 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:38.466931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 934/1879] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:38.478714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eedc24-a5f3-4ac3-9bfc-25ec6a0c99fa admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:38.480501 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b2eedc24-a5f3-4ac3-9bfc-25ec6a0c99fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:38.626664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eedc24-a5f3-4ac3-9bfc-25ec6a0c99fa admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:38.636785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb853c-9f7d-4db8-a937-ac613afefbd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:38.637656 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb853c-9f7d-4db8-a937-ac613afefbd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:38.638140 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb853c-9f7d-4db8-a937-ac613afefbd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:38.638638 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb853c-9f7d-4db8-a937-ac613afefbd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:38.653996 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb853c-9f7d-4db8-a937-ac613afefbd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:38.655512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb853c-9f7d-4db8-a937-ac613afefbd7 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:38.669531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 946/1880] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:09:39.004554 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf67ca3-4b21-46fb-a5e3-12d76cd1cfea None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:39.006586 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ecf67ca3-4b21-46fb-a5e3-12d76cd1cfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:39.020148 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf67ca3-4b21-46fb-a5e3-12d76cd1cfea None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:39.025096 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe31ad-0ba0-44fc-ac85-f0741cbf50e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:39.025736 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe31ad-0ba0-44fc-ac85-f0741cbf50e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:39.026023 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe31ad-0ba0-44fc-ac85-f0741cbf50e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:39.026299 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe31ad-0ba0-44fc-ac85-f0741cbf50e3 admin admin] PATH_INFO: `/v3/projects/de6c1217e3c1451da9191d0d9d0065c1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:39.027460 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe31ad-0ba0-44fc-ac85-f0741cbf50e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de6c1217e3c1451da9191d0d9d0065c1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:39.029399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe31ad-0ba0-44fc-ac85-f0741cbf50e3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:39.081453 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c9fe31ad-0ba0-44fc-ac85-f0741cbf50e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de6c1217e3c1451da9191d0d9d0065c1', 'request_id': 'req-c9fe31ad-0ba0-44fc-ac85-f0741cbf50e3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:39.088378 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c9fe31ad-0ba0-44fc-ac85-f0741cbf50e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de6c1217e3c1451da9191d0d9d0065c1', 'request_id': 'req-c9fe31ad-0ba0-44fc-ac85-f0741cbf50e3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:39.093806 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c9fe31ad-0ba0-44fc-ac85-f0741cbf50e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de6c1217e3c1451da9191d0d9d0065c1', 'request_id': 'req-c9fe31ad-0ba0-44fc-ac85-f0741cbf50e3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:39.107767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c9fe31ad-0ba0-44fc-ac85-f0741cbf50e3 admin admin] The token cache is being invalidate because project de6c1217e3c1451da9191d0d9d0065c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:39.108050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c9fe31ad-0ba0-44fc-ac85-f0741cbf50e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:39.108672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c9fe31ad-0ba0-44fc-ac85-f0741cbf50e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:39.110155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 935/1881] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:39 2022] DELETE /identity/v3/projects/de6c1217e3c1451da9191d0d9d0065c1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:39.114186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb853c-9f7d-4db8-a937-ac613afefbd7 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:39.124635 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb853c-9f7d-4db8-a937-ac613afefbd7 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:39.188721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28003f76-1550-4d23-9b69-f56289a61b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:39.189382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28003f76-1550-4d23-9b69-f56289a61b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:39.189657 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28003f76-1550-4d23-9b69-f56289a61b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:39.189925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28003f76-1550-4d23-9b69-f56289a61b24 admin admin] PATH_INFO: `/v3/users/80a636ad9e484f419206729faa041f72` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:39.191042 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28003f76-1550-4d23-9b69-f56289a61b24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a636ad9e484f419206729faa041f72)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:39.192974 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28003f76-1550-4d23-9b69-f56289a61b24 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:39.240909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-28003f76-1550-4d23-9b69-f56289a61b24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a636ad9e484f419206729faa041f72'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:39.248580 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-28003f76-1550-4d23-9b69-f56289a61b24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a636ad9e484f419206729faa041f72'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:39.249215 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-28003f76-1550-4d23-9b69-f56289a61b24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a636ad9e484f419206729faa041f72'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:39.256876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:39.262601 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-28003f76-1550-4d23-9b69-f56289a61b24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a636ad9e484f419206729faa041f72'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:39.279614 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-28003f76-1550-4d23-9b69-f56289a61b24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a636ad9e484f419206729faa041f72'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:39.287010 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 947/1882] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:39 2022] DELETE /identity/v3/users/80a636ad9e484f419206729faa041f72 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:39.564008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe31ad-0ba0-44fc-ac85-f0741cbf50e3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:39.566268 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c9fe31ad-0ba0-44fc-ac85-f0741cbf50e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:39.584860 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe31ad-0ba0-44fc-ac85-f0741cbf50e3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:39.675649 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7800e-31a8-4db4-9d9d-cf9c7065421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:39.676573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7800e-31a8-4db4-9d9d-cf9c7065421f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:39.677004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7800e-31a8-4db4-9d9d-cf9c7065421f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:39.677277 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7800e-31a8-4db4-9d9d-cf9c7065421f admin admin] PATH_INFO: `/v3/projects/7d17f131fb9045c48148a0a722ca1e94` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:39.678867 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7800e-31a8-4db4-9d9d-cf9c7065421f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d17f131fb9045c48148a0a722ca1e94)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:39.681341 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7800e-31a8-4db4-9d9d-cf9c7065421f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:39.737566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-84e7800e-31a8-4db4-9d9d-cf9c7065421f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d17f131fb9045c48148a0a722ca1e94', 'request_id': 'req-84e7800e-31a8-4db4-9d9d-cf9c7065421f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:39.750224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-84e7800e-31a8-4db4-9d9d-cf9c7065421f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d17f131fb9045c48148a0a722ca1e94', 'request_id': 'req-84e7800e-31a8-4db4-9d9d-cf9c7065421f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:39.765596 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-84e7800e-31a8-4db4-9d9d-cf9c7065421f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d17f131fb9045c48148a0a722ca1e94', 'request_id': 'req-84e7800e-31a8-4db4-9d9d-cf9c7065421f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:39.782090 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:39.790706 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28003f76-1550-4d23-9b69-f56289a61b24 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:39.791461 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-84e7800e-31a8-4db4-9d9d-cf9c7065421f admin admin] The token cache is being invalidate because project 7d17f131fb9045c48148a0a722ca1e94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:39.791762 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-84e7800e-31a8-4db4-9d9d-cf9c7065421f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:39.793058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-28003f76-1550-4d23-9b69-f56289a61b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:39.794399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-84e7800e-31a8-4db4-9d9d-cf9c7065421f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:39.797404 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 936/1883] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:39 2022] DELETE /identity/v3/projects/7d17f131fb9045c48148a0a722ca1e94 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:39.802941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17221a56-dda1-4cdc-9517-d89a6d776372 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:39.803320 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17221a56-dda1-4cdc-9517-d89a6d776372 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:39.803957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17221a56-dda1-4cdc-9517-d89a6d776372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:39.810982 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28003f76-1550-4d23-9b69-f56289a61b24 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:39.853684 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-17221a56-dda1-4cdc-9517-d89a6d776372 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:39.857936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-17221a56-dda1-4cdc-9517-d89a6d776372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:39.906542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddc7ed-be7b-4f26-9f3f-80fca212faad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:39.907362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddc7ed-be7b-4f26-9f3f-80fca212faad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:39.909145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddc7ed-be7b-4f26-9f3f-80fca212faad admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:39.909528 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddc7ed-be7b-4f26-9f3f-80fca212faad admin admin] PATH_INFO: `/v3/users/0d8b0fbb78314df8bd11a25f97df4eb8` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:39.911595 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddc7ed-be7b-4f26-9f3f-80fca212faad admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8b0fbb78314df8bd11a25f97df4eb8)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:39.916411 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddc7ed-be7b-4f26-9f3f-80fca212faad admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:39.989906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8fddc7ed-be7b-4f26-9f3f-80fca212faad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8b0fbb78314df8bd11a25f97df4eb8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:39.999596 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 937/1884] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:40.008026 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bc0ce-78bf-4aa5-9fb1-d912660ec8ae None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:40.008932 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bc0ce-78bf-4aa5-9fb1-d912660ec8ae None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:40.008932 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bc0ce-78bf-4aa5-9fb1-d912660ec8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:40.015405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8fddc7ed-be7b-4f26-9f3f-80fca212faad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8b0fbb78314df8bd11a25f97df4eb8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:40.017911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8fddc7ed-be7b-4f26-9f3f-80fca212faad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8b0fbb78314df8bd11a25f97df4eb8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:40.043071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1f5bc0ce-78bf-4aa5-9fb1-d912660ec8ae None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:40.043790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8fddc7ed-be7b-4f26-9f3f-80fca212faad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8b0fbb78314df8bd11a25f97df4eb8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:40.044701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1f5bc0ce-78bf-4aa5-9fb1-d912660ec8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:40.057063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8fddc7ed-be7b-4f26-9f3f-80fca212faad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8b0fbb78314df8bd11a25f97df4eb8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:40.057622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 938/1885] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:40.062184 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bc0ce-78bf-4aa5-9fb1-d912660ec8ae None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:40.065106 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 948/1886] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:39 2022] DELETE /identity/v3/users/0d8b0fbb78314df8bd11a25f97df4eb8 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:40.073577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bc0ce-78bf-4aa5-9fb1-d912660ec8ae None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:40.076878 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e71e4a-b3ed-46d5-9180-cd847ee003bb None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:40.077238 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e71e4a-b3ed-46d5-9180-cd847ee003bb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:40.077592 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e71e4a-b3ed-46d5-9180-cd847ee003bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:40.103131 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-15e71e4a-b3ed-46d5-9180-cd847ee003bb None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:40.104357 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-15e71e4a-b3ed-46d5-9180-cd847ee003bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:40.166929 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4920118-00b2-47d6-8925-a3a507c13702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:40.167867 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4920118-00b2-47d6-8925-a3a507c13702 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:40.168373 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4920118-00b2-47d6-8925-a3a507c13702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:40.168879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4920118-00b2-47d6-8925-a3a507c13702 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:40.169732 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4920118-00b2-47d6-8925-a3a507c13702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:09:40.170420 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4920118-00b2-47d6-8925-a3a507c13702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:40.172295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4920118-00b2-47d6-8925-a3a507c13702 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:40.214658 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 949/1887] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:40.215559 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 939/1888] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 07:09:40.217229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e71e4a-b3ed-46d5-9180-cd847ee003bb None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:40.228059 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:40.245777 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e71e4a-b3ed-46d5-9180-cd847ee003bb None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:40.259242 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4920118-00b2-47d6-8925-a3a507c13702 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:40.259427 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd60d3-d889-469c-909c-96b921ba46b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:40.260296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd60d3-d889-469c-909c-96b921ba46b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:40.260910 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd60d3-d889-469c-909c-96b921ba46b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:40.261686 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c4920118-00b2-47d6-8925-a3a507c13702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:40.262072 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd60d3-d889-469c-909c-96b921ba46b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:40.262833 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd60d3-d889-469c-909c-96b921ba46b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:40.266542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd60d3-d889-469c-909c-96b921ba46b9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:40.332032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 950/1889] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:40 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:40.333112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd60d3-d889-469c-909c-96b921ba46b9 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:40.419261 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4920118-00b2-47d6-8925-a3a507c13702 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:40.501430 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd60d3-d889-469c-909c-96b921ba46b9 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:40.518637 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950837c-487f-4b56-92de-08cbd81c7392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:40.519782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950837c-487f-4b56-92de-08cbd81c7392 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:40.520610 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950837c-487f-4b56-92de-08cbd81c7392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:40.521452 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950837c-487f-4b56-92de-08cbd81c7392 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:40.525933 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950837c-487f-4b56-92de-08cbd81c7392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:40.532699 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950837c-487f-4b56-92de-08cbd81c7392 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:40.537792 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:40.571504 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949f2ba-6c93-498e-a305-bc2e64a1651d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:40.572444 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949f2ba-6c93-498e-a305-bc2e64a1651d service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:40.572726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949f2ba-6c93-498e-a305-bc2e64a1651d service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:40.572995 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949f2ba-6c93-498e-a305-bc2e64a1651d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:40.591445 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 951/1890] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:40 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:40.598058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950837c-487f-4b56-92de-08cbd81c7392 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:40.618480 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950837c-487f-4b56-92de-08cbd81c7392 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:40.630815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949f2ba-6c93-498e-a305-bc2e64a1651d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:40.632844 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949f2ba-6c93-498e-a305-bc2e64a1651d service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:40.633826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac314e88-24d9-4fa2-b995-142391f7e5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:40.634691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac314e88-24d9-4fa2-b995-142391f7e5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:40.635139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac314e88-24d9-4fa2-b995-142391f7e5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:40.651985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac314e88-24d9-4fa2-b995-142391f7e5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:40.653207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac314e88-24d9-4fa2-b995-142391f7e5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:40.656406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac314e88-24d9-4fa2-b995-142391f7e5c3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:40.667416 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 940/1891] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:09:40.675992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 952/1892] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:40.677670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949f2ba-6c93-498e-a305-bc2e64a1651d service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:40.690317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949f2ba-6c93-498e-a305-bc2e64a1651d service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:40.696600 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04076a47-b17b-48db-b871-cac2994a33ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:40.697527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04076a47-b17b-48db-b871-cac2994a33ab admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:40.698065 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04076a47-b17b-48db-b871-cac2994a33ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:40.698409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04076a47-b17b-48db-b871-cac2994a33ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:40.699778 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04076a47-b17b-48db-b871-cac2994a33ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:40.701361 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04076a47-b17b-48db-b871-cac2994a33ab admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:40.715278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 941/1893] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:40.717582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac314e88-24d9-4fa2-b995-142391f7e5c3 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:40.741253 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac314e88-24d9-4fa2-b995-142391f7e5c3 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:40.747218 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fc4b4-6eed-4a0d-a26d-93f49fc422ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:40.747930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fc4b4-6eed-4a0d-a26d-93f49fc422ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:40.748212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fc4b4-6eed-4a0d-a26d-93f49fc422ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:40.748487 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fc4b4-6eed-4a0d-a26d-93f49fc422ff admin admin] PATH_INFO: `/v3/projects/11d4df8659a74097b5b68458d713da7f/users/451fe667763c4e39b68899cdff5978c6/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:40.772253 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fc4b4-6eed-4a0d-a26d-93f49fc422ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=11d4df8659a74097b5b68458d713da7f, user_id=451fe667763c4e39b68899cdff5978c6, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:40.776528 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fc4b4-6eed-4a0d-a26d-93f49fc422ff admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:40.797458 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 953/1894] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:40 2022] PUT /identity/v3/projects/11d4df8659a74097b5b68458d713da7f/users/451fe667763c4e39b68899cdff5978c6/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:40.808682 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2d1d2-1f52-436e-84f3-d42d298ba0bd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:40.809722 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2d1d2-1f52-436e-84f3-d42d298ba0bd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:40.810102 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2d1d2-1f52-436e-84f3-d42d298ba0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:40.876148 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-74f2d1d2-1f52-436e-84f3-d42d298ba0bd None None] MFA Rules not processed for user `451fe667763c4e39b68899cdff5978c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:40.877378 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-74f2d1d2-1f52-436e-84f3-d42d298ba0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:40.997948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 942/1895] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:40.999515 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fc4b4-6eed-4a0d-a26d-93f49fc422ff admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:41.125665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fc4b4-6eed-4a0d-a26d-93f49fc422ff admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:41.131193 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d922b-24b5-4406-b171-f03b55feae2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:41.131803 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d922b-24b5-4406-b171-f03b55feae2a admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:41.132236 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d922b-24b5-4406-b171-f03b55feae2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:41.133112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d922b-24b5-4406-b171-f03b55feae2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:41.133788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d922b-24b5-4406-b171-f03b55feae2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:41.136423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d922b-24b5-4406-b171-f03b55feae2a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:41.197640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 954/1896] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:40 2022] POST /identity/v3/projects => generated 381 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:41.202476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2d1d2-1f52-436e-84f3-d42d298ba0bd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:41.219333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2d1d2-1f52-436e-84f3-d42d298ba0bd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:41.331214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51059cea-266d-43b2-bfd8-d2636bd0c3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:41.331843 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51059cea-266d-43b2-bfd8-d2636bd0c3be admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:41.332119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51059cea-266d-43b2-bfd8-d2636bd0c3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:41.332390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51059cea-266d-43b2-bfd8-d2636bd0c3be admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:41.333083 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51059cea-266d-43b2-bfd8-d2636bd0c3be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:41.335484 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51059cea-266d-43b2-bfd8-d2636bd0c3be admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:41.364124 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 943/1897] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:41 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:09:41.368997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d922b-24b5-4406-b171-f03b55feae2a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:41.384474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d922b-24b5-4406-b171-f03b55feae2a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:41.391866 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e6f15-28eb-43b1-b636-87759b3edf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:41.393714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e6f15-28eb-43b1-b636-87759b3edf5e admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:41.394924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e6f15-28eb-43b1-b636-87759b3edf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:41.395395 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e6f15-28eb-43b1-b636-87759b3edf5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:41.396514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e6f15-28eb-43b1-b636-87759b3edf5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:41.398698 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e6f15-28eb-43b1-b636-87759b3edf5e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:41.431722 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 955/1898] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:41.436075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51059cea-266d-43b2-bfd8-d2636bd0c3be admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:41.455207 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51059cea-266d-43b2-bfd8-d2636bd0c3be admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:41.463290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c91b45-5ddc-4bba-92ae-18f2a4556757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:41.463916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c91b45-5ddc-4bba-92ae-18f2a4556757 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:41.472282 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c91b45-5ddc-4bba-92ae-18f2a4556757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:41.473658 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e6f15-28eb-43b1-b636-87759b3edf5e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:41.474472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c91b45-5ddc-4bba-92ae-18f2a4556757 admin admin] PATH_INFO: `/v3/projects/2c9c90cca1884b19ba06b27d705af19c/users/1a0898cd90b646adbb83715f4979157e/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:41.477201 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-298e6f15-28eb-43b1-b636-87759b3edf5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:41.499608 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e6f15-28eb-43b1-b636-87759b3edf5e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:41.500120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c91b45-5ddc-4bba-92ae-18f2a4556757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9c90cca1884b19ba06b27d705af19c, user_id=1a0898cd90b646adbb83715f4979157e, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:41.502901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c91b45-5ddc-4bba-92ae-18f2a4556757 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:41.509497 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c114fd-29a3-4910-97dd-d57bac86eea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:41.510245 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c114fd-29a3-4910-97dd-d57bac86eea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:41.510552 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c114fd-29a3-4910-97dd-d57bac86eea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:41.510860 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c114fd-29a3-4910-97dd-d57bac86eea0 admin admin] PATH_INFO: `/v3/projects/451ff2058c574bf1badeab5140d307e4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:41.512113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c114fd-29a3-4910-97dd-d57bac86eea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=451ff2058c574bf1badeab5140d307e4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:41.514777 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c114fd-29a3-4910-97dd-d57bac86eea0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:41.517379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:41.527979 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 944/1899] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:41 2022] PUT /identity/v3/projects/2c9c90cca1884b19ba06b27d705af19c/users/1a0898cd90b646adbb83715f4979157e/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:41.532083 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c91b45-5ddc-4bba-92ae-18f2a4556757 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:41.576561 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:41.580026 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e3c114fd-29a3-4910-97dd-d57bac86eea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451ff2058c574bf1badeab5140d307e4', 'request_id': 'req-e3c114fd-29a3-4910-97dd-d57bac86eea0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:41.588199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e3c114fd-29a3-4910-97dd-d57bac86eea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451ff2058c574bf1badeab5140d307e4', 'request_id': 'req-e3c114fd-29a3-4910-97dd-d57bac86eea0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:41.598534 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e3c114fd-29a3-4910-97dd-d57bac86eea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451ff2058c574bf1badeab5140d307e4', 'request_id': 'req-e3c114fd-29a3-4910-97dd-d57bac86eea0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:41.617655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e3c114fd-29a3-4910-97dd-d57bac86eea0 admin admin] The token cache is being invalidate because project 451ff2058c574bf1badeab5140d307e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:41.617942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e3c114fd-29a3-4910-97dd-d57bac86eea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:41.618656 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e3c114fd-29a3-4910-97dd-d57bac86eea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:41.620298 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 956/1900] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:41 2022] DELETE /identity/v3/projects/451ff2058c574bf1badeab5140d307e4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:09:41.625574 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c114fd-29a3-4910-97dd-d57bac86eea0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:41.627356 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e3c114fd-29a3-4910-97dd-d57bac86eea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:41.630039 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c91b45-5ddc-4bba-92ae-18f2a4556757 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:41.717187 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c8846-a0db-44d3-abf8-bda9b1c97cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:41.718377 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c8846-a0db-44d3-abf8-bda9b1c97cbb admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:41.718489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c8846-a0db-44d3-abf8-bda9b1c97cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:41.718763 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c8846-a0db-44d3-abf8-bda9b1c97cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:41.719604 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c8846-a0db-44d3-abf8-bda9b1c97cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:41.728694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c8846-a0db-44d3-abf8-bda9b1c97cbb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:41.751533 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 945/1901] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:09:41.754337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c8846-a0db-44d3-abf8-bda9b1c97cbb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:41.757048 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6e3c8846-a0db-44d3-abf8-bda9b1c97cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:41.765366 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c114fd-29a3-4910-97dd-d57bac86eea0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:41.780974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c8846-a0db-44d3-abf8-bda9b1c97cbb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:41.782263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d02a5-6fa1-4583-bbf0-1ff266f1d18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:41.782973 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d02a5-6fa1-4583-bbf0-1ff266f1d18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:41.783321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d02a5-6fa1-4583-bbf0-1ff266f1d18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:41.783546 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d02a5-6fa1-4583-bbf0-1ff266f1d18e admin admin] PATH_INFO: `/v3/users/34deebee004244db838973ade99467c0` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:41.786372 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64d7fe-6058-4ac3-9e22-e2a1c300d804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:41.786997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d02a5-6fa1-4583-bbf0-1ff266f1d18e admin admin] RBAC: Authorizing `identity:delete_user(user_id=34deebee004244db838973ade99467c0)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:41.787125 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64d7fe-6058-4ac3-9e22-e2a1c300d804 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:41.787326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64d7fe-6058-4ac3-9e22-e2a1c300d804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:41.787601 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64d7fe-6058-4ac3-9e22-e2a1c300d804 admin admin] PATH_INFO: `/v3/projects/2c9c90cca1884b19ba06b27d705af19c/users/1a0898cd90b646adbb83715f4979157e/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:41.802454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64d7fe-6058-4ac3-9e22-e2a1c300d804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9c90cca1884b19ba06b27d705af19c, user_id=1a0898cd90b646adbb83715f4979157e, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:41.805724 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64d7fe-6058-4ac3-9e22-e2a1c300d804 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:41.807776 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d02a5-6fa1-4583-bbf0-1ff266f1d18e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:41.819001 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 946/1902] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:41 2022] PUT /identity/v3/projects/2c9c90cca1884b19ba06b27d705af19c/users/1a0898cd90b646adbb83715f4979157e/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:41.832024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13aa493-027e-4162-8314-61cd19e48a08 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:41.832340 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13aa493-027e-4162-8314-61cd19e48a08 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:41.833276 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13aa493-027e-4162-8314-61cd19e48a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:41.894824 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a13aa493-027e-4162-8314-61cd19e48a08 None None] MFA Rules not processed for user `1a0898cd90b646adbb83715f4979157e`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:41.896125 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a13aa493-027e-4162-8314-61cd19e48a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:41.922638 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-865d02a5-6fa1-4583-bbf0-1ff266f1d18e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34deebee004244db838973ade99467c0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:41.933651 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-865d02a5-6fa1-4583-bbf0-1ff266f1d18e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34deebee004244db838973ade99467c0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:41.935967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-865d02a5-6fa1-4583-bbf0-1ff266f1d18e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34deebee004244db838973ade99467c0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:41.980944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-865d02a5-6fa1-4583-bbf0-1ff266f1d18e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34deebee004244db838973ade99467c0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:41.995673 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-865d02a5-6fa1-4583-bbf0-1ff266f1d18e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34deebee004244db838973ade99467c0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:41.996400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 947/1903] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:42.004367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 957/1904] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:41 2022] DELETE /identity/v3/users/34deebee004244db838973ade99467c0 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:42.065399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13aa493-027e-4162-8314-61cd19e48a08 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:42.067896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a13aa493-027e-4162-8314-61cd19e48a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:42.139244 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:42.160665 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13aa493-027e-4162-8314-61cd19e48a08 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:42.254858 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33584e-2b49-4148-bbd9-e33e63340e4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:42.255572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33584e-2b49-4148-bbd9-e33e63340e4a service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:42.256026 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33584e-2b49-4148-bbd9-e33e63340e4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:42.256303 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33584e-2b49-4148-bbd9-e33e63340e4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:42.348434 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33584e-2b49-4148-bbd9-e33e63340e4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:42.349888 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33584e-2b49-4148-bbd9-e33e63340e4a service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:42.363802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 948/1905] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:09:42.484013 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d02a5-6fa1-4583-bbf0-1ff266f1d18e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:42.496054 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d02a5-6fa1-4583-bbf0-1ff266f1d18e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:42.497758 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e527b7-cd0d-46f6-84e1-52c19f66302d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:42.498052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e527b7-cd0d-46f6-84e1-52c19f66302d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:42.498389 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e527b7-cd0d-46f6-84e1-52c19f66302d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:42.500246 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 949/1906] 10.222.0.40 () {54 vars in 921 bytes} [Tue Aug 9 07:09:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:09:42.501548 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e859a-bde4-4698-b8ab-6ce0c0a0fc31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:42.502452 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e859a-bde4-4698-b8ab-6ce0c0a0fc31 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:42.502917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e859a-bde4-4698-b8ab-6ce0c0a0fc31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:42.503390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e859a-bde4-4698-b8ab-6ce0c0a0fc31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:42.505876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-183e859a-bde4-4698-b8ab-6ce0c0a0fc31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:42.509397 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c32061-0cd2-4915-983a-e287494676fd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:42.510587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c32061-0cd2-4915-983a-e287494676fd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:42.510871 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c32061-0cd2-4915-983a-e287494676fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:42.527863 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:42.546141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-95c32061-0cd2-4915-983a-e287494676fd None None] MFA Rules not processed for user `6e949d9666be44a0b6122d510168c7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:42.547617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-95c32061-0cd2-4915-983a-e287494676fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:42.653860 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e859a-bde4-4698-b8ab-6ce0c0a0fc31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:42.655529 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e859a-bde4-4698-b8ab-6ce0c0a0fc31 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:42.658162 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 950/1907] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Aug 9 07:09:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:42.667070 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 958/1908] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:42.685892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c32061-0cd2-4915-983a-e287494676fd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:42.689173 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-95c32061-0cd2-4915-983a-e287494676fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:42.706800 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c32061-0cd2-4915-983a-e287494676fd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:42.716303 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6743256-cbba-4e5f-b5d6-1619da26ed4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:42.717032 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6743256-cbba-4e5f-b5d6-1619da26ed4d service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:42.717232 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6743256-cbba-4e5f-b5d6-1619da26ed4d service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:42.717574 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6743256-cbba-4e5f-b5d6-1619da26ed4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:42.757612 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6743256-cbba-4e5f-b5d6-1619da26ed4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:42.757802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e859a-bde4-4698-b8ab-6ce0c0a0fc31 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:42.757802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-183e859a-bde4-4698-b8ab-6ce0c0a0fc31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:42.758048 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6743256-cbba-4e5f-b5d6-1619da26ed4d service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:42.765115 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 951/1909] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:42.932509 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e859a-bde4-4698-b8ab-6ce0c0a0fc31 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:42.940737 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04280c98-673a-4d93-814b-26214984898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:42.941560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04280c98-673a-4d93-814b-26214984898f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:42.941893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04280c98-673a-4d93-814b-26214984898f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:42.942168 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04280c98-673a-4d93-814b-26214984898f admin admin] PATH_INFO: `/v3/projects/d52886dd44c243f79c9db68bec1a3c33` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:42.943704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04280c98-673a-4d93-814b-26214984898f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52886dd44c243f79c9db68bec1a3c33)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:42.946464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04280c98-673a-4d93-814b-26214984898f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:43.048035 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-04280c98-673a-4d93-814b-26214984898f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52886dd44c243f79c9db68bec1a3c33', 'request_id': 'req-04280c98-673a-4d93-814b-26214984898f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:43.055216 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-04280c98-673a-4d93-814b-26214984898f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52886dd44c243f79c9db68bec1a3c33', 'request_id': 'req-04280c98-673a-4d93-814b-26214984898f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:43.064018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-04280c98-673a-4d93-814b-26214984898f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52886dd44c243f79c9db68bec1a3c33', 'request_id': 'req-04280c98-673a-4d93-814b-26214984898f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:43.082629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-04280c98-673a-4d93-814b-26214984898f admin admin] The token cache is being invalidate because project d52886dd44c243f79c9db68bec1a3c33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:43.083183 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-04280c98-673a-4d93-814b-26214984898f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:43.084008 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-04280c98-673a-4d93-814b-26214984898f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:43.091316 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5327b-0760-4cc5-a6fe-97708f49eba0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:43.091597 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5327b-0760-4cc5-a6fe-97708f49eba0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:43.091875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5327b-0760-4cc5-a6fe-97708f49eba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:43.094543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 959/1910] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:42 2022] DELETE /identity/v3/projects/d52886dd44c243f79c9db68bec1a3c33 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:43.115134 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bcc5327b-0760-4cc5-a6fe-97708f49eba0 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:43.116358 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bcc5327b-0760-4cc5-a6fe-97708f49eba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:43.164049 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:43.219507 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 952/1911] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:43.230643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dac91d-dd98-4d9d-bb60-5a90be52e5e0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:43.230848 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dac91d-dd98-4d9d-bb60-5a90be52e5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:43.231185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dac91d-dd98-4d9d-bb60-5a90be52e5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:43.254296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-42dac91d-dd98-4d9d-bb60-5a90be52e5e0 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:43.255600 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-42dac91d-dd98-4d9d-bb60-5a90be52e5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:43.264725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 960/1912] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:43.268833 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5327b-0760-4cc5-a6fe-97708f49eba0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:43.283277 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5327b-0760-4cc5-a6fe-97708f49eba0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:43.284533 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88ec12-f764-4265-9b26-60a519ea105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:43.285030 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88ec12-f764-4265-9b26-60a519ea105d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:43.285311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88ec12-f764-4265-9b26-60a519ea105d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:43.285580 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88ec12-f764-4265-9b26-60a519ea105d admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:43.286225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88ec12-f764-4265-9b26-60a519ea105d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:09:43.286525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88ec12-f764-4265-9b26-60a519ea105d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:43.288140 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88ec12-f764-4265-9b26-60a519ea105d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:43.303295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 953/1913] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 07:09:43.307650 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dac91d-dd98-4d9d-bb60-5a90be52e5e0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:43.317012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dac91d-dd98-4d9d-bb60-5a90be52e5e0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:43.322649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c5c16-83c6-4312-8a67-74ff6c237dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:43.323361 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c5c16-83c6-4312-8a67-74ff6c237dfe admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:43.323707 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c5c16-83c6-4312-8a67-74ff6c237dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:43.324045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c5c16-83c6-4312-8a67-74ff6c237dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:43.325007 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c5c16-83c6-4312-8a67-74ff6c237dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:43.326944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c5c16-83c6-4312-8a67-74ff6c237dfe admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:43.359616 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 961/1914] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:43 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:43.364837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88ec12-f764-4265-9b26-60a519ea105d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:43.377316 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88ec12-f764-4265-9b26-60a519ea105d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:43.437569 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df978c4-21bd-421d-a75e-20359417d850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:43.438427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df978c4-21bd-421d-a75e-20359417d850 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:43.438703 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df978c4-21bd-421d-a75e-20359417d850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:43.438972 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df978c4-21bd-421d-a75e-20359417d850 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:43.439628 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df978c4-21bd-421d-a75e-20359417d850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:43.441570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df978c4-21bd-421d-a75e-20359417d850 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:43.462858 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 954/1915] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:43 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:43.467102 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c5c16-83c6-4312-8a67-74ff6c237dfe admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:43.481712 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c5c16-83c6-4312-8a67-74ff6c237dfe admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:43.487118 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fa0bd-84e4-4f59-acc6-09ccfd4f3f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:43.487790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fa0bd-84e4-4f59-acc6-09ccfd4f3f4d admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:43.488070 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fa0bd-84e4-4f59-acc6-09ccfd4f3f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:43.488340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fa0bd-84e4-4f59-acc6-09ccfd4f3f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:43.488986 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fa0bd-84e4-4f59-acc6-09ccfd4f3f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:43.490560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fa0bd-84e4-4f59-acc6-09ccfd4f3f4d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:43.497107 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:43.503909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 962/1916] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:09:43.508728 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df978c4-21bd-421d-a75e-20359417d850 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:43.519064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df978c4-21bd-421d-a75e-20359417d850 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:43.524658 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c6c56-3c63-456d-88b9-8a009c46d49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:43.525257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c6c56-3c63-456d-88b9-8a009c46d49b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:43.525532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c6c56-3c63-456d-88b9-8a009c46d49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:43.525800 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c6c56-3c63-456d-88b9-8a009c46d49b admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:43.526434 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c6c56-3c63-456d-88b9-8a009c46d49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:43.528085 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c6c56-3c63-456d-88b9-8a009c46d49b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:43.538620 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 955/1917] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:43.543107 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fa0bd-84e4-4f59-acc6-09ccfd4f3f4d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:43.552738 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fa0bd-84e4-4f59-acc6-09ccfd4f3f4d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:43.557547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c3391-2d49-4dad-8fb6-5a3b532806b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:43.558196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c3391-2d49-4dad-8fb6-5a3b532806b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:43.558477 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c3391-2d49-4dad-8fb6-5a3b532806b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:43.558747 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c3391-2d49-4dad-8fb6-5a3b532806b6 admin admin] PATH_INFO: `/v3/projects/d52184f9795e41a98c922c601b1d0fe6/users/75e48fa385cf47af8f758174b2ea8593/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:43.574546 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c3391-2d49-4dad-8fb6-5a3b532806b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52184f9795e41a98c922c601b1d0fe6, user_id=75e48fa385cf47af8f758174b2ea8593, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:43.577192 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c3391-2d49-4dad-8fb6-5a3b532806b6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:43.590705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 963/1918] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:43 2022] PUT /identity/v3/projects/d52184f9795e41a98c922c601b1d0fe6/users/75e48fa385cf47af8f758174b2ea8593/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:43.601004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dcb60-2be5-46d0-bc41-d54eae257d5e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:43.601285 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dcb60-2be5-46d0-bc41-d54eae257d5e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:43.601557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dcb60-2be5-46d0-bc41-d54eae257d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:43.630605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-904dcb60-2be5-46d0-bc41-d54eae257d5e None None] MFA Rules not processed for user `75e48fa385cf47af8f758174b2ea8593`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:43.632014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-904dcb60-2be5-46d0-bc41-d54eae257d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:43.720031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 956/1919] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:43.725187 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c3391-2d49-4dad-8fb6-5a3b532806b6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:43.837044 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c3391-2d49-4dad-8fb6-5a3b532806b6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:43.844934 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6fe8c-8b02-44f3-b92c-fe86f5f15284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:43.845701 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6fe8c-8b02-44f3-b92c-fe86f5f15284 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:43.846114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6fe8c-8b02-44f3-b92c-fe86f5f15284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:43.846393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6fe8c-8b02-44f3-b92c-fe86f5f15284 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:43.848075 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6fe8c-8b02-44f3-b92c-fe86f5f15284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:43.850135 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6fe8c-8b02-44f3-b92c-fe86f5f15284 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:43.889285 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 964/1920] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:43 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:43.893283 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dcb60-2be5-46d0-bc41-d54eae257d5e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:43.909245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dcb60-2be5-46d0-bc41-d54eae257d5e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:43.938862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:44.021347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77f7eb-f80c-439a-a5fe-55f8576aada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:44.022361 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77f7eb-f80c-439a-a5fe-55f8576aada5 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:44.022800 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77f7eb-f80c-439a-a5fe-55f8576aada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:44.023520 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77f7eb-f80c-439a-a5fe-55f8576aada5 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:44.025176 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77f7eb-f80c-439a-a5fe-55f8576aada5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:44.028098 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77f7eb-f80c-439a-a5fe-55f8576aada5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:44.075600 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6fe8c-8b02-44f3-b92c-fe86f5f15284 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:44.083063 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 957/1921] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:43 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:44.094636 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6fe8c-8b02-44f3-b92c-fe86f5f15284 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:44.116012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77f7eb-f80c-439a-a5fe-55f8576aada5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:44.118499 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cf77f7eb-f80c-439a-a5fe-55f8576aada5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:44.122435 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0e45f-6d5b-4a33-857b-f7e8340cb811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:44.124520 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0e45f-6d5b-4a33-857b-f7e8340cb811 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:44.124816 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0e45f-6d5b-4a33-857b-f7e8340cb811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:44.125094 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0e45f-6d5b-4a33-857b-f7e8340cb811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:44.128647 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0e45f-6d5b-4a33-857b-f7e8340cb811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:44.131594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0e45f-6d5b-4a33-857b-f7e8340cb811 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:44.140675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77f7eb-f80c-439a-a5fe-55f8576aada5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:44.146130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66790f31-a5fb-47a3-83c7-ef4d48c23774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:44.147335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66790f31-a5fb-47a3-83c7-ef4d48c23774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:44.148148 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66790f31-a5fb-47a3-83c7-ef4d48c23774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:44.148443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66790f31-a5fb-47a3-83c7-ef4d48c23774 admin admin] PATH_INFO: `/v3/users/2f5e6461f7f94de58ec526d5ee2709cf` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:44.149645 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66790f31-a5fb-47a3-83c7-ef4d48c23774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f5e6461f7f94de58ec526d5ee2709cf)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:44.152640 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66790f31-a5fb-47a3-83c7-ef4d48c23774 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:44.158118 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 965/1922] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:09:44.163939 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0e45f-6d5b-4a33-857b-f7e8340cb811 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:44.185578 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0e45f-6d5b-4a33-857b-f7e8340cb811 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:44.201518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3a882-ba4d-4a78-b19b-9a56a131b169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:44.202273 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3a882-ba4d-4a78-b19b-9a56a131b169 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:44.202554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3a882-ba4d-4a78-b19b-9a56a131b169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:44.202919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3a882-ba4d-4a78-b19b-9a56a131b169 admin admin] PATH_INFO: `/v3/projects/30613b786c764c9295ecd05ca8d458d5/users/a1ee9514488147da8bd20f39cb75eb0b/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:44.233943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3a882-ba4d-4a78-b19b-9a56a131b169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30613b786c764c9295ecd05ca8d458d5, user_id=a1ee9514488147da8bd20f39cb75eb0b, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:44.238487 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3a882-ba4d-4a78-b19b-9a56a131b169 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:44.265611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 966/1923] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:44 2022] PUT /identity/v3/projects/30613b786c764c9295ecd05ca8d458d5/users/a1ee9514488147da8bd20f39cb75eb0b/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:44.266608 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-66790f31-a5fb-47a3-83c7-ef4d48c23774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f5e6461f7f94de58ec526d5ee2709cf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:44.267358 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-66790f31-a5fb-47a3-83c7-ef4d48c23774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f5e6461f7f94de58ec526d5ee2709cf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:44.269568 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-66790f31-a5fb-47a3-83c7-ef4d48c23774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f5e6461f7f94de58ec526d5ee2709cf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:44.276784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3a882-ba4d-4a78-b19b-9a56a131b169 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:44.282357 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-aba3a882-ba4d-4a78-b19b-9a56a131b169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:44.287748 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-66790f31-a5fb-47a3-83c7-ef4d48c23774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f5e6461f7f94de58ec526d5ee2709cf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:44.305958 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-66790f31-a5fb-47a3-83c7-ef4d48c23774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f5e6461f7f94de58ec526d5ee2709cf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:44.349497 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 958/1924] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:44 2022] DELETE /identity/v3/users/2f5e6461f7f94de58ec526d5ee2709cf => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:44.355602 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aad2f-6eec-49c4-b9b1-9a0d665ef6cf None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:44.355877 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aad2f-6eec-49c4-b9b1-9a0d665ef6cf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:44.356225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aad2f-6eec-49c4-b9b1-9a0d665ef6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:44.382484 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-584aad2f-6eec-49c4-b9b1-9a0d665ef6cf None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:44.384493 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-584aad2f-6eec-49c4-b9b1-9a0d665ef6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:44.414135 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3a882-ba4d-4a78-b19b-9a56a131b169 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:44.481629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:44.527208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87ef9e-452b-443d-b746-c3deae46e596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:44.528435 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87ef9e-452b-443d-b746-c3deae46e596 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:44.529238 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87ef9e-452b-443d-b746-c3deae46e596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:44.530201 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87ef9e-452b-443d-b746-c3deae46e596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:44.531401 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87ef9e-452b-443d-b746-c3deae46e596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:44.533271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87ef9e-452b-443d-b746-c3deae46e596 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:44.544363 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 959/1925] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:44.562139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 967/1926] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:44.566134 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584aad2f-6eec-49c4-b9b1-9a0d665ef6cf None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:44.583483 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584aad2f-6eec-49c4-b9b1-9a0d665ef6cf None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:44.597239 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b421af-a5aa-407b-bf2c-fc7b25d9e54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:44.598162 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b421af-a5aa-407b-bf2c-fc7b25d9e54f admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:44.598544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b421af-a5aa-407b-bf2c-fc7b25d9e54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:44.599001 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b421af-a5aa-407b-bf2c-fc7b25d9e54f admin admin] PATH_INFO: `/v3/projects/30613b786c764c9295ecd05ca8d458d5/users/a1ee9514488147da8bd20f39cb75eb0b/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:44.605590 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87ef9e-452b-443d-b746-c3deae46e596 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:44.608605 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9b87ef9e-452b-443d-b746-c3deae46e596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:44.610601 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b421af-a5aa-407b-bf2c-fc7b25d9e54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30613b786c764c9295ecd05ca8d458d5, user_id=a1ee9514488147da8bd20f39cb75eb0b, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:44.618744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b421af-a5aa-407b-bf2c-fc7b25d9e54f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:44.656129 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 960/1927] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:44 2022] PUT /identity/v3/projects/30613b786c764c9295ecd05ca8d458d5/users/a1ee9514488147da8bd20f39cb75eb0b/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:44.659850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83cdb2-d406-45ba-bad7-db7cbdc9e635 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:44.659850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83cdb2-d406-45ba-bad7-db7cbdc9e635 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:44.659850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83cdb2-d406-45ba-bad7-db7cbdc9e635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:44.722531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87ef9e-452b-443d-b746-c3deae46e596 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:44.764420 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:44.787701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3b83cdb2-d406-45ba-bad7-db7cbdc9e635 None None] MFA Rules not processed for user `a1ee9514488147da8bd20f39cb75eb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:44.787701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3b83cdb2-d406-45ba-bad7-db7cbdc9e635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:44.902934 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0714302-5656-42ec-99a7-f6d1b8e37812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:44.903966 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0714302-5656-42ec-99a7-f6d1b8e37812 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:44.906262 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0714302-5656-42ec-99a7-f6d1b8e37812 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:44.907434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0714302-5656-42ec-99a7-f6d1b8e37812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:44.985383 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 961/1928] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:44.998996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83cdb2-d406-45ba-bad7-db7cbdc9e635 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:45.001401 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3b83cdb2-d406-45ba-bad7-db7cbdc9e635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:45.033705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0714302-5656-42ec-99a7-f6d1b8e37812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:45.036287 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0714302-5656-42ec-99a7-f6d1b8e37812 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:45.062889 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 968/1929] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:45.108117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83cdb2-d406-45ba-bad7-db7cbdc9e635 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:45.112636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac157be-4708-4629-b1f8-14fef4df44e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:45.113385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac157be-4708-4629-b1f8-14fef4df44e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:45.113769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac157be-4708-4629-b1f8-14fef4df44e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:45.114475 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac157be-4708-4629-b1f8-14fef4df44e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:45.130513 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac157be-4708-4629-b1f8-14fef4df44e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:45.132590 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac157be-4708-4629-b1f8-14fef4df44e7 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:45.149121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 962/1930] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:45.287665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0714302-5656-42ec-99a7-f6d1b8e37812 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:45.301302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0714302-5656-42ec-99a7-f6d1b8e37812 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:45.305921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83407ec8-7d44-47ef-a1c1-2663a4339f1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:45.306537 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83407ec8-7d44-47ef-a1c1-2663a4339f1a service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:45.306806 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83407ec8-7d44-47ef-a1c1-2663a4339f1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:45.307096 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83407ec8-7d44-47ef-a1c1-2663a4339f1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:45.308839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-83407ec8-7d44-47ef-a1c1-2663a4339f1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:45.355108 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:45.389845 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83407ec8-7d44-47ef-a1c1-2663a4339f1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:45.391306 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83407ec8-7d44-47ef-a1c1-2663a4339f1a service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:45.402106 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 969/1931] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:45.960533 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac157be-4708-4629-b1f8-14fef4df44e7 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:45.964124 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7ac157be-4708-4629-b1f8-14fef4df44e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:45.985883 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac157be-4708-4629-b1f8-14fef4df44e7 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:45.993135 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bbc8a-8f8d-4846-a649-06ab9e4f65d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:45.994004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bbc8a-8f8d-4846-a649-06ab9e4f65d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:45.994470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bbc8a-8f8d-4846-a649-06ab9e4f65d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:45.994887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bbc8a-8f8d-4846-a649-06ab9e4f65d2 admin admin] PATH_INFO: `/v3/projects/2c0e292595484e6782b5d55a4cffa2c9` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:45.997949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bbc8a-8f8d-4846-a649-06ab9e4f65d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c0e292595484e6782b5d55a4cffa2c9)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:46.000869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bbc8a-8f8d-4846-a649-06ab9e4f65d2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:46.081020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-233bbc8a-8f8d-4846-a649-06ab9e4f65d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c0e292595484e6782b5d55a4cffa2c9', 'request_id': 'req-233bbc8a-8f8d-4846-a649-06ab9e4f65d2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:46.091339 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-233bbc8a-8f8d-4846-a649-06ab9e4f65d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c0e292595484e6782b5d55a4cffa2c9', 'request_id': 'req-233bbc8a-8f8d-4846-a649-06ab9e4f65d2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:46.098792 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-233bbc8a-8f8d-4846-a649-06ab9e4f65d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c0e292595484e6782b5d55a4cffa2c9', 'request_id': 'req-233bbc8a-8f8d-4846-a649-06ab9e4f65d2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:46.122719 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-233bbc8a-8f8d-4846-a649-06ab9e4f65d2 admin admin] The token cache is being invalidate because project 2c0e292595484e6782b5d55a4cffa2c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:46.125910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-233bbc8a-8f8d-4846-a649-06ab9e4f65d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:46.129156 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-233bbc8a-8f8d-4846-a649-06ab9e4f65d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:46.140399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 963/1932] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:45 2022] DELETE /identity/v3/projects/2c0e292595484e6782b5d55a4cffa2c9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:46.144877 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83407ec8-7d44-47ef-a1c1-2663a4339f1a service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:46.161059 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83407ec8-7d44-47ef-a1c1-2663a4339f1a service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:46.233905 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668b386-83f4-4b9f-aac1-0415904065b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:46.234410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668b386-83f4-4b9f-aac1-0415904065b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:46.234741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668b386-83f4-4b9f-aac1-0415904065b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:46.235018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668b386-83f4-4b9f-aac1-0415904065b8 admin admin] PATH_INFO: `/v3/users/3c08ae7726f94ec18dc983f725da4797` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:46.237107 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668b386-83f4-4b9f-aac1-0415904065b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c08ae7726f94ec18dc983f725da4797)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:46.238571 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668b386-83f4-4b9f-aac1-0415904065b8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:46.310582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2668b386-83f4-4b9f-aac1-0415904065b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c08ae7726f94ec18dc983f725da4797'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:46.325740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2668b386-83f4-4b9f-aac1-0415904065b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c08ae7726f94ec18dc983f725da4797'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:46.326605 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2668b386-83f4-4b9f-aac1-0415904065b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c08ae7726f94ec18dc983f725da4797'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:46.348817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2668b386-83f4-4b9f-aac1-0415904065b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c08ae7726f94ec18dc983f725da4797'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:46.376884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2668b386-83f4-4b9f-aac1-0415904065b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c08ae7726f94ec18dc983f725da4797'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:46.386734 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 970/1933] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:46 2022] DELETE /identity/v3/users/3c08ae7726f94ec18dc983f725da4797 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:46.776403 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bbc8a-8f8d-4846-a649-06ab9e4f65d2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:46.777911 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-233bbc8a-8f8d-4846-a649-06ab9e4f65d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:46.791077 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bbc8a-8f8d-4846-a649-06ab9e4f65d2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:46.811363 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:46.857565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59250f12-ddea-42a1-bf88-dd8c5be77d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:46.858206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59250f12-ddea-42a1-bf88-dd8c5be77d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:46.858482 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59250f12-ddea-42a1-bf88-dd8c5be77d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:46.858798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59250f12-ddea-42a1-bf88-dd8c5be77d8c admin admin] PATH_INFO: `/v3/users/449bc78f66bc44919813905cc1682d29` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:46.860147 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59250f12-ddea-42a1-bf88-dd8c5be77d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=449bc78f66bc44919813905cc1682d29)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:46.862082 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59250f12-ddea-42a1-bf88-dd8c5be77d8c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:46.918836 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-59250f12-ddea-42a1-bf88-dd8c5be77d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '449bc78f66bc44919813905cc1682d29'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:46.920004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-59250f12-ddea-42a1-bf88-dd8c5be77d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '449bc78f66bc44919813905cc1682d29'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:46.920644 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-59250f12-ddea-42a1-bf88-dd8c5be77d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '449bc78f66bc44919813905cc1682d29'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:46.929427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-59250f12-ddea-42a1-bf88-dd8c5be77d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '449bc78f66bc44919813905cc1682d29'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:46.939819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-59250f12-ddea-42a1-bf88-dd8c5be77d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '449bc78f66bc44919813905cc1682d29'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:46.975556 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 964/1934] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:46 2022] DELETE /identity/v3/users/449bc78f66bc44919813905cc1682d29 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:46.980348 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807b2cc-a2a2-4f40-a89f-14381903dd68 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:46.980918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807b2cc-a2a2-4f40-a89f-14381903dd68 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:46.981469 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807b2cc-a2a2-4f40-a89f-14381903dd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:47.004237 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4807b2cc-a2a2-4f40-a89f-14381903dd68 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:47.005515 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4807b2cc-a2a2-4f40-a89f-14381903dd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:47.089914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:47.116148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 971/1935] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:47.142939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59250f12-ddea-42a1-bf88-dd8c5be77d8c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:47.144528 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-59250f12-ddea-42a1-bf88-dd8c5be77d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:47.208058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59250f12-ddea-42a1-bf88-dd8c5be77d8c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:47.213283 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdb509-ddb3-4c54-aa8a-71e3ccdaa103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:47.214335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdb509-ddb3-4c54-aa8a-71e3ccdaa103 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:47.214553 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdb509-ddb3-4c54-aa8a-71e3ccdaa103 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:47.214798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdb509-ddb3-4c54-aa8a-71e3ccdaa103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:47.226939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bdb509-ddb3-4c54-aa8a-71e3ccdaa103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:47.228590 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bdb509-ddb3-4c54-aa8a-71e3ccdaa103 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:47.239897 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 965/1936] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:47.341752 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807b2cc-a2a2-4f40-a89f-14381903dd68 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:47.343906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4807b2cc-a2a2-4f40-a89f-14381903dd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:47.358815 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807b2cc-a2a2-4f40-a89f-14381903dd68 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:47.363867 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e329f-ad2b-4247-beeb-0ae131a92fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:47.364486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e329f-ad2b-4247-beeb-0ae131a92fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:47.364924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e329f-ad2b-4247-beeb-0ae131a92fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:47.365161 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e329f-ad2b-4247-beeb-0ae131a92fe6 admin admin] PATH_INFO: `/v3/projects/16c15289112649eebf22dd8bfb770313` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:47.367816 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e329f-ad2b-4247-beeb-0ae131a92fe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16c15289112649eebf22dd8bfb770313)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:47.369977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e329f-ad2b-4247-beeb-0ae131a92fe6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:47.450165 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-836e329f-ad2b-4247-beeb-0ae131a92fe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16c15289112649eebf22dd8bfb770313', 'request_id': 'req-836e329f-ad2b-4247-beeb-0ae131a92fe6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:47.458622 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-836e329f-ad2b-4247-beeb-0ae131a92fe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16c15289112649eebf22dd8bfb770313', 'request_id': 'req-836e329f-ad2b-4247-beeb-0ae131a92fe6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:47.467910 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-836e329f-ad2b-4247-beeb-0ae131a92fe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16c15289112649eebf22dd8bfb770313', 'request_id': 'req-836e329f-ad2b-4247-beeb-0ae131a92fe6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:47.487717 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-836e329f-ad2b-4247-beeb-0ae131a92fe6 admin admin] The token cache is being invalidate because project 16c15289112649eebf22dd8bfb770313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:47.488083 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-836e329f-ad2b-4247-beeb-0ae131a92fe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:47.489351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-836e329f-ad2b-4247-beeb-0ae131a92fe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:47.491744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 972/1937] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:47 2022] DELETE /identity/v3/projects/16c15289112649eebf22dd8bfb770313 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:47.496325 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1280d1-c6a6-45bd-a6e5-4681627c1c86 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:47.496614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1280d1-c6a6-45bd-a6e5-4681627c1c86 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:47.497284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1280d1-c6a6-45bd-a6e5-4681627c1c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:47.531703 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3b1280d1-c6a6-45bd-a6e5-4681627c1c86 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:47.531703 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3b1280d1-c6a6-45bd-a6e5-4681627c1c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:47.612200 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:47.666846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 966/1938] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:47.668592 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7e006-4258-488b-9ddb-efff3b001edd None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:47.669329 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7e006-4258-488b-9ddb-efff3b001edd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:47.669610 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7e006-4258-488b-9ddb-efff3b001edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:47.720395 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-dcd7e006-4258-488b-9ddb-efff3b001edd None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:47.722848 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-dcd7e006-4258-488b-9ddb-efff3b001edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:47.733348 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 973/1939] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:47.737854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1280d1-c6a6-45bd-a6e5-4681627c1c86 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:47.750929 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1280d1-c6a6-45bd-a6e5-4681627c1c86 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:47.756217 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223621e-3a95-4f9a-972b-f5978c1919d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:47.757100 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223621e-3a95-4f9a-972b-f5978c1919d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:47.757568 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223621e-3a95-4f9a-972b-f5978c1919d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:47.757913 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223621e-3a95-4f9a-972b-f5978c1919d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:47.758643 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223621e-3a95-4f9a-972b-f5978c1919d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:09:47.759014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223621e-3a95-4f9a-972b-f5978c1919d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:47.760753 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223621e-3a95-4f9a-972b-f5978c1919d9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:47.774333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 967/1940] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:09:47.779664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7e006-4258-488b-9ddb-efff3b001edd None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:47.793750 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7e006-4258-488b-9ddb-efff3b001edd None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:47.798676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b32282-73ff-4aa5-9821-8eed41097461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:47.799327 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b32282-73ff-4aa5-9821-8eed41097461 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:47.799709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b32282-73ff-4aa5-9821-8eed41097461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:47.799863 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b32282-73ff-4aa5-9821-8eed41097461 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:47.800598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b32282-73ff-4aa5-9821-8eed41097461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:47.802542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b32282-73ff-4aa5-9821-8eed41097461 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:47.837810 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 974/1941] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:47 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:47.842272 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223621e-3a95-4f9a-972b-f5978c1919d9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:47.854358 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223621e-3a95-4f9a-972b-f5978c1919d9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:47.938884 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33c28a-ebfe-4db9-89aa-81fd1e703be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:47.940639 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33c28a-ebfe-4db9-89aa-81fd1e703be5 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:47.941299 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33c28a-ebfe-4db9-89aa-81fd1e703be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:47.941400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33c28a-ebfe-4db9-89aa-81fd1e703be5 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:47.942075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33c28a-ebfe-4db9-89aa-81fd1e703be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:47.945690 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33c28a-ebfe-4db9-89aa-81fd1e703be5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:47.983324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 968/1942] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:47 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:09:47.984626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b32282-73ff-4aa5-9821-8eed41097461 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:48.001206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b32282-73ff-4aa5-9821-8eed41097461 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:48.008811 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3e492-4449-44b5-82dc-7bc545651135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:48.009930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e492-4449-44b5-82dc-7bc545651135 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:48.010215 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e492-4449-44b5-82dc-7bc545651135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:48.010572 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e492-4449-44b5-82dc-7bc545651135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:48.011297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b3e492-4449-44b5-82dc-7bc545651135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:48.013147 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33c28a-ebfe-4db9-89aa-81fd1e703be5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:48.014857 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8a33c28a-ebfe-4db9-89aa-81fd1e703be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:48.024655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b3e492-4449-44b5-82dc-7bc545651135 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:48.040172 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33c28a-ebfe-4db9-89aa-81fd1e703be5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:48.048216 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 975/1943] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:48.049388 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3e492-4449-44b5-82dc-7bc545651135 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:48.061820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba69b58-1199-4ad8-86b7-9c707b611787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:48.065171 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba69b58-1199-4ad8-86b7-9c707b611787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:48.065825 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba69b58-1199-4ad8-86b7-9c707b611787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:48.066366 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba69b58-1199-4ad8-86b7-9c707b611787 admin admin] PATH_INFO: `/v3/projects/d4a076c028c5491f85880f72714524f5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:48.066539 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3e492-4449-44b5-82dc-7bc545651135 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:48.068674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba69b58-1199-4ad8-86b7-9c707b611787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4a076c028c5491f85880f72714524f5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:48.073086 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba69b58-1199-4ad8-86b7-9c707b611787 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:48.081931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a11b8-b5ef-489a-9c88-12823ba2c303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:48.082463 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a11b8-b5ef-489a-9c88-12823ba2c303 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:48.082744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a11b8-b5ef-489a-9c88-12823ba2c303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:48.083006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a11b8-b5ef-489a-9c88-12823ba2c303 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:48.083703 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a11b8-b5ef-489a-9c88-12823ba2c303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:48.089919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a11b8-b5ef-489a-9c88-12823ba2c303 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:48.114079 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 976/1944] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:48.114973 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a11b8-b5ef-489a-9c88-12823ba2c303 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:48.169530 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a11b8-b5ef-489a-9c88-12823ba2c303 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:48.177114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22461570-9b9b-4a6c-934c-6e1d20f08bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:48.178055 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22461570-9b9b-4a6c-934c-6e1d20f08bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:48.178551 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22461570-9b9b-4a6c-934c-6e1d20f08bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:48.179585 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22461570-9b9b-4a6c-934c-6e1d20f08bd5 admin admin] PATH_INFO: `/v3/projects/1a0ac453f51a4324992ed6956b2bbd4e/users/fcf306f6bb954a6d89895246f5349ef3/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:48.196811 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7ba69b58-1199-4ad8-86b7-9c707b611787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4a076c028c5491f85880f72714524f5', 'request_id': 'req-7ba69b58-1199-4ad8-86b7-9c707b611787'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:48.197786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22461570-9b9b-4a6c-934c-6e1d20f08bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a0ac453f51a4324992ed6956b2bbd4e, user_id=fcf306f6bb954a6d89895246f5349ef3, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:48.201497 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22461570-9b9b-4a6c-934c-6e1d20f08bd5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:48.210409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7ba69b58-1199-4ad8-86b7-9c707b611787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4a076c028c5491f85880f72714524f5', 'request_id': 'req-7ba69b58-1199-4ad8-86b7-9c707b611787'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:48.215721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7ba69b58-1199-4ad8-86b7-9c707b611787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4a076c028c5491f85880f72714524f5', 'request_id': 'req-7ba69b58-1199-4ad8-86b7-9c707b611787'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:48.226195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 977/1945] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:48 2022] PUT /identity/v3/projects/1a0ac453f51a4324992ed6956b2bbd4e/users/fcf306f6bb954a6d89895246f5349ef3/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:48.227208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22461570-9b9b-4a6c-934c-6e1d20f08bd5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:48.231437 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7ba69b58-1199-4ad8-86b7-9c707b611787 admin admin] The token cache is being invalidate because project d4a076c028c5491f85880f72714524f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:48.231972 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7ba69b58-1199-4ad8-86b7-9c707b611787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:48.232881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7ba69b58-1199-4ad8-86b7-9c707b611787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:48.234846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 969/1946] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:48 2022] DELETE /identity/v3/projects/d4a076c028c5491f85880f72714524f5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:48.237142 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-22461570-9b9b-4a6c-934c-6e1d20f08bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:48.237818 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3c00c-64ac-43ce-af3f-b6b9cf23c0e1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:48.238106 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3c00c-64ac-43ce-af3f-b6b9cf23c0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:48.238386 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3c00c-64ac-43ce-af3f-b6b9cf23c0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:48.289417 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5eb3c00c-64ac-43ce-af3f-b6b9cf23c0e1 None None] MFA Rules not processed for user `fcf306f6bb954a6d89895246f5349ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:48.290948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5eb3c00c-64ac-43ce-af3f-b6b9cf23c0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:48.329384 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22461570-9b9b-4a6c-934c-6e1d20f08bd5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:48.337896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:48.339150 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e704066-2ef1-48fe-bfd9-825f141d4a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:48.340342 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e704066-2ef1-48fe-bfd9-825f141d4a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:48.340761 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e704066-2ef1-48fe-bfd9-825f141d4a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:48.341006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e704066-2ef1-48fe-bfd9-825f141d4a83 admin admin] PATH_INFO: `/v3/users/75e48fa385cf47af8f758174b2ea8593` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:48.342680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e704066-2ef1-48fe-bfd9-825f141d4a83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75e48fa385cf47af8f758174b2ea8593)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:48.344957 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e704066-2ef1-48fe-bfd9-825f141d4a83 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:48.348310 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:48.379972 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 970/1947] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:48.381120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3c00c-64ac-43ce-af3f-b6b9cf23c0e1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:48.383469 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5eb3c00c-64ac-43ce-af3f-b6b9cf23c0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:48.398930 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3c00c-64ac-43ce-af3f-b6b9cf23c0e1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:48.403638 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1e704066-2ef1-48fe-bfd9-825f141d4a83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75e48fa385cf47af8f758174b2ea8593'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:48.404399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe6cd0-aa3f-4374-8100-96829a7d670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:48.405133 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe6cd0-aa3f-4374-8100-96829a7d670a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:48.405480 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe6cd0-aa3f-4374-8100-96829a7d670a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:48.405828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe6cd0-aa3f-4374-8100-96829a7d670a admin admin] PATH_INFO: `/v3/users/e4fa9167f9fd424881cad73a99ca6abb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:48.407036 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe6cd0-aa3f-4374-8100-96829a7d670a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4fa9167f9fd424881cad73a99ca6abb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:48.409013 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe6cd0-aa3f-4374-8100-96829a7d670a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:48.413100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1e704066-2ef1-48fe-bfd9-825f141d4a83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75e48fa385cf47af8f758174b2ea8593'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:48.414443 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1e704066-2ef1-48fe-bfd9-825f141d4a83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75e48fa385cf47af8f758174b2ea8593'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:48.430714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1e704066-2ef1-48fe-bfd9-825f141d4a83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75e48fa385cf47af8f758174b2ea8593'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:48.441284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1e704066-2ef1-48fe-bfd9-825f141d4a83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75e48fa385cf47af8f758174b2ea8593'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:48.450167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 978/1948] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:48 2022] DELETE /identity/v3/users/75e48fa385cf47af8f758174b2ea8593 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:48.450833 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e704066-2ef1-48fe-bfd9-825f141d4a83 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:48.452600 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1e704066-2ef1-48fe-bfd9-825f141d4a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:48.464455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-80fe6cd0-aa3f-4374-8100-96829a7d670a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4fa9167f9fd424881cad73a99ca6abb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:48.465296 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-80fe6cd0-aa3f-4374-8100-96829a7d670a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4fa9167f9fd424881cad73a99ca6abb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:48.466062 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-80fe6cd0-aa3f-4374-8100-96829a7d670a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4fa9167f9fd424881cad73a99ca6abb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:48.474539 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-80fe6cd0-aa3f-4374-8100-96829a7d670a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4fa9167f9fd424881cad73a99ca6abb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:48.482283 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-80fe6cd0-aa3f-4374-8100-96829a7d670a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4fa9167f9fd424881cad73a99ca6abb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:48.500816 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 971/1949] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:48 2022] DELETE /identity/v3/users/e4fa9167f9fd424881cad73a99ca6abb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:48.502154 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2244e-6e91-4098-9091-be2ab4351e72 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:48.502779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2244e-6e91-4098-9091-be2ab4351e72 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:48.503065 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2244e-6e91-4098-9091-be2ab4351e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:48.519790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e704066-2ef1-48fe-bfd9-825f141d4a83 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:48.524249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-11e2244e-6e91-4098-9091-be2ab4351e72 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:48.525656 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-11e2244e-6e91-4098-9091-be2ab4351e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:48.590593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2defc-771a-45a6-a70d-a3f6cff72d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:48.591419 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2defc-771a-45a6-a70d-a3f6cff72d17 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:48.591778 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2defc-771a-45a6-a70d-a3f6cff72d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:48.592113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2defc-771a-45a6-a70d-a3f6cff72d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:48.592850 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2defc-771a-45a6-a70d-a3f6cff72d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:48.594901 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2defc-771a-45a6-a70d-a3f6cff72d17 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:48.602681 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 972/1950] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:48.613964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2244e-6e91-4098-9091-be2ab4351e72 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:48.615961 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-11e2244e-6e91-4098-9091-be2ab4351e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:48.640325 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 979/1951] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:48 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:48.642913 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2defc-771a-45a6-a70d-a3f6cff72d17 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:48.644880 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-abe2defc-771a-45a6-a70d-a3f6cff72d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:48.660788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:48.682557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:48.688298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2244e-6e91-4098-9091-be2ab4351e72 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:48.758182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f51a5-eebd-47ea-b0f3-2ff9ad403a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:48.758957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f51a5-eebd-47ea-b0f3-2ff9ad403a9d service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:48.759285 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f51a5-eebd-47ea-b0f3-2ff9ad403a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:48.759559 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f51a5-eebd-47ea-b0f3-2ff9ad403a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:48.768718 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2defc-771a-45a6-a70d-a3f6cff72d17 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:48.769212 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f51a5-eebd-47ea-b0f3-2ff9ad403a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:48.771318 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f51a5-eebd-47ea-b0f3-2ff9ad403a9d service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:48.774908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cafee7-39e8-4318-86cd-1c567a8f6c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:48.776259 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cafee7-39e8-4318-86cd-1c567a8f6c9c admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:48.776680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cafee7-39e8-4318-86cd-1c567a8f6c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:48.776963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cafee7-39e8-4318-86cd-1c567a8f6c9c admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:48.777724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cafee7-39e8-4318-86cd-1c567a8f6c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:48.779689 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cafee7-39e8-4318-86cd-1c567a8f6c9c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:48.783165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 973/1952] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:48.805846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 980/1953] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:48 2022] POST /identity/v3/users => generated 300 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:48.807008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f51a5-eebd-47ea-b0f3-2ff9ad403a9d service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:48.816281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f51a5-eebd-47ea-b0f3-2ff9ad403a9d service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:48.821916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58549f-00a4-4e51-979e-a628826f9516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:48.822598 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58549f-00a4-4e51-979e-a628826f9516 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:48.822949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58549f-00a4-4e51-979e-a628826f9516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:48.823319 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58549f-00a4-4e51-979e-a628826f9516 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:48.824088 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58549f-00a4-4e51-979e-a628826f9516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:48.826025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58549f-00a4-4e51-979e-a628826f9516 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:48.837578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 974/1954] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:48.841350 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cafee7-39e8-4318-86cd-1c567a8f6c9c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:48.851715 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cafee7-39e8-4318-86cd-1c567a8f6c9c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:48.856410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292242a-6c00-4223-b288-1a3e7a6be913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:48.857007 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292242a-6c00-4223-b288-1a3e7a6be913 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:48.857284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292242a-6c00-4223-b288-1a3e7a6be913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:48.857558 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292242a-6c00-4223-b288-1a3e7a6be913 admin admin] PATH_INFO: `/v3/projects/4411b320c81346b586f945c3de5a44af/users/306e84a232dc4c34ab18cb9c67720372/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:48.874812 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292242a-6c00-4223-b288-1a3e7a6be913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4411b320c81346b586f945c3de5a44af, user_id=306e84a232dc4c34ab18cb9c67720372, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:48.878398 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292242a-6c00-4223-b288-1a3e7a6be913 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:48.893032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 981/1955] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:48 2022] PUT /identity/v3/projects/4411b320c81346b586f945c3de5a44af/users/306e84a232dc4c34ab18cb9c67720372/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:09:48.897141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58549f-00a4-4e51-979e-a628826f9516 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:48.908356 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58549f-00a4-4e51-979e-a628826f9516 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:48.939247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292242a-6c00-4223-b288-1a3e7a6be913 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:48.941730 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2292242a-6c00-4223-b288-1a3e7a6be913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:48.997190 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125edf14-ff5f-469c-907d-25546b90544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:48.997913 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125edf14-ff5f-469c-907d-25546b90544d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:48.998162 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125edf14-ff5f-469c-907d-25546b90544d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:48.998440 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125edf14-ff5f-469c-907d-25546b90544d admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:48.999112 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125edf14-ff5f-469c-907d-25546b90544d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:49.002920 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125edf14-ff5f-469c-907d-25546b90544d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:49.042123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 975/1956] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:49.047202 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125edf14-ff5f-469c-907d-25546b90544d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:49.048199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292242a-6c00-4223-b288-1a3e7a6be913 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:49.053716 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476bc11-86ca-4037-aa66-8f930f82fbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:49.055014 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476bc11-86ca-4037-aa66-8f930f82fbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:49.055014 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476bc11-86ca-4037-aa66-8f930f82fbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:49.055328 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476bc11-86ca-4037-aa66-8f930f82fbef admin admin] PATH_INFO: `/v3/projects/b3a63cf1a1e545a8a74462b72e3982ac` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:49.057560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476bc11-86ca-4037-aa66-8f930f82fbef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3a63cf1a1e545a8a74462b72e3982ac)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:49.059333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125edf14-ff5f-469c-907d-25546b90544d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:49.059976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476bc11-86ca-4037-aa66-8f930f82fbef admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:49.066146 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16bca1-c20d-4b80-8340-3934134d7298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:49.067168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16bca1-c20d-4b80-8340-3934134d7298 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:49.067687 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16bca1-c20d-4b80-8340-3934134d7298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:49.068169 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16bca1-c20d-4b80-8340-3934134d7298 admin admin] PATH_INFO: `/v3/projects/4411b320c81346b586f945c3de5a44af/users/306e84a232dc4c34ab18cb9c67720372/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:49.071007 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16bca1-c20d-4b80-8340-3934134d7298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4411b320c81346b586f945c3de5a44af, user_id=306e84a232dc4c34ab18cb9c67720372, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:49.074406 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16bca1-c20d-4b80-8340-3934134d7298 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:49.115427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 976/1957] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:49 2022] PUT /identity/v3/projects/4411b320c81346b586f945c3de5a44af/users/306e84a232dc4c34ab18cb9c67720372/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:09:49.117460 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e6474-de1b-495f-ad80-20d28a426409 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:49.117842 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e6474-de1b-495f-ad80-20d28a426409 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:49.118122 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e6474-de1b-495f-ad80-20d28a426409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:49.126022 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6476bc11-86ca-4037-aa66-8f930f82fbef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3a63cf1a1e545a8a74462b72e3982ac', 'request_id': 'req-6476bc11-86ca-4037-aa66-8f930f82fbef'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:49.134826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6476bc11-86ca-4037-aa66-8f930f82fbef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3a63cf1a1e545a8a74462b72e3982ac', 'request_id': 'req-6476bc11-86ca-4037-aa66-8f930f82fbef'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:49.143124 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6476bc11-86ca-4037-aa66-8f930f82fbef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3a63cf1a1e545a8a74462b72e3982ac', 'request_id': 'req-6476bc11-86ca-4037-aa66-8f930f82fbef'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:49.151277 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-241e6474-de1b-495f-ad80-20d28a426409 None None] MFA Rules not processed for user `306e84a232dc4c34ab18cb9c67720372`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:49.152662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-241e6474-de1b-495f-ad80-20d28a426409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:49.176026 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6476bc11-86ca-4037-aa66-8f930f82fbef admin admin] The token cache is being invalidate because project b3a63cf1a1e545a8a74462b72e3982ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:49.177770 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6476bc11-86ca-4037-aa66-8f930f82fbef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:49.180294 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6476bc11-86ca-4037-aa66-8f930f82fbef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:49.185861 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 982/1958] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:48 2022] DELETE /identity/v3/projects/b3a63cf1a1e545a8a74462b72e3982ac => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:49.191324 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396e071-4b0f-4850-8ff2-5768d4d46c2b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:49.191989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396e071-4b0f-4850-8ff2-5768d4d46c2b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:49.192419 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396e071-4b0f-4850-8ff2-5768d4d46c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:49.233820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3396e071-4b0f-4850-8ff2-5768d4d46c2b None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:49.235292 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3396e071-4b0f-4850-8ff2-5768d4d46c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:49.242206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:49.257637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 977/1959] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:49 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:49.271310 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e6474-de1b-495f-ad80-20d28a426409 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:49.273839 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-241e6474-de1b-495f-ad80-20d28a426409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:49.281443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:49.334493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 983/1960] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:49.336284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396e071-4b0f-4850-8ff2-5768d4d46c2b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:49.338722 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3396e071-4b0f-4850-8ff2-5768d4d46c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:49.357718 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396e071-4b0f-4850-8ff2-5768d4d46c2b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:49.370175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e6474-de1b-495f-ad80-20d28a426409 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:49.372082 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d86b6-45d2-4653-8393-e978cfdb0e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:49.373465 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d86b6-45d2-4653-8393-e978cfdb0e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:49.375306 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d86b6-45d2-4653-8393-e978cfdb0e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:49.375498 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631cc0f-dff5-43b5-a6f5-f49f6a38f5c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:49.376445 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631cc0f-dff5-43b5-a6f5-f49f6a38f5c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:49.376703 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d86b6-45d2-4653-8393-e978cfdb0e16 admin admin] PATH_INFO: `/v3/projects/d52184f9795e41a98c922c601b1d0fe6` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:49.376804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631cc0f-dff5-43b5-a6f5-f49f6a38f5c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:49.377000 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631cc0f-dff5-43b5-a6f5-f49f6a38f5c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:49.378844 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d86b6-45d2-4653-8393-e978cfdb0e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52184f9795e41a98c922c601b1d0fe6)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:49.382940 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d86b6-45d2-4653-8393-e978cfdb0e16 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:49.398150 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631cc0f-dff5-43b5-a6f5-f49f6a38f5c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:49.400012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631cc0f-dff5-43b5-a6f5-f49f6a38f5c8 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:49.411941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 978/1961] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:49 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:09:49.411941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f12eda-b7a4-461f-8bb4-f13c0f777fb0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:49.412178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f12eda-b7a4-461f-8bb4-f13c0f777fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:49.412448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f12eda-b7a4-461f-8bb4-f13c0f777fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:49.435612 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-56f12eda-b7a4-461f-8bb4-f13c0f777fb0 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:49.437688 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-56f12eda-b7a4-461f-8bb4-f13c0f777fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:49.440280 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-203d86b6-45d2-4653-8393-e978cfdb0e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52184f9795e41a98c922c601b1d0fe6', 'request_id': 'req-203d86b6-45d2-4653-8393-e978cfdb0e16'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:49.458801 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-203d86b6-45d2-4653-8393-e978cfdb0e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52184f9795e41a98c922c601b1d0fe6', 'request_id': 'req-203d86b6-45d2-4653-8393-e978cfdb0e16'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:49.466464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-203d86b6-45d2-4653-8393-e978cfdb0e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52184f9795e41a98c922c601b1d0fe6', 'request_id': 'req-203d86b6-45d2-4653-8393-e978cfdb0e16'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:49.510157 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-203d86b6-45d2-4653-8393-e978cfdb0e16 admin admin] The token cache is being invalidate because project d52184f9795e41a98c922c601b1d0fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:49.510634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-203d86b6-45d2-4653-8393-e978cfdb0e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:49.513140 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-203d86b6-45d2-4653-8393-e978cfdb0e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:49.516920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 984/1962] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:49 2022] DELETE /identity/v3/projects/d52184f9795e41a98c922c601b1d0fe6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:49.528810 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d86b6-45d2-4653-8393-e978cfdb0e16 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:49.533717 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-203d86b6-45d2-4653-8393-e978cfdb0e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:49.602274 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 979/1963] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:49.606694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f12eda-b7a4-461f-8bb4-f13c0f777fb0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:49.633200 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f12eda-b7a4-461f-8bb4-f13c0f777fb0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:49.646790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241548a-ace0-4ebc-b849-cf71aaa3c6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:49.648356 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241548a-ace0-4ebc-b849-cf71aaa3c6fb admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:49.649154 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241548a-ace0-4ebc-b849-cf71aaa3c6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:49.649451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241548a-ace0-4ebc-b849-cf71aaa3c6fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:49.650250 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241548a-ace0-4ebc-b849-cf71aaa3c6fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:09:49.650604 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241548a-ace0-4ebc-b849-cf71aaa3c6fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:49.652332 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241548a-ace0-4ebc-b849-cf71aaa3c6fb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:49.681211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 980/1964] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:09:49.682116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241548a-ace0-4ebc-b849-cf71aaa3c6fb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:49.685506 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d86b6-45d2-4653-8393-e978cfdb0e16 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:49.698644 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241548a-ace0-4ebc-b849-cf71aaa3c6fb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:49.702051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74941a9d-a885-470e-bd6b-5dd00d7eb45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:49.702710 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941a9d-a885-470e-bd6b-5dd00d7eb45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:49.702998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941a9d-a885-470e-bd6b-5dd00d7eb45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:49.703283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941a9d-a885-470e-bd6b-5dd00d7eb45e admin admin] PATH_INFO: `/v3/users/a1ee9514488147da8bd20f39cb75eb0b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:49.704741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74941a9d-a885-470e-bd6b-5dd00d7eb45e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ee9514488147da8bd20f39cb75eb0b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:49.707714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74941a9d-a885-470e-bd6b-5dd00d7eb45e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:49.716613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d3da2-ee05-46ff-9bdd-41a92f3f7dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:49.717315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d3da2-ee05-46ff-9bdd-41a92f3f7dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:49.717662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d3da2-ee05-46ff-9bdd-41a92f3f7dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:49.718035 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d3da2-ee05-46ff-9bdd-41a92f3f7dd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:49.718739 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d3da2-ee05-46ff-9bdd-41a92f3f7dd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:49.720978 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d3da2-ee05-46ff-9bdd-41a92f3f7dd2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:49.764052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 981/1965] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:49 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:49.768508 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d3da2-ee05-46ff-9bdd-41a92f3f7dd2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:49.772079 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:49.815904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-74941a9d-a885-470e-bd6b-5dd00d7eb45e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ee9514488147da8bd20f39cb75eb0b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:49.830006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-74941a9d-a885-470e-bd6b-5dd00d7eb45e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ee9514488147da8bd20f39cb75eb0b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:49.831253 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-74941a9d-a885-470e-bd6b-5dd00d7eb45e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ee9514488147da8bd20f39cb75eb0b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:49.849406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-74941a9d-a885-470e-bd6b-5dd00d7eb45e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ee9514488147da8bd20f39cb75eb0b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:49.859592 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-74941a9d-a885-470e-bd6b-5dd00d7eb45e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ee9514488147da8bd20f39cb75eb0b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:49.860437 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d3da2-ee05-46ff-9bdd-41a92f3f7dd2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:49.865664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 985/1966] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:49 2022] DELETE /identity/v3/users/a1ee9514488147da8bd20f39cb75eb0b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:09:49.868458 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2bd56-8610-40b7-9ab8-e33cfed3e468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:49.869094 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2bd56-8610-40b7-9ab8-e33cfed3e468 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:49.869497 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2bd56-8610-40b7-9ab8-e33cfed3e468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:49.869871 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2bd56-8610-40b7-9ab8-e33cfed3e468 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:49.870646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2bd56-8610-40b7-9ab8-e33cfed3e468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:49.872871 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2bd56-8610-40b7-9ab8-e33cfed3e468 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:49.900121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 982/1967] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:49 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:49.904581 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74941a9d-a885-470e-bd6b-5dd00d7eb45e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:49.906171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-74941a9d-a885-470e-bd6b-5dd00d7eb45e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:49.994094 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74941a9d-a885-470e-bd6b-5dd00d7eb45e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:50.000007 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27171ac-f952-44bc-a9ba-57068339eaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:50.000335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27171ac-f952-44bc-a9ba-57068339eaec admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:50.000509 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27171ac-f952-44bc-a9ba-57068339eaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:50.000983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27171ac-f952-44bc-a9ba-57068339eaec admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:50.001642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27171ac-f952-44bc-a9ba-57068339eaec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:50.003264 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27171ac-f952-44bc-a9ba-57068339eaec admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:50.016254 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 986/1968] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:50.020707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2bd56-8610-40b7-9ab8-e33cfed3e468 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:50.027901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:50.034039 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2bd56-8610-40b7-9ab8-e33cfed3e468 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:50.040647 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ceb4c-5067-4a3c-bf55-4f02ddd014b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:50.041290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ceb4c-5067-4a3c-bf55-4f02ddd014b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:50.041565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ceb4c-5067-4a3c-bf55-4f02ddd014b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:50.041834 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ceb4c-5067-4a3c-bf55-4f02ddd014b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:50.042539 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ceb4c-5067-4a3c-bf55-4f02ddd014b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:50.044432 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ceb4c-5067-4a3c-bf55-4f02ddd014b9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:50.063218 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 983/1969] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:50.065689 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27171ac-f952-44bc-a9ba-57068339eaec admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:50.077821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27171ac-f952-44bc-a9ba-57068339eaec admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:50.089367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30356b7-338e-4e0e-a77e-fcc42884d817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:50.091712 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30356b7-338e-4e0e-a77e-fcc42884d817 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:50.092000 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30356b7-338e-4e0e-a77e-fcc42884d817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:50.092280 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30356b7-338e-4e0e-a77e-fcc42884d817 admin admin] PATH_INFO: `/v3/projects/a509860d647e4672aea395738e47a19f/users/d851c46a6faa426ea70e17a084f79d5e/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:50.110768 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30356b7-338e-4e0e-a77e-fcc42884d817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a509860d647e4672aea395738e47a19f, user_id=d851c46a6faa426ea70e17a084f79d5e, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:50.114685 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30356b7-338e-4e0e-a77e-fcc42884d817 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:50.140626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 987/1970] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:50 2022] PUT /identity/v3/projects/a509860d647e4672aea395738e47a19f/users/d851c46a6faa426ea70e17a084f79d5e/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:50.143274 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d9805-f301-4981-a0dc-e78a4b3f65f4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:50.143701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d9805-f301-4981-a0dc-e78a4b3f65f4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:50.144471 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d9805-f301-4981-a0dc-e78a4b3f65f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:50.184281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b21d9805-f301-4981-a0dc-e78a4b3f65f4 None None] MFA Rules not processed for user `d851c46a6faa426ea70e17a084f79d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:50.185782 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b21d9805-f301-4981-a0dc-e78a4b3f65f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:50.282337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 984/1971] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:50.287214 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30356b7-338e-4e0e-a77e-fcc42884d817 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:50.305222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d9805-f301-4981-a0dc-e78a4b3f65f4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:50.306724 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b21d9805-f301-4981-a0dc-e78a4b3f65f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:50.394189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30356b7-338e-4e0e-a77e-fcc42884d817 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:50.400376 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fbb4d-f5fe-44c4-8c47-369d58340f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:50.400998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fbb4d-f5fe-44c4-8c47-369d58340f18 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:50.401276 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fbb4d-f5fe-44c4-8c47-369d58340f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:50.401762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fbb4d-f5fe-44c4-8c47-369d58340f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:50.402560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fbb4d-f5fe-44c4-8c47-369d58340f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:50.404466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fbb4d-f5fe-44c4-8c47-369d58340f18 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:50.415937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d9805-f301-4981-a0dc-e78a4b3f65f4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:50.421149 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080ddbc-9d1f-41c3-8a97-a2e2ac9f5973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:50.422175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080ddbc-9d1f-41c3-8a97-a2e2ac9f5973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:50.422556 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080ddbc-9d1f-41c3-8a97-a2e2ac9f5973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:50.423218 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080ddbc-9d1f-41c3-8a97-a2e2ac9f5973 admin admin] PATH_INFO: `/v3/users/fcf306f6bb954a6d89895246f5349ef3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:50.425260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080ddbc-9d1f-41c3-8a97-a2e2ac9f5973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcf306f6bb954a6d89895246f5349ef3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:50.427834 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080ddbc-9d1f-41c3-8a97-a2e2ac9f5973 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:50.443248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 988/1972] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:50 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:09:50.446532 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fbb4d-f5fe-44c4-8c47-369d58340f18 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:50.448505 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2e0fbb4d-f5fe-44c4-8c47-369d58340f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:50.469438 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:50.502842 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f080ddbc-9d1f-41c3-8a97-a2e2ac9f5973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcf306f6bb954a6d89895246f5349ef3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:50.503732 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f080ddbc-9d1f-41c3-8a97-a2e2ac9f5973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcf306f6bb954a6d89895246f5349ef3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:50.504612 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f080ddbc-9d1f-41c3-8a97-a2e2ac9f5973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcf306f6bb954a6d89895246f5349ef3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:50.514609 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f080ddbc-9d1f-41c3-8a97-a2e2ac9f5973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcf306f6bb954a6d89895246f5349ef3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:50.519548 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fbb4d-f5fe-44c4-8c47-369d58340f18 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:50.525584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e679321-efe5-466c-aee7-9553ef8f2704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:50.526237 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e679321-efe5-466c-aee7-9553ef8f2704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:50.526512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e679321-efe5-466c-aee7-9553ef8f2704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:50.526785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e679321-efe5-466c-aee7-9553ef8f2704 admin admin] PATH_INFO: `/v3/projects/30613b786c764c9295ecd05ca8d458d5` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:50.527068 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f080ddbc-9d1f-41c3-8a97-a2e2ac9f5973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcf306f6bb954a6d89895246f5349ef3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:50.527965 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e679321-efe5-466c-aee7-9553ef8f2704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30613b786c764c9295ecd05ca8d458d5)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:50.529853 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e679321-efe5-466c-aee7-9553ef8f2704 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:50.546703 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:50.554383 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 985/1973] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:50 2022] DELETE /identity/v3/users/fcf306f6bb954a6d89895246f5349ef3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:50.555949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080ddbc-9d1f-41c3-8a97-a2e2ac9f5973 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:50.559335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f080ddbc-9d1f-41c3-8a97-a2e2ac9f5973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:50.589198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4e679321-efe5-466c-aee7-9553ef8f2704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30613b786c764c9295ecd05ca8d458d5', 'request_id': 'req-4e679321-efe5-466c-aee7-9553ef8f2704'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:50.595654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4e679321-efe5-466c-aee7-9553ef8f2704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30613b786c764c9295ecd05ca8d458d5', 'request_id': 'req-4e679321-efe5-466c-aee7-9553ef8f2704'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:50.609932 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4e679321-efe5-466c-aee7-9553ef8f2704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30613b786c764c9295ecd05ca8d458d5', 'request_id': 'req-4e679321-efe5-466c-aee7-9553ef8f2704'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:50.624617 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4e679321-efe5-466c-aee7-9553ef8f2704 admin admin] The token cache is being invalidate because project 30613b786c764c9295ecd05ca8d458d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:50.625110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4e679321-efe5-466c-aee7-9553ef8f2704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:50.625793 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4e679321-efe5-466c-aee7-9553ef8f2704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:50.627395 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 989/1974] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:50 2022] DELETE /identity/v3/projects/30613b786c764c9295ecd05ca8d458d5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:50.631987 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097d3f7-a1eb-4177-a06a-db6ffc1f8051 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:50.632265 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097d3f7-a1eb-4177-a06a-db6ffc1f8051 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:50.632536 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097d3f7-a1eb-4177-a06a-db6ffc1f8051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:50.652498 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5097d3f7-a1eb-4177-a06a-db6ffc1f8051 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:50.653903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5097d3f7-a1eb-4177-a06a-db6ffc1f8051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:50.667455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080ddbc-9d1f-41c3-8a97-a2e2ac9f5973 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:50.731028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 990/1975] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:50.731028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2090e7-78ed-4e7c-95c3-84d827fa485e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:50.731028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2090e7-78ed-4e7c-95c3-84d827fa485e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:50.731028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2090e7-78ed-4e7c-95c3-84d827fa485e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:50.764105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6c2090e7-78ed-4e7c-95c3-84d827fa485e None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:50.766029 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6c2090e7-78ed-4e7c-95c3-84d827fa485e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:50.780427 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 991/1976] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:50.780427 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2090e7-78ed-4e7c-95c3-84d827fa485e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:50.780427 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6c2090e7-78ed-4e7c-95c3-84d827fa485e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:50.827721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56691b-05e2-401b-9b71-1b1451111a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:50.827917 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56691b-05e2-401b-9b71-1b1451111a1d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:50.828099 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56691b-05e2-401b-9b71-1b1451111a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:50.828344 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56691b-05e2-401b-9b71-1b1451111a1d admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:50.829063 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56691b-05e2-401b-9b71-1b1451111a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:50.832881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56691b-05e2-401b-9b71-1b1451111a1d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:50.895926 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 986/1977] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:50 2022] POST /identity/v3/users => generated 290 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:50.899803 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e74750-1fc5-4ddd-8d44-0f39296790df None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:50.900187 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e74750-1fc5-4ddd-8d44-0f39296790df None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:50.900468 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e74750-1fc5-4ddd-8d44-0f39296790df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:50.919459 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:50.945131 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-25e74750-1fc5-4ddd-8d44-0f39296790df None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:50.946790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-25e74750-1fc5-4ddd-8d44-0f39296790df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:50.956973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 987/1978] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:50.962872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e74750-1fc5-4ddd-8d44-0f39296790df None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:50.965990 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-25e74750-1fc5-4ddd-8d44-0f39296790df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:50.969498 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2090e7-78ed-4e7c-95c3-84d827fa485e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:50.973372 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afae24-73f9-487b-8b6a-ebbd0bee4fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:50.974038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afae24-73f9-487b-8b6a-ebbd0bee4fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:50.974512 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afae24-73f9-487b-8b6a-ebbd0bee4fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:50.974783 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afae24-73f9-487b-8b6a-ebbd0bee4fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:50.989026 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afae24-73f9-487b-8b6a-ebbd0bee4fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:50.990762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afae24-73f9-487b-8b6a-ebbd0bee4fd6 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:50.993470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e74750-1fc5-4ddd-8d44-0f39296790df None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:51.003331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 992/1979] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:51.011877 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eda1e-04e9-4993-9024-98fda9edb44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:51.013528 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eda1e-04e9-4993-9024-98fda9edb44f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:51.015344 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eda1e-04e9-4993-9024-98fda9edb44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:51.015632 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eda1e-04e9-4993-9024-98fda9edb44f admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:51.015800 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afae24-73f9-487b-8b6a-ebbd0bee4fd6 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:51.016357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124eda1e-04e9-4993-9024-98fda9edb44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:51.033854 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afae24-73f9-487b-8b6a-ebbd0bee4fd6 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:51.035685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124eda1e-04e9-4993-9024-98fda9edb44f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:51.052287 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f26616-4850-4c15-9545-01f3922dcfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:51.052921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f26616-4850-4c15-9545-01f3922dcfda admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:51.053269 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f26616-4850-4c15-9545-01f3922dcfda admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:51.053453 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f26616-4850-4c15-9545-01f3922dcfda admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:51.054711 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f26616-4850-4c15-9545-01f3922dcfda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:09:51.054711 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f26616-4850-4c15-9545-01f3922dcfda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:51.062310 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f26616-4850-4c15-9545-01f3922dcfda admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:51.071051 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 988/1980] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:51.072153 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eda1e-04e9-4993-9024-98fda9edb44f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:51.096614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eda1e-04e9-4993-9024-98fda9edb44f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:51.098997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 993/1981] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:09:51.100241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f26616-4850-4c15-9545-01f3922dcfda admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:51.106073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a6f26616-4850-4c15-9545-01f3922dcfda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:51.119967 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28073ba-fd15-4674-8360-e7bfc4d53c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:51.120605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28073ba-fd15-4674-8360-e7bfc4d53c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:51.120886 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28073ba-fd15-4674-8360-e7bfc4d53c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:51.121159 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28073ba-fd15-4674-8360-e7bfc4d53c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:51.121813 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28073ba-fd15-4674-8360-e7bfc4d53c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:51.125753 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28073ba-fd15-4674-8360-e7bfc4d53c07 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:51.129599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f26616-4850-4c15-9545-01f3922dcfda admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:51.145026 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a7a50-9e8d-4b9f-adb4-1c0fdc3f1183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:51.145922 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a7a50-9e8d-4b9f-adb4-1c0fdc3f1183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:51.146401 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a7a50-9e8d-4b9f-adb4-1c0fdc3f1183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:51.147769 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a7a50-9e8d-4b9f-adb4-1c0fdc3f1183 admin admin] PATH_INFO: `/v3/users/451fe667763c4e39b68899cdff5978c6` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:51.149389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a7a50-9e8d-4b9f-adb4-1c0fdc3f1183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=451fe667763c4e39b68899cdff5978c6)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:51.151472 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a7a50-9e8d-4b9f-adb4-1c0fdc3f1183 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:51.161434 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 989/1982] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:09:51.164035 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28073ba-fd15-4674-8360-e7bfc4d53c07 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:51.178113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28073ba-fd15-4674-8360-e7bfc4d53c07 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:51.184535 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b78b09-45f1-4dd8-af94-a30fe83039cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:51.186151 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b78b09-45f1-4dd8-af94-a30fe83039cd admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:51.186436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b78b09-45f1-4dd8-af94-a30fe83039cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:51.186705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b78b09-45f1-4dd8-af94-a30fe83039cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:51.187411 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b78b09-45f1-4dd8-af94-a30fe83039cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:51.189945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b78b09-45f1-4dd8-af94-a30fe83039cd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:51.228594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8c9a7a50-9e8d-4b9f-adb4-1c0fdc3f1183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451fe667763c4e39b68899cdff5978c6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:51.230279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 990/1983] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:51 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:51.231240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b78b09-45f1-4dd8-af94-a30fe83039cd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:51.242190 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8c9a7a50-9e8d-4b9f-adb4-1c0fdc3f1183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451fe667763c4e39b68899cdff5978c6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:51.243348 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8c9a7a50-9e8d-4b9f-adb4-1c0fdc3f1183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451fe667763c4e39b68899cdff5978c6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:51.286796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8c9a7a50-9e8d-4b9f-adb4-1c0fdc3f1183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451fe667763c4e39b68899cdff5978c6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:51.298643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8c9a7a50-9e8d-4b9f-adb4-1c0fdc3f1183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451fe667763c4e39b68899cdff5978c6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:51.303115 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:51.313795 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 994/1984] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:51 2022] DELETE /identity/v3/users/451fe667763c4e39b68899cdff5978c6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:51.315041 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a7a50-9e8d-4b9f-adb4-1c0fdc3f1183 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:51.318521 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8c9a7a50-9e8d-4b9f-adb4-1c0fdc3f1183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:51.327161 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b78b09-45f1-4dd8-af94-a30fe83039cd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:51.400873 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a7a50-9e8d-4b9f-adb4-1c0fdc3f1183 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:51.406021 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b9d8a-d724-4255-a37c-42da037babd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:51.406662 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b9d8a-d724-4255-a37c-42da037babd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:51.406951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b9d8a-d724-4255-a37c-42da037babd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:51.407264 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b9d8a-d724-4255-a37c-42da037babd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:51.407956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b9d8a-d724-4255-a37c-42da037babd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:51.410055 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b9d8a-d724-4255-a37c-42da037babd6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:51.443388 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 995/1985] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:51 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:51.445624 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8d707-6430-4839-b4cb-eefb0532c9bc None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:51.447546 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8d707-6430-4839-b4cb-eefb0532c9bc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:51.447665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8d707-6430-4839-b4cb-eefb0532c9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:51.448917 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc5fdb-f96b-4b34-803f-f1e1a6527fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:51.450126 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc5fdb-f96b-4b34-803f-f1e1a6527fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:51.450589 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc5fdb-f96b-4b34-803f-f1e1a6527fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:51.451297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc5fdb-f96b-4b34-803f-f1e1a6527fbc admin admin] PATH_INFO: `/v3/projects/ccc76a73f4fb4dc999f330386b77bf4a/users/9ae5f1e6ebba4a3badc4f1b0f8f21515/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:51.472150 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc5fdb-f96b-4b34-803f-f1e1a6527fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc76a73f4fb4dc999f330386b77bf4a, user_id=9ae5f1e6ebba4a3badc4f1b0f8f21515, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:51.474115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-aef8d707-6430-4839-b4cb-eefb0532c9bc None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:51.476392 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-aef8d707-6430-4839-b4cb-eefb0532c9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:51.487330 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 996/1986] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:51.489122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8d707-6430-4839-b4cb-eefb0532c9bc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:51.489343 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc5fdb-f96b-4b34-803f-f1e1a6527fbc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:51.504888 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8d707-6430-4839-b4cb-eefb0532c9bc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:51.513861 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972052ef-10a6-4145-affc-29ebfae40b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:51.514907 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972052ef-10a6-4145-affc-29ebfae40b5b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:51.515370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972052ef-10a6-4145-affc-29ebfae40b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:51.515790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972052ef-10a6-4145-affc-29ebfae40b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:51.517601 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972052ef-10a6-4145-affc-29ebfae40b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:51.520231 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972052ef-10a6-4145-affc-29ebfae40b5b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:51.531702 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 991/1987] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:51 2022] PUT /identity/v3/projects/ccc76a73f4fb4dc999f330386b77bf4a/users/9ae5f1e6ebba4a3badc4f1b0f8f21515/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:51.542558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc5fdb-f96b-4b34-803f-f1e1a6527fbc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:51.542558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4cdc5fdb-f96b-4b34-803f-f1e1a6527fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:51.544159 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 997/1988] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:51.545782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d50735-dc6e-4c46-a365-004d7c7048b5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:51.546143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d50735-dc6e-4c46-a365-004d7c7048b5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:51.546486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d50735-dc6e-4c46-a365-004d7c7048b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:51.577354 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:51.598691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b5d50735-dc6e-4c46-a365-004d7c7048b5 None None] MFA Rules not processed for user `9ae5f1e6ebba4a3badc4f1b0f8f21515`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:51.600254 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b5d50735-dc6e-4c46-a365-004d7c7048b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:51.666398 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc5fdb-f96b-4b34-803f-f1e1a6527fbc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:51.670115 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6f7f2-8e07-4915-9ce8-7d836af9b2be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:51.670728 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6f7f2-8e07-4915-9ce8-7d836af9b2be service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:51.671014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6f7f2-8e07-4915-9ce8-7d836af9b2be service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:51.671313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6f7f2-8e07-4915-9ce8-7d836af9b2be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:51.687233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 998/1989] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:51.688143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d50735-dc6e-4c46-a365-004d7c7048b5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:51.751112 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6f7f2-8e07-4915-9ce8-7d836af9b2be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:51.752870 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6f7f2-8e07-4915-9ce8-7d836af9b2be service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:51.763338 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d50735-dc6e-4c46-a365-004d7c7048b5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:51.765208 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 992/1990] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:51.765936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6f7f2-8e07-4915-9ce8-7d836af9b2be service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:51.767291 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-42e6f7f2-8e07-4915-9ce8-7d836af9b2be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:51.769782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadcf04-a379-4922-a722-fc7c46c46d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:51.770391 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadcf04-a379-4922-a722-fc7c46c46d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:51.770675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadcf04-a379-4922-a722-fc7c46c46d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:51.770950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadcf04-a379-4922-a722-fc7c46c46d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:51.771631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadcf04-a379-4922-a722-fc7c46c46d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:51.774094 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadcf04-a379-4922-a722-fc7c46c46d80 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:51.781292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6f7f2-8e07-4915-9ce8-7d836af9b2be service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:51.790180 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 999/1991] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:51.790355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704bbf3-4b66-45d8-a7bb-28d75629e1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:51.790355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704bbf3-4b66-45d8-a7bb-28d75629e1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:51.790355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704bbf3-4b66-45d8-a7bb-28d75629e1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:51.790355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704bbf3-4b66-45d8-a7bb-28d75629e1c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:51.790698 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704bbf3-4b66-45d8-a7bb-28d75629e1c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:51.791813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadcf04-a379-4922-a722-fc7c46c46d80 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:51.792274 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704bbf3-4b66-45d8-a7bb-28d75629e1c7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:51.802961 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadcf04-a379-4922-a722-fc7c46c46d80 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:51.808874 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de601c60-be89-4025-8b3a-fe30c18125dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:51.809730 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de601c60-be89-4025-8b3a-fe30c18125dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:51.810434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de601c60-be89-4025-8b3a-fe30c18125dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:51.810434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de601c60-be89-4025-8b3a-fe30c18125dc admin admin] PATH_INFO: `/v3/projects/bce75a2f8513456892baefbe5d2323c6/users/a87a5aaf9f8c49af8042500eabe2da09/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:51.827524 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 993/1992] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:51 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:51.828607 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704bbf3-4b66-45d8-a7bb-28d75629e1c7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:51.833343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de601c60-be89-4025-8b3a-fe30c18125dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce75a2f8513456892baefbe5d2323c6, user_id=a87a5aaf9f8c49af8042500eabe2da09, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:51.837919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de601c60-be89-4025-8b3a-fe30c18125dc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:51.840706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:51.857472 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1000/1993] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:51 2022] PUT /identity/v3/projects/bce75a2f8513456892baefbe5d2323c6/users/a87a5aaf9f8c49af8042500eabe2da09/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:51.868343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d353b1d-a776-4f46-aa0f-b2688ffe98ec None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:51.868653 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d353b1d-a776-4f46-aa0f-b2688ffe98ec None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:51.868993 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d353b1d-a776-4f46-aa0f-b2688ffe98ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:51.903327 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5d353b1d-a776-4f46-aa0f-b2688ffe98ec None None] MFA Rules not processed for user `a87a5aaf9f8c49af8042500eabe2da09`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:51.904898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5d353b1d-a776-4f46-aa0f-b2688ffe98ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:51.906199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704bbf3-4b66-45d8-a7bb-28d75629e1c7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:51.982357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3647a3-a38c-4152-9c8e-7e9d4e1b939d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:51.982978 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3647a3-a38c-4152-9c8e-7e9d4e1b939d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:51.983503 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3647a3-a38c-4152-9c8e-7e9d4e1b939d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:51.983746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3647a3-a38c-4152-9c8e-7e9d4e1b939d admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:51.984880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3647a3-a38c-4152-9c8e-7e9d4e1b939d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:51.987178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3647a3-a38c-4152-9c8e-7e9d4e1b939d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:52.006122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:52.017210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1001/1994] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:52.021236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 994/1995] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:51 2022] POST /identity/v3/users => generated 296 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:09:52.022527 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d353b1d-a776-4f46-aa0f-b2688ffe98ec None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:52.025249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3647a3-a38c-4152-9c8e-7e9d4e1b939d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:52.039819 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d353b1d-a776-4f46-aa0f-b2688ffe98ec None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:52.045715 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd3ee5-777e-4465-912b-f5b8e100b1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:52.046487 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd3ee5-777e-4465-912b-f5b8e100b1bd admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:52.046869 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd3ee5-777e-4465-912b-f5b8e100b1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:52.047804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd3ee5-777e-4465-912b-f5b8e100b1bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:52.048503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd3ee5-777e-4465-912b-f5b8e100b1bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:52.051162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd3ee5-777e-4465-912b-f5b8e100b1bd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:52.060842 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3647a3-a38c-4152-9c8e-7e9d4e1b939d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:52.078673 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67d319-7746-4f87-b61b-b231dfa5410a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:52.079486 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67d319-7746-4f87-b61b-b231dfa5410a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:52.079729 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67d319-7746-4f87-b61b-b231dfa5410a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:52.080469 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67d319-7746-4f87-b61b-b231dfa5410a admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:52.081132 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67d319-7746-4f87-b61b-b231dfa5410a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:52.082755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67d319-7746-4f87-b61b-b231dfa5410a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:52.094409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 995/1996] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:52.100814 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67d319-7746-4f87-b61b-b231dfa5410a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:52.111910 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1002/1997] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:52 2022] POST /identity/v3/projects => generated 389 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:52.113799 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd3ee5-777e-4465-912b-f5b8e100b1bd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:52.118935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67d319-7746-4f87-b61b-b231dfa5410a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:52.208414 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a2d24-1bd6-4843-82b6-059b775c16e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:52.209077 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a2d24-1bd6-4843-82b6-059b775c16e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:52.209353 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a2d24-1bd6-4843-82b6-059b775c16e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:52.209619 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a2d24-1bd6-4843-82b6-059b775c16e0 admin admin] PATH_INFO: `/v3/projects/f2abe0b4a77142aab41282e2b8290239/users/be41a3d817e04b309d414f06e303368a/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:52.250204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd3ee5-777e-4465-912b-f5b8e100b1bd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:52.251700 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a2d24-1bd6-4843-82b6-059b775c16e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2abe0b4a77142aab41282e2b8290239, user_id=be41a3d817e04b309d414f06e303368a, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:52.256477 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a2d24-1bd6-4843-82b6-059b775c16e0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:52.262794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c8acb-490c-438b-b4d4-b771ff9ed331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:52.263571 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c8acb-490c-438b-b4d4-b771ff9ed331 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:52.263847 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c8acb-490c-438b-b4d4-b771ff9ed331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:52.264120 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c8acb-490c-438b-b4d4-b771ff9ed331 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:52.264742 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c8acb-490c-438b-b4d4-b771ff9ed331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:52.268804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c8acb-490c-438b-b4d4-b771ff9ed331 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:52.284678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 996/1998] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:52 2022] PUT /identity/v3/projects/f2abe0b4a77142aab41282e2b8290239/users/be41a3d817e04b309d414f06e303368a/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:52.285720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a2d24-1bd6-4843-82b6-059b775c16e0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:52.292047 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3e2a2d24-1bd6-4843-82b6-059b775c16e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:52.318965 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1003/1999] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:52 2022] POST /identity/v3/users => generated 301 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:52.320945 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c8acb-490c-438b-b4d4-b771ff9ed331 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:52.332381 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:52.354747 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c8acb-490c-438b-b4d4-b771ff9ed331 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:52.445749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a2d24-1bd6-4843-82b6-059b775c16e0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:52.468540 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a13d2-0713-4d3c-82aa-ec06d293d2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:52.469649 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a13d2-0713-4d3c-82aa-ec06d293d2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:52.471905 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a13d2-0713-4d3c-82aa-ec06d293d2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:52.473548 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a13d2-0713-4d3c-82aa-ec06d293d2c2 admin admin] PATH_INFO: `/v3/projects/1a0ac453f51a4324992ed6956b2bbd4e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:52.480774 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a13d2-0713-4d3c-82aa-ec06d293d2c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a0ac453f51a4324992ed6956b2bbd4e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:52.484417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29e271-639c-463f-be8a-9256957a6870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:52.485062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29e271-639c-463f-be8a-9256957a6870 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:52.485661 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29e271-639c-463f-be8a-9256957a6870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:52.485661 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29e271-639c-463f-be8a-9256957a6870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:52.486253 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29e271-639c-463f-be8a-9256957a6870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:52.487951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29e271-639c-463f-be8a-9256957a6870 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:52.488285 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a13d2-0713-4d3c-82aa-ec06d293d2c2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:52.515046 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1004/2000] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:52.519190 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29e271-639c-463f-be8a-9256957a6870 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:52.545853 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29e271-639c-463f-be8a-9256957a6870 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:52.567970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-745a13d2-0713-4d3c-82aa-ec06d293d2c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a0ac453f51a4324992ed6956b2bbd4e', 'request_id': 'req-745a13d2-0713-4d3c-82aa-ec06d293d2c2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:52.591290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-745a13d2-0713-4d3c-82aa-ec06d293d2c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a0ac453f51a4324992ed6956b2bbd4e', 'request_id': 'req-745a13d2-0713-4d3c-82aa-ec06d293d2c2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:52.604756 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-745a13d2-0713-4d3c-82aa-ec06d293d2c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a0ac453f51a4324992ed6956b2bbd4e', 'request_id': 'req-745a13d2-0713-4d3c-82aa-ec06d293d2c2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:52.635822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-745a13d2-0713-4d3c-82aa-ec06d293d2c2 admin admin] The token cache is being invalidate because project 1a0ac453f51a4324992ed6956b2bbd4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:52.635822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-745a13d2-0713-4d3c-82aa-ec06d293d2c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:52.638539 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-745a13d2-0713-4d3c-82aa-ec06d293d2c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:52.643353 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 997/2001] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:52 2022] DELETE /identity/v3/projects/1a0ac453f51a4324992ed6956b2bbd4e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:52.644400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a13d2-0713-4d3c-82aa-ec06d293d2c2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:52.650124 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-745a13d2-0713-4d3c-82aa-ec06d293d2c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:52.693989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf5eec-4378-46d9-90ea-b6c35b59f17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:52.695696 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf5eec-4378-46d9-90ea-b6c35b59f17f admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:52.695992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf5eec-4378-46d9-90ea-b6c35b59f17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:52.700858 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf5eec-4378-46d9-90ea-b6c35b59f17f admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:52.701263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf5eec-4378-46d9-90ea-b6c35b59f17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:52.703738 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf5eec-4378-46d9-90ea-b6c35b59f17f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:52.711584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:52.723193 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1005/2002] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:52.723896 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf5eec-4378-46d9-90ea-b6c35b59f17f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:52.728849 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-31cf5eec-4378-46d9-90ea-b6c35b59f17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:52.747140 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf5eec-4378-46d9-90ea-b6c35b59f17f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:52.764733 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43390924-493f-49dd-a9a5-e047ebdf2c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:52.765461 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43390924-493f-49dd-a9a5-e047ebdf2c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:52.765810 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43390924-493f-49dd-a9a5-e047ebdf2c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:52.766149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43390924-493f-49dd-a9a5-e047ebdf2c4c admin admin] PATH_INFO: `/v3/projects/11d4df8659a74097b5b68458d713da7f` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:52.767545 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43390924-493f-49dd-a9a5-e047ebdf2c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=11d4df8659a74097b5b68458d713da7f)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:52.769795 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43390924-493f-49dd-a9a5-e047ebdf2c4c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:52.780694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a13d2-0713-4d3c-82aa-ec06d293d2c2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:52.789795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380fe0f-3703-4bc2-be51-06a227adf773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:52.790486 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380fe0f-3703-4bc2-be51-06a227adf773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:52.790774 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380fe0f-3703-4bc2-be51-06a227adf773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:52.791156 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380fe0f-3703-4bc2-be51-06a227adf773 admin admin] PATH_INFO: `/v3/projects/f2abe0b4a77142aab41282e2b8290239/users/be41a3d817e04b309d414f06e303368a/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:52.798540 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380fe0f-3703-4bc2-be51-06a227adf773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2abe0b4a77142aab41282e2b8290239, user_id=be41a3d817e04b309d414f06e303368a, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:52.801246 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380fe0f-3703-4bc2-be51-06a227adf773 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:52.830061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 998/2003] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:52 2022] PUT /identity/v3/projects/f2abe0b4a77142aab41282e2b8290239/users/be41a3d817e04b309d414f06e303368a/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:52.838460 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380fe0f-3703-4bc2-be51-06a227adf773 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:52.838460 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0380fe0f-3703-4bc2-be51-06a227adf773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:52.852590 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-43390924-493f-49dd-a9a5-e047ebdf2c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11d4df8659a74097b5b68458d713da7f', 'request_id': 'req-43390924-493f-49dd-a9a5-e047ebdf2c4c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:52.859849 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-43390924-493f-49dd-a9a5-e047ebdf2c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11d4df8659a74097b5b68458d713da7f', 'request_id': 'req-43390924-493f-49dd-a9a5-e047ebdf2c4c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:52.869450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-43390924-493f-49dd-a9a5-e047ebdf2c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11d4df8659a74097b5b68458d713da7f', 'request_id': 'req-43390924-493f-49dd-a9a5-e047ebdf2c4c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:52.887638 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-43390924-493f-49dd-a9a5-e047ebdf2c4c admin admin] The token cache is being invalidate because project 11d4df8659a74097b5b68458d713da7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:52.888450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-43390924-493f-49dd-a9a5-e047ebdf2c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:52.889984 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-43390924-493f-49dd-a9a5-e047ebdf2c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:52.893681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1006/2004] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:52 2022] DELETE /identity/v3/projects/11d4df8659a74097b5b68458d713da7f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:52.894231 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43390924-493f-49dd-a9a5-e047ebdf2c4c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:52.896197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-43390924-493f-49dd-a9a5-e047ebdf2c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:52.918203 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:52.967000 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380fe0f-3703-4bc2-be51-06a227adf773 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:52.987546 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43390924-493f-49dd-a9a5-e047ebdf2c4c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:52.995026 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d63d69-3db9-491a-801a-e864a3113849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:52.995776 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d63d69-3db9-491a-801a-e864a3113849 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:52.996062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d63d69-3db9-491a-801a-e864a3113849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:52.996337 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d63d69-3db9-491a-801a-e864a3113849 admin admin] PATH_INFO: `/v3/projects/4504af15ad63432f89a3a4f3bcdffd08/users/15d1443b9b964c9eaf664818dbd75421/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:53.020675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d63d69-3db9-491a-801a-e864a3113849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4504af15ad63432f89a3a4f3bcdffd08, user_id=15d1443b9b964c9eaf664818dbd75421, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:53.028187 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d63d69-3db9-491a-801a-e864a3113849 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:53.040552 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5c0f6-7c2c-4044-baf9-58d611b3b615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:53.042623 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5c0f6-7c2c-4044-baf9-58d611b3b615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:53.042894 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5c0f6-7c2c-4044-baf9-58d611b3b615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:53.043289 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5c0f6-7c2c-4044-baf9-58d611b3b615 admin admin] PATH_INFO: `/v3/users/306e84a232dc4c34ab18cb9c67720372` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:53.045429 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5c0f6-7c2c-4044-baf9-58d611b3b615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=306e84a232dc4c34ab18cb9c67720372)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:53.047654 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5c0f6-7c2c-4044-baf9-58d611b3b615 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:53.050262 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1007/2005] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:52 2022] PUT /identity/v3/projects/4504af15ad63432f89a3a4f3bcdffd08/users/15d1443b9b964c9eaf664818dbd75421/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:53.053225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435bb4e-63d5-4b05-8376-f1c8a4bb7c18 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:53.054160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435bb4e-63d5-4b05-8376-f1c8a4bb7c18 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:53.054596 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435bb4e-63d5-4b05-8376-f1c8a4bb7c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:53.094627 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0435bb4e-63d5-4b05-8376-f1c8a4bb7c18 None None] MFA Rules not processed for user `be41a3d817e04b309d414f06e303368a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:53.096906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0435bb4e-63d5-4b05-8376-f1c8a4bb7c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:53.135141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-78b5c0f6-7c2c-4044-baf9-58d611b3b615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '306e84a232dc4c34ab18cb9c67720372'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:53.136418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-78b5c0f6-7c2c-4044-baf9-58d611b3b615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '306e84a232dc4c34ab18cb9c67720372'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:53.137359 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-78b5c0f6-7c2c-4044-baf9-58d611b3b615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '306e84a232dc4c34ab18cb9c67720372'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:53.146281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-78b5c0f6-7c2c-4044-baf9-58d611b3b615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '306e84a232dc4c34ab18cb9c67720372'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:53.155826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-78b5c0f6-7c2c-4044-baf9-58d611b3b615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '306e84a232dc4c34ab18cb9c67720372'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:53.166006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:53.189656 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 999/2006] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:52 2022] DELETE /identity/v3/users/306e84a232dc4c34ab18cb9c67720372 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:53.190773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5c0f6-7c2c-4044-baf9-58d611b3b615 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:53.192473 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-78b5c0f6-7c2c-4044-baf9-58d611b3b615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:53.215632 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1008/2007] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:53.215632 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435bb4e-63d5-4b05-8376-f1c8a4bb7c18 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:53.218611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0435bb4e-63d5-4b05-8376-f1c8a4bb7c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:53.281812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5c0f6-7c2c-4044-baf9-58d611b3b615 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:53.289726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a21ee-42ae-462f-af45-d011764437cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:53.290373 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a21ee-42ae-462f-af45-d011764437cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:53.290652 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a21ee-42ae-462f-af45-d011764437cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:53.290984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a21ee-42ae-462f-af45-d011764437cc admin admin] PATH_INFO: `/v3/users/1a0898cd90b646adbb83715f4979157e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:53.292676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a21ee-42ae-462f-af45-d011764437cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a0898cd90b646adbb83715f4979157e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:53.294674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a21ee-42ae-462f-af45-d011764437cc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:53.300104 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:53.314048 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435bb4e-63d5-4b05-8376-f1c8a4bb7c18 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:53.318253 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd68c06-0ace-4e70-b92e-46e2a3c10b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:53.318970 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd68c06-0ace-4e70-b92e-46e2a3c10b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:53.319891 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd68c06-0ace-4e70-b92e-46e2a3c10b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:53.320327 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd68c06-0ace-4e70-b92e-46e2a3c10b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:53.321089 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd68c06-0ace-4e70-b92e-46e2a3c10b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:53.322930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd68c06-0ace-4e70-b92e-46e2a3c10b25 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:53.356458 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1009/2008] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:53.358421 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd68c06-0ace-4e70-b92e-46e2a3c10b25 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:53.361061 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-acd68c06-0ace-4e70-b92e-46e2a3c10b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:53.372447 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2f6a21ee-42ae-462f-af45-d011764437cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a0898cd90b646adbb83715f4979157e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:53.374061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2f6a21ee-42ae-462f-af45-d011764437cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a0898cd90b646adbb83715f4979157e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:53.375971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2f6a21ee-42ae-462f-af45-d011764437cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a0898cd90b646adbb83715f4979157e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:53.388141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2f6a21ee-42ae-462f-af45-d011764437cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a0898cd90b646adbb83715f4979157e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:53.400250 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2f6a21ee-42ae-462f-af45-d011764437cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a0898cd90b646adbb83715f4979157e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:53.435697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1000/2009] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:53 2022] DELETE /identity/v3/users/1a0898cd90b646adbb83715f4979157e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:53.436686 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a21ee-42ae-462f-af45-d011764437cc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:53.438303 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2f6a21ee-42ae-462f-af45-d011764437cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:53.445674 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd68c06-0ace-4e70-b92e-46e2a3c10b25 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:53.531758 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46dcd9-cb7e-43d5-a31b-8b0724fb5964 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:53.533144 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46dcd9-cb7e-43d5-a31b-8b0724fb5964 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:53.533409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46dcd9-cb7e-43d5-a31b-8b0724fb5964 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:53.533737 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46dcd9-cb7e-43d5-a31b-8b0724fb5964 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:53.535287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a21ee-42ae-462f-af45-d011764437cc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:53.536698 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3a46dcd9-cb7e-43d5-a31b-8b0724fb5964 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:53.556398 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fed74c-768f-4c29-9404-d9fa4033925a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:53.557228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fed74c-768f-4c29-9404-d9fa4033925a admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:53.557526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fed74c-768f-4c29-9404-d9fa4033925a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:53.557779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fed74c-768f-4c29-9404-d9fa4033925a admin admin] PATH_INFO: `/v3/projects/4504af15ad63432f89a3a4f3bcdffd08/users/15d1443b9b964c9eaf664818dbd75421/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:53.560076 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fed74c-768f-4c29-9404-d9fa4033925a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4504af15ad63432f89a3a4f3bcdffd08, user_id=15d1443b9b964c9eaf664818dbd75421, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:53.563414 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fed74c-768f-4c29-9404-d9fa4033925a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:53.577453 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1001/2010] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:53 2022] PUT /identity/v3/projects/4504af15ad63432f89a3a4f3bcdffd08/users/15d1443b9b964c9eaf664818dbd75421/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:53.588695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fed74c-768f-4c29-9404-d9fa4033925a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:53.590805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-82fed74c-768f-4c29-9404-d9fa4033925a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:53.623489 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:53.642543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46dcd9-cb7e-43d5-a31b-8b0724fb5964 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:53.644020 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46dcd9-cb7e-43d5-a31b-8b0724fb5964 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:53.657878 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1010/2011] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:53.658978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1eed2-0969-4aeb-a6c7-5f36b49fccf2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:53.659310 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1eed2-0969-4aeb-a6c7-5f36b49fccf2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:53.659581 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1eed2-0969-4aeb-a6c7-5f36b49fccf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:53.696005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fed74c-768f-4c29-9404-d9fa4033925a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:53.699694 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-71a1eed2-0969-4aeb-a6c7-5f36b49fccf2 None None] MFA Rules not processed for user `15d1443b9b964c9eaf664818dbd75421`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:53.701991 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-71a1eed2-0969-4aeb-a6c7-5f36b49fccf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:53.716661 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91711bae-d81f-43cf-ab31-f6b2069e7656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:53.717315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91711bae-d81f-43cf-ab31-f6b2069e7656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:53.717594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91711bae-d81f-43cf-ab31-f6b2069e7656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:53.717862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91711bae-d81f-43cf-ab31-f6b2069e7656 admin admin] PATH_INFO: `/v3/projects/4411b320c81346b586f945c3de5a44af` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:53.719002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91711bae-d81f-43cf-ab31-f6b2069e7656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4411b320c81346b586f945c3de5a44af)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:53.720936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91711bae-d81f-43cf-ab31-f6b2069e7656 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:53.767810 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:53.807868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1011/2012] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:53 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:53.809090 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1eed2-0969-4aeb-a6c7-5f36b49fccf2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:53.810685 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-71a1eed2-0969-4aeb-a6c7-5f36b49fccf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:53.832283 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-91711bae-d81f-43cf-ab31-f6b2069e7656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4411b320c81346b586f945c3de5a44af', 'request_id': 'req-91711bae-d81f-43cf-ab31-f6b2069e7656'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:53.845141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-91711bae-d81f-43cf-ab31-f6b2069e7656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4411b320c81346b586f945c3de5a44af', 'request_id': 'req-91711bae-d81f-43cf-ab31-f6b2069e7656'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:53.862641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-91711bae-d81f-43cf-ab31-f6b2069e7656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4411b320c81346b586f945c3de5a44af', 'request_id': 'req-91711bae-d81f-43cf-ab31-f6b2069e7656'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:53.883671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-91711bae-d81f-43cf-ab31-f6b2069e7656 admin admin] The token cache is being invalidate because project 4411b320c81346b586f945c3de5a44af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:53.883671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-91711bae-d81f-43cf-ab31-f6b2069e7656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:53.885108 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-91711bae-d81f-43cf-ab31-f6b2069e7656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:53.888476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1002/2013] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:53 2022] DELETE /identity/v3/projects/4411b320c81346b586f945c3de5a44af => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:53.889333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91711bae-d81f-43cf-ab31-f6b2069e7656 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:53.890803 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-91711bae-d81f-43cf-ab31-f6b2069e7656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:53.906372 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1eed2-0969-4aeb-a6c7-5f36b49fccf2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:54.031544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bd204-a019-4a67-9685-10c252408874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:54.032224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bd204-a019-4a67-9685-10c252408874 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:54.032549 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bd204-a019-4a67-9685-10c252408874 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:54.032810 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bd204-a019-4a67-9685-10c252408874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:54.036568 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-564bd204-a019-4a67-9685-10c252408874 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:54.044236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91711bae-d81f-43cf-ab31-f6b2069e7656 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:54.054189 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d707c-9180-4fc4-a71c-32df1572d606 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:54.054189 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d707c-9180-4fc4-a71c-32df1572d606 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:54.054189 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d707c-9180-4fc4-a71c-32df1572d606 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:54.054189 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d707c-9180-4fc4-a71c-32df1572d606 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:54.060147 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-983d707c-9180-4fc4-a71c-32df1572d606 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:54.107596 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:54.123719 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bd204-a019-4a67-9685-10c252408874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:54.125174 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bd204-a019-4a67-9685-10c252408874 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:54.136796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1012/2014] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:54.138087 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d0692-a43d-4f4c-be2a-3357f72c22db None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:54.138374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d0692-a43d-4f4c-be2a-3357f72c22db None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:54.138656 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d0692-a43d-4f4c-be2a-3357f72c22db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:54.169948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d707c-9180-4fc4-a71c-32df1572d606 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:54.170699 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d707c-9180-4fc4-a71c-32df1572d606 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:54.172312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-820d0692-a43d-4f4c-be2a-3357f72c22db None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:54.173811 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-820d0692-a43d-4f4c-be2a-3357f72c22db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:54.197499 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1003/2015] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:53 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:54.198672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d707c-9180-4fc4-a71c-32df1572d606 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:54.203955 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-983d707c-9180-4fc4-a71c-32df1572d606 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:54.375827 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1013/2016] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:54.386167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3673a6-abb7-4cce-bca8-389274f0e4be None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:54.386533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3673a6-abb7-4cce-bca8-389274f0e4be None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:54.386893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3673a6-abb7-4cce-bca8-389274f0e4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:54.408832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:54.420795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d707c-9180-4fc4-a71c-32df1572d606 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:54.425492 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4b3673a6-abb7-4cce-bca8-389274f0e4be None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:54.427117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4b3673a6-abb7-4cce-bca8-389274f0e4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:54.434509 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e6318-e43d-491e-af75-7dde67fb131f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:54.435344 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e6318-e43d-491e-af75-7dde67fb131f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:54.435779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e6318-e43d-491e-af75-7dde67fb131f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:54.436144 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e6318-e43d-491e-af75-7dde67fb131f admin admin] PATH_INFO: `/v3/projects/2c9c90cca1884b19ba06b27d705af19c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:54.437605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e6318-e43d-491e-af75-7dde67fb131f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c9c90cca1884b19ba06b27d705af19c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:54.440182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e6318-e43d-491e-af75-7dde67fb131f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:54.460297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1014/2017] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:54.467123 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3673a6-abb7-4cce-bca8-389274f0e4be None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:54.488034 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3673a6-abb7-4cce-bca8-389274f0e4be None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:54.500585 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5d15f-8c5f-4a9f-91c3-1dd31856aa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:54.501374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5d15f-8c5f-4a9f-91c3-1dd31856aa85 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:54.501725 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5d15f-8c5f-4a9f-91c3-1dd31856aa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:54.502180 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5d15f-8c5f-4a9f-91c3-1dd31856aa85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:54.502940 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5d15f-8c5f-4a9f-91c3-1dd31856aa85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:09:54.503790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5d15f-8c5f-4a9f-91c3-1dd31856aa85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:54.505457 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5d15f-8c5f-4a9f-91c3-1dd31856aa85 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:54.536207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1015/2018] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:09:54.536207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5d15f-8c5f-4a9f-91c3-1dd31856aa85 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:54.538534 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7fa5d15f-8c5f-4a9f-91c3-1dd31856aa85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:54.548476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9a3e6318-e43d-491e-af75-7dde67fb131f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c9c90cca1884b19ba06b27d705af19c', 'request_id': 'req-9a3e6318-e43d-491e-af75-7dde67fb131f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:54.562839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5d15f-8c5f-4a9f-91c3-1dd31856aa85 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:54.566155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9a3e6318-e43d-491e-af75-7dde67fb131f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c9c90cca1884b19ba06b27d705af19c', 'request_id': 'req-9a3e6318-e43d-491e-af75-7dde67fb131f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:54.581916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9a3e6318-e43d-491e-af75-7dde67fb131f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c9c90cca1884b19ba06b27d705af19c', 'request_id': 'req-9a3e6318-e43d-491e-af75-7dde67fb131f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:54.610036 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9a3e6318-e43d-491e-af75-7dde67fb131f admin admin] The token cache is being invalidate because project 2c9c90cca1884b19ba06b27d705af19c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:54.610360 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9a3e6318-e43d-491e-af75-7dde67fb131f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:54.611019 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9a3e6318-e43d-491e-af75-7dde67fb131f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:54.612607 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1004/2019] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:54 2022] DELETE /identity/v3/projects/2c9c90cca1884b19ba06b27d705af19c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:54.613357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e6318-e43d-491e-af75-7dde67fb131f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:54.614705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9a3e6318-e43d-491e-af75-7dde67fb131f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:54.672114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02bd9b-fa30-4c72-9635-add2896f4ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:54.672843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02bd9b-fa30-4c72-9635-add2896f4ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:54.673024 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02bd9b-fa30-4c72-9635-add2896f4ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:54.673315 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02bd9b-fa30-4c72-9635-add2896f4ed7 admin admin] PATH_INFO: `/v3/users/a87a5aaf9f8c49af8042500eabe2da09` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:54.674534 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02bd9b-fa30-4c72-9635-add2896f4ed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a87a5aaf9f8c49af8042500eabe2da09)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:54.676436 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02bd9b-fa30-4c72-9635-add2896f4ed7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:54.708455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e6318-e43d-491e-af75-7dde67fb131f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:54.716846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef56371-0fdb-4a95-b438-7cd1a4d471b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:54.717717 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef56371-0fdb-4a95-b438-7cd1a4d471b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:54.717871 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef56371-0fdb-4a95-b438-7cd1a4d471b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:54.718032 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef56371-0fdb-4a95-b438-7cd1a4d471b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:54.719076 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef56371-0fdb-4a95-b438-7cd1a4d471b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:54.720660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef56371-0fdb-4a95-b438-7cd1a4d471b0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:54.734597 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6f02bd9b-fa30-4c72-9635-add2896f4ed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a87a5aaf9f8c49af8042500eabe2da09'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:54.744301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6f02bd9b-fa30-4c72-9635-add2896f4ed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a87a5aaf9f8c49af8042500eabe2da09'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:54.745041 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6f02bd9b-fa30-4c72-9635-add2896f4ed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a87a5aaf9f8c49af8042500eabe2da09'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:54.762685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1005/2020] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:54 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:54.762685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c292e-67ab-4f5b-bb2a-e75d0f757998 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:54.762905 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:54.763363 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c292e-67ab-4f5b-bb2a-e75d0f757998 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:54.763682 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c292e-67ab-4f5b-bb2a-e75d0f757998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:54.764766 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6f02bd9b-fa30-4c72-9635-add2896f4ed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a87a5aaf9f8c49af8042500eabe2da09'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:54.773733 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6f02bd9b-fa30-4c72-9635-add2896f4ed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a87a5aaf9f8c49af8042500eabe2da09'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:54.783173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1016/2021] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:54 2022] DELETE /identity/v3/users/a87a5aaf9f8c49af8042500eabe2da09 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:54.786694 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02bd9b-fa30-4c72-9635-add2896f4ed7 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:54.791383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6f02bd9b-fa30-4c72-9635-add2896f4ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:54.803176 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-881c292e-67ab-4f5b-bb2a-e75d0f757998 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:54.804045 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-881c292e-67ab-4f5b-bb2a-e75d0f757998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:54.880113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02bd9b-fa30-4c72-9635-add2896f4ed7 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:54.881126 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1006/2022] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:54.882912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b75af5-5564-46fc-9ddc-4fba589bf007 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:54.883234 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b75af5-5564-46fc-9ddc-4fba589bf007 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:54.883508 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b75af5-5564-46fc-9ddc-4fba589bf007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:54.886220 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8669f30-2d81-425b-badf-225ce5b25761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:54.886820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8669f30-2d81-425b-badf-225ce5b25761 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:54.887118 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8669f30-2d81-425b-badf-225ce5b25761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:54.887390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8669f30-2d81-425b-badf-225ce5b25761 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:54.888253 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8669f30-2d81-425b-badf-225ce5b25761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:54.890157 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8669f30-2d81-425b-badf-225ce5b25761 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:54.902942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d0b75af5-5564-46fc-9ddc-4fba589bf007 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:54.904181 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d0b75af5-5564-46fc-9ddc-4fba589bf007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:54.911925 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1007/2023] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:54.915640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1017/2024] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:54 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:54.915872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a5c73-8a02-4cbb-b124-8a604dcc25f8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:54.915872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a5c73-8a02-4cbb-b124-8a604dcc25f8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:54.915872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a5c73-8a02-4cbb-b124-8a604dcc25f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:54.920118 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8669f30-2d81-425b-badf-225ce5b25761 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:54.928876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:54.930572 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8669f30-2d81-425b-badf-225ce5b25761 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:54.934297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bb1a5c73-8a02-4cbb-b124-8a604dcc25f8 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:54.936139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9991124-2f38-4828-972b-370233719402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:54.936270 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bb1a5c73-8a02-4cbb-b124-8a604dcc25f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:54.936873 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9991124-2f38-4828-972b-370233719402 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:54.937194 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9991124-2f38-4828-972b-370233719402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:54.937476 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9991124-2f38-4828-972b-370233719402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:54.938130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9991124-2f38-4828-972b-370233719402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:54.939845 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9991124-2f38-4828-972b-370233719402 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:54.945571 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1008/2025] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:54.946281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a5c73-8a02-4cbb-b124-8a604dcc25f8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:54.950963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1018/2026] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:54.952069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bb1a5c73-8a02-4cbb-b124-8a604dcc25f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:54.953843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9991124-2f38-4828-972b-370233719402 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:54.963881 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9991124-2f38-4828-972b-370233719402 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:54.968543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc996b1-3938-442d-8bef-efa22ebad6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:54.969122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc996b1-3938-442d-8bef-efa22ebad6ff admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:54.969398 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc996b1-3938-442d-8bef-efa22ebad6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:54.969668 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc996b1-3938-442d-8bef-efa22ebad6ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:54.970298 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc996b1-3938-442d-8bef-efa22ebad6ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:09:54.970602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc996b1-3938-442d-8bef-efa22ebad6ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:54.972186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc996b1-3938-442d-8bef-efa22ebad6ff admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:54.987330 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1019/2027] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:09:54.987330 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc996b1-3938-442d-8bef-efa22ebad6ff admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:54.994328 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc996b1-3938-442d-8bef-efa22ebad6ff admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:54.999020 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e012471-d833-44f4-9fc8-8cdf450938c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:54.999605 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e012471-d833-44f4-9fc8-8cdf450938c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:54.999886 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e012471-d833-44f4-9fc8-8cdf450938c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:55.000157 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e012471-d833-44f4-9fc8-8cdf450938c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:55.000785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e012471-d833-44f4-9fc8-8cdf450938c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:55.002334 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e012471-d833-44f4-9fc8-8cdf450938c8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:55.012922 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1020/2028] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:55.013511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a5c73-8a02-4cbb-b124-8a604dcc25f8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:55.013690 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e012471-d833-44f4-9fc8-8cdf450938c8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:55.017452 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169cb73-ebdb-460b-a129-b2905cd9f3ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:55.018062 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169cb73-ebdb-460b-a129-b2905cd9f3ab service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:55.018522 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169cb73-ebdb-460b-a129-b2905cd9f3ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:55.018797 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169cb73-ebdb-460b-a129-b2905cd9f3ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:55.023517 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e012471-d833-44f4-9fc8-8cdf450938c8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:55.028087 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e1d5d-888a-4278-87fe-4bc38cf74772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:55.028448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169cb73-ebdb-460b-a129-b2905cd9f3ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:55.028669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e1d5d-888a-4278-87fe-4bc38cf74772 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:55.028926 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e1d5d-888a-4278-87fe-4bc38cf74772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:55.029918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e1d5d-888a-4278-87fe-4bc38cf74772 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:55.030084 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169cb73-ebdb-460b-a129-b2905cd9f3ab service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:55.030537 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e1d5d-888a-4278-87fe-4bc38cf74772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:55.032448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e1d5d-888a-4278-87fe-4bc38cf74772 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:55.040301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1009/2029] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:55.041078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169cb73-ebdb-460b-a129-b2905cd9f3ab service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:55.051360 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169cb73-ebdb-460b-a129-b2905cd9f3ab service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:55.057144 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6f114-44e2-480f-96a6-d099051bc2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:55.057806 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6f114-44e2-480f-96a6-d099051bc2f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:55.058092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6f114-44e2-480f-96a6-d099051bc2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:55.058360 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6f114-44e2-480f-96a6-d099051bc2f1 admin admin] PATH_INFO: `/v3/projects/ea1b559b2318440992e08f7c6c73a652/users/6b55ae7482564faaa1d61d143830d3a3/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:55.062930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1021/2030] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:55 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:55.067132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e1d5d-888a-4278-87fe-4bc38cf74772 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:55.075836 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6f114-44e2-480f-96a6-d099051bc2f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea1b559b2318440992e08f7c6c73a652, user_id=6b55ae7482564faaa1d61d143830d3a3, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:55.078679 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6f114-44e2-480f-96a6-d099051bc2f1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:55.096557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1010/2031] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:55 2022] PUT /identity/v3/projects/ea1b559b2318440992e08f7c6c73a652/users/6b55ae7482564faaa1d61d143830d3a3/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:55.109233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e4ec0-79f4-44c7-a8e7-ddf4d60c2793 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:55.109528 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e4ec0-79f4-44c7-a8e7-ddf4d60c2793 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:55.109789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e4ec0-79f4-44c7-a8e7-ddf4d60c2793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:55.139500 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e1d5d-888a-4278-87fe-4bc38cf74772 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:55.139708 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5b2e4ec0-79f4-44c7-a8e7-ddf4d60c2793 None None] MFA Rules not processed for user `6b55ae7482564faaa1d61d143830d3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:55.140810 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5b2e4ec0-79f4-44c7-a8e7-ddf4d60c2793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:55.167760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:55.220244 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1011/2032] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:55.221896 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c388d-692f-4816-a9c8-cbe8715cad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:55.223047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c388d-692f-4816-a9c8-cbe8715cad50 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:55.223356 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c388d-692f-4816-a9c8-cbe8715cad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:55.223624 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c388d-692f-4816-a9c8-cbe8715cad50 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:55.224550 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c388d-692f-4816-a9c8-cbe8715cad50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:55.226688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c388d-692f-4816-a9c8-cbe8715cad50 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:55.232075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e4ec0-79f4-44c7-a8e7-ddf4d60c2793 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:55.233573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5b2e4ec0-79f4-44c7-a8e7-ddf4d60c2793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:55.251188 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1022/2033] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:55 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:55.253477 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c388d-692f-4816-a9c8-cbe8715cad50 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:55.263198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c388d-692f-4816-a9c8-cbe8715cad50 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:55.268120 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10408b2b-16be-492b-987e-305463f8f928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:55.269426 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10408b2b-16be-492b-987e-305463f8f928 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:55.269891 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10408b2b-16be-492b-987e-305463f8f928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:55.270841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10408b2b-16be-492b-987e-305463f8f928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:55.272049 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10408b2b-16be-492b-987e-305463f8f928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:55.274455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10408b2b-16be-492b-987e-305463f8f928 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:55.291026 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1023/2034] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:09:55.295268 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10408b2b-16be-492b-987e-305463f8f928 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:55.305574 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e4ec0-79f4-44c7-a8e7-ddf4d60c2793 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:55.309737 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2042c96-b6fc-4f17-b10e-cff7180e4a13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:55.309880 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10408b2b-16be-492b-987e-305463f8f928 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:55.310541 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2042c96-b6fc-4f17-b10e-cff7180e4a13 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:55.310883 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2042c96-b6fc-4f17-b10e-cff7180e4a13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:55.311351 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2042c96-b6fc-4f17-b10e-cff7180e4a13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:55.315869 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9dfee-110c-4c49-9f35-d8d5c3273c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:55.316205 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9dfee-110c-4c49-9f35-d8d5c3273c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:55.316554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9dfee-110c-4c49-9f35-d8d5c3273c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:55.316897 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9dfee-110c-4c49-9f35-d8d5c3273c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:55.317620 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9dfee-110c-4c49-9f35-d8d5c3273c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:55.320416 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9dfee-110c-4c49-9f35-d8d5c3273c8c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:55.321810 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2042c96-b6fc-4f17-b10e-cff7180e4a13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:55.323342 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2042c96-b6fc-4f17-b10e-cff7180e4a13 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:55.347398 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1012/2035] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:55.360038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1024/2036] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:55.360400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2042c96-b6fc-4f17-b10e-cff7180e4a13 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:55.360933 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9dfee-110c-4c49-9f35-d8d5c3273c8c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:55.361909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f2042c96-b6fc-4f17-b10e-cff7180e4a13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:55.376728 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9dfee-110c-4c49-9f35-d8d5c3273c8c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:55.384679 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238e642-a9ba-40e6-9251-f3639d14b425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:55.388546 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238e642-a9ba-40e6-9251-f3639d14b425 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:55.388839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238e642-a9ba-40e6-9251-f3639d14b425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:55.389121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238e642-a9ba-40e6-9251-f3639d14b425 admin admin] PATH_INFO: `/v3/projects/f84cc1f037f34902943fb523697cd96e/users/f9a0c86367b64d82b054f81255bac4e9/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:55.390707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2042c96-b6fc-4f17-b10e-cff7180e4a13 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:55.399405 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda8083-eddf-433e-9566-fd83f9970c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:55.400245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda8083-eddf-433e-9566-fd83f9970c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:55.400589 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda8083-eddf-433e-9566-fd83f9970c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:55.401013 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda8083-eddf-433e-9566-fd83f9970c9f admin admin] PATH_INFO: `/v3/projects/bce75a2f8513456892baefbe5d2323c6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:55.402466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda8083-eddf-433e-9566-fd83f9970c9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce75a2f8513456892baefbe5d2323c6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:55.404462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda8083-eddf-433e-9566-fd83f9970c9f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:55.411614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:55.421413 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238e642-a9ba-40e6-9251-f3639d14b425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f84cc1f037f34902943fb523697cd96e, user_id=f9a0c86367b64d82b054f81255bac4e9, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:55.424963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238e642-a9ba-40e6-9251-f3639d14b425 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:55.448977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1025/2037] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:55 2022] PUT /identity/v3/projects/f84cc1f037f34902943fb523697cd96e/users/f9a0c86367b64d82b054f81255bac4e9/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:55.462465 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38fa6b-88ed-442b-b0a6-0619980b6386 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:55.462465 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38fa6b-88ed-442b-b0a6-0619980b6386 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:55.462755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38fa6b-88ed-442b-b0a6-0619980b6386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:55.488193 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-edda8083-eddf-433e-9566-fd83f9970c9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce75a2f8513456892baefbe5d2323c6', 'request_id': 'req-edda8083-eddf-433e-9566-fd83f9970c9f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:55.498450 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-edda8083-eddf-433e-9566-fd83f9970c9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce75a2f8513456892baefbe5d2323c6', 'request_id': 'req-edda8083-eddf-433e-9566-fd83f9970c9f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:55.503893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-da38fa6b-88ed-442b-b0a6-0619980b6386 None None] MFA Rules not processed for user `f9a0c86367b64d82b054f81255bac4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:55.505854 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-da38fa6b-88ed-442b-b0a6-0619980b6386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:55.507765 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-edda8083-eddf-433e-9566-fd83f9970c9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce75a2f8513456892baefbe5d2323c6', 'request_id': 'req-edda8083-eddf-433e-9566-fd83f9970c9f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:55.531560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-edda8083-eddf-433e-9566-fd83f9970c9f admin admin] The token cache is being invalidate because project bce75a2f8513456892baefbe5d2323c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:55.531850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-edda8083-eddf-433e-9566-fd83f9970c9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:55.532913 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-edda8083-eddf-433e-9566-fd83f9970c9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:55.535028 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1013/2038] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:55 2022] DELETE /identity/v3/projects/bce75a2f8513456892baefbe5d2323c6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:55.540194 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda8083-eddf-433e-9566-fd83f9970c9f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:55.543840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-edda8083-eddf-433e-9566-fd83f9970c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:55.584226 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1026/2039] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:55.589405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38fa6b-88ed-442b-b0a6-0619980b6386 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:55.590973 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-da38fa6b-88ed-442b-b0a6-0619980b6386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:55.657548 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda8083-eddf-433e-9566-fd83f9970c9f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:55.671836 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd9096-9204-42cc-8404-8e54b79da1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:55.672479 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd9096-9204-42cc-8404-8e54b79da1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:55.672761 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd9096-9204-42cc-8404-8e54b79da1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:55.673627 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd9096-9204-42cc-8404-8e54b79da1cf admin admin] PATH_INFO: `/v3/users/15d1443b9b964c9eaf664818dbd75421` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:55.675393 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd9096-9204-42cc-8404-8e54b79da1cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d1443b9b964c9eaf664818dbd75421)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:55.677754 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd9096-9204-42cc-8404-8e54b79da1cf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:55.718761 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38fa6b-88ed-442b-b0a6-0619980b6386 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:55.727197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf401022-4859-4fde-a755-6e1794b6842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:55.727892 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf401022-4859-4fde-a755-6e1794b6842f admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:55.728217 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf401022-4859-4fde-a755-6e1794b6842f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:55.728566 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf401022-4859-4fde-a755-6e1794b6842f admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:55.729211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf401022-4859-4fde-a755-6e1794b6842f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:55.731326 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf401022-4859-4fde-a755-6e1794b6842f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:55.740691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:55.771566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3cfd9096-9204-42cc-8404-8e54b79da1cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d1443b9b964c9eaf664818dbd75421'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:55.775612 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3cfd9096-9204-42cc-8404-8e54b79da1cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d1443b9b964c9eaf664818dbd75421'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:55.776299 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3cfd9096-9204-42cc-8404-8e54b79da1cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d1443b9b964c9eaf664818dbd75421'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:55.795171 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3cfd9096-9204-42cc-8404-8e54b79da1cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d1443b9b964c9eaf664818dbd75421'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:55.798723 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1027/2040] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:55 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:55.803070 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf401022-4859-4fde-a755-6e1794b6842f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:55.808263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cf401022-4859-4fde-a755-6e1794b6842f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:55.814198 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3cfd9096-9204-42cc-8404-8e54b79da1cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d1443b9b964c9eaf664818dbd75421'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:55.843382 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1014/2041] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:55 2022] DELETE /identity/v3/users/15d1443b9b964c9eaf664818dbd75421 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:55.940183 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf401022-4859-4fde-a755-6e1794b6842f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:56.010727 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b2b1b-44b0-4de1-900b-6ea25f181f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:56.011381 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b2b1b-44b0-4de1-900b-6ea25f181f9d admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:56.012013 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b2b1b-44b0-4de1-900b-6ea25f181f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:56.012297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b2b1b-44b0-4de1-900b-6ea25f181f9d admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:56.013070 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b2b1b-44b0-4de1-900b-6ea25f181f9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:56.015001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b2b1b-44b0-4de1-900b-6ea25f181f9d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:56.042241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1028/2042] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:55 2022] POST /identity/v3/users => generated 294 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:09:56.046087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd9096-9204-42cc-8404-8e54b79da1cf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:56.063048 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd9096-9204-42cc-8404-8e54b79da1cf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:56.068760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5ce19-050c-43ab-b509-70a4c66a9f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:56.069960 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5ce19-050c-43ab-b509-70a4c66a9f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:56.070242 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5ce19-050c-43ab-b509-70a4c66a9f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:56.070516 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5ce19-050c-43ab-b509-70a4c66a9f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:56.071202 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5ce19-050c-43ab-b509-70a4c66a9f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:56.072939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5ce19-050c-43ab-b509-70a4c66a9f5b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:56.087123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1015/2043] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:56.088788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b2b1b-44b0-4de1-900b-6ea25f181f9d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:56.099853 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b2b1b-44b0-4de1-900b-6ea25f181f9d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:56.105611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350e548-8bd4-44bf-aae6-fa8a6d87581d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:56.106665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350e548-8bd4-44bf-aae6-fa8a6d87581d admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:56.106665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350e548-8bd4-44bf-aae6-fa8a6d87581d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:56.106893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350e548-8bd4-44bf-aae6-fa8a6d87581d admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:56.107426 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350e548-8bd4-44bf-aae6-fa8a6d87581d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:56.108991 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350e548-8bd4-44bf-aae6-fa8a6d87581d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:56.128185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1029/2044] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:56.129502 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5ce19-050c-43ab-b509-70a4c66a9f5b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:56.136422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:56.143758 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5ce19-050c-43ab-b509-70a4c66a9f5b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:56.151763 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ff794-a3df-4d85-9a01-0f77f737db9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:56.153017 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ff794-a3df-4d85-9a01-0f77f737db9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:56.153142 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ff794-a3df-4d85-9a01-0f77f737db9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:56.153751 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ff794-a3df-4d85-9a01-0f77f737db9d admin admin] PATH_INFO: `/v3/projects/f738d35665924c8fa493cd0624d70d87/users/de941a2350764cf09a7644b58dac1986/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:56.174524 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ff794-a3df-4d85-9a01-0f77f737db9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f738d35665924c8fa493cd0624d70d87, user_id=de941a2350764cf09a7644b58dac1986, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:56.180061 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350e548-8bd4-44bf-aae6-fa8a6d87581d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:56.182102 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ff794-a3df-4d85-9a01-0f77f737db9d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:56.182918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f350e548-8bd4-44bf-aae6-fa8a6d87581d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:56.202080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1016/2045] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:56 2022] PUT /identity/v3/projects/f738d35665924c8fa493cd0624d70d87/users/de941a2350764cf09a7644b58dac1986/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:56.206992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350e548-8bd4-44bf-aae6-fa8a6d87581d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:56.213421 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c44012-09c8-4e69-bc1b-a997e68c8081 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:56.213733 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c44012-09c8-4e69-bc1b-a997e68c8081 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:56.214102 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c44012-09c8-4e69-bc1b-a997e68c8081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:56.246269 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-21c44012-09c8-4e69-bc1b-a997e68c8081 None None] MFA Rules not processed for user `de941a2350764cf09a7644b58dac1986`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:56.248755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-21c44012-09c8-4e69-bc1b-a997e68c8081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:56.280012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418771e0-0769-4f0e-8824-fc8249c01051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:56.280716 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418771e0-0769-4f0e-8824-fc8249c01051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:56.280990 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418771e0-0769-4f0e-8824-fc8249c01051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:56.281252 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418771e0-0769-4f0e-8824-fc8249c01051 admin admin] PATH_INFO: `/v3/projects/4504af15ad63432f89a3a4f3bcdffd08` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:56.282526 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418771e0-0769-4f0e-8824-fc8249c01051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4504af15ad63432f89a3a4f3bcdffd08)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:56.284429 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418771e0-0769-4f0e-8824-fc8249c01051 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:56.296392 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:56.335639 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1017/2046] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:56.337922 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c44012-09c8-4e69-bc1b-a997e68c8081 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:56.340965 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-418771e0-0769-4f0e-8824-fc8249c01051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4504af15ad63432f89a3a4f3bcdffd08', 'request_id': 'req-418771e0-0769-4f0e-8824-fc8249c01051'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:56.348908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-418771e0-0769-4f0e-8824-fc8249c01051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4504af15ad63432f89a3a4f3bcdffd08', 'request_id': 'req-418771e0-0769-4f0e-8824-fc8249c01051'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:56.354461 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c44012-09c8-4e69-bc1b-a997e68c8081 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:56.358312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-418771e0-0769-4f0e-8824-fc8249c01051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4504af15ad63432f89a3a4f3bcdffd08', 'request_id': 'req-418771e0-0769-4f0e-8824-fc8249c01051'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:56.376226 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-418771e0-0769-4f0e-8824-fc8249c01051 admin admin] The token cache is being invalidate because project 4504af15ad63432f89a3a4f3bcdffd08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:56.376635 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-418771e0-0769-4f0e-8824-fc8249c01051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:56.377341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-418771e0-0769-4f0e-8824-fc8249c01051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:56.378922 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1030/2047] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:56 2022] DELETE /identity/v3/projects/4504af15ad63432f89a3a4f3bcdffd08 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:09:56.384111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d12e4-11ef-43a7-8c03-56d9cece042a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:56.384615 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d12e4-11ef-43a7-8c03-56d9cece042a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:56.384962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d12e4-11ef-43a7-8c03-56d9cece042a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:56.405821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-025d12e4-11ef-43a7-8c03-56d9cece042a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:56.407022 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-025d12e4-11ef-43a7-8c03-56d9cece042a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:56.424438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f6d55-e767-47f8-8563-4ef48269637a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:56.425219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f6d55-e767-47f8-8563-4ef48269637a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:56.425652 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f6d55-e767-47f8-8563-4ef48269637a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:56.426115 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f6d55-e767-47f8-8563-4ef48269637a admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:56.426869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f6d55-e767-47f8-8563-4ef48269637a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:56.428988 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f6d55-e767-47f8-8563-4ef48269637a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:56.462138 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1018/2048] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:56 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:56.468426 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f6d55-e767-47f8-8563-4ef48269637a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:56.470135 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-358f6d55-e767-47f8-8563-4ef48269637a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:56.473561 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1031/2049] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:56.480973 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71427ce-ef26-4de9-9d7d-3fd12e2ff562 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:56.481308 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71427ce-ef26-4de9-9d7d-3fd12e2ff562 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:56.481703 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71427ce-ef26-4de9-9d7d-3fd12e2ff562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:56.503675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e71427ce-ef26-4de9-9d7d-3fd12e2ff562 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:56.504878 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e71427ce-ef26-4de9-9d7d-3fd12e2ff562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:56.546208 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:56.560654 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f6d55-e767-47f8-8563-4ef48269637a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:56.565990 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ebba9-6ab2-413f-991d-67d5dbf0d6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:56.566697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ebba9-6ab2-413f-991d-67d5dbf0d6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:56.567061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ebba9-6ab2-413f-991d-67d5dbf0d6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:56.567435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ebba9-6ab2-413f-991d-67d5dbf0d6c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:56.568153 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ebba9-6ab2-413f-991d-67d5dbf0d6c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:56.570966 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ebba9-6ab2-413f-991d-67d5dbf0d6c7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:56.606434 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1019/2050] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:56 2022] POST /identity/v3/users => generated 299 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:56.609778 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ebba9-6ab2-413f-991d-67d5dbf0d6c7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:56.617955 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1032/2051] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:56.621848 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71427ce-ef26-4de9-9d7d-3fd12e2ff562 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:56.627788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ebba9-6ab2-413f-991d-67d5dbf0d6c7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:56.634910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb8786-5c66-4e57-84ac-c668a8f77cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:56.635561 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb8786-5c66-4e57-84ac-c668a8f77cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:56.635838 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb8786-5c66-4e57-84ac-c668a8f77cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:56.636525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb8786-5c66-4e57-84ac-c668a8f77cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:56.636623 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71427ce-ef26-4de9-9d7d-3fd12e2ff562 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:56.636808 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb8786-5c66-4e57-84ac-c668a8f77cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:56.638422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb8786-5c66-4e57-84ac-c668a8f77cf7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:56.641928 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8a85d-e207-4cbb-b719-1908e4912ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:56.642322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8a85d-e207-4cbb-b719-1908e4912ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:56.642605 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8a85d-e207-4cbb-b719-1908e4912ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:56.642873 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8a85d-e207-4cbb-b719-1908e4912ac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:56.643553 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8a85d-e207-4cbb-b719-1908e4912ac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:09:56.643851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8a85d-e207-4cbb-b719-1908e4912ac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:56.645611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8a85d-e207-4cbb-b719-1908e4912ac1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:56.660628 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1020/2052] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:56.665095 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb8786-5c66-4e57-84ac-c668a8f77cf7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:56.678200 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb8786-5c66-4e57-84ac-c668a8f77cf7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:56.686557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1033/2053] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 07:09:56.689162 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0d853-9b08-4626-a55a-6849bb648a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:56.690105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0d853-9b08-4626-a55a-6849bb648a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:56.690105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0d853-9b08-4626-a55a-6849bb648a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:56.690371 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0d853-9b08-4626-a55a-6849bb648a7c admin admin] PATH_INFO: `/v3/projects/ff83e3121c9e41a28afdd97c15ee98dc/users/366e8f725066460cb8589954b548e50d/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:56.692060 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8a85d-e207-4cbb-b719-1908e4912ac1 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:56.704679 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8a85d-e207-4cbb-b719-1908e4912ac1 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:56.718373 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0d853-9b08-4626-a55a-6849bb648a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff83e3121c9e41a28afdd97c15ee98dc, user_id=366e8f725066460cb8589954b548e50d, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:56.720663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1022e6-d1ae-4fdc-8b55-42fa7e84b119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:56.721330 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1022e6-d1ae-4fdc-8b55-42fa7e84b119 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:56.721558 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1022e6-d1ae-4fdc-8b55-42fa7e84b119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:56.721825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1022e6-d1ae-4fdc-8b55-42fa7e84b119 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:56.722867 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0d853-9b08-4626-a55a-6849bb648a7c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:56.723365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1022e6-d1ae-4fdc-8b55-42fa7e84b119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:56.725475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1022e6-d1ae-4fdc-8b55-42fa7e84b119 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:56.762548 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1021/2054] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:56 2022] PUT /identity/v3/projects/ff83e3121c9e41a28afdd97c15ee98dc/users/366e8f725066460cb8589954b548e50d/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:09:56.766618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0d853-9b08-4626-a55a-6849bb648a7c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:56.784212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1034/2055] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:56 2022] POST /identity/v3/projects => generated 361 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:56.787858 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1022e6-d1ae-4fdc-8b55-42fa7e84b119 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:56.808222 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:56.946553 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1022e6-d1ae-4fdc-8b55-42fa7e84b119 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:56.961511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093a337-4fc8-495e-99e8-ed12c805d93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:56.962124 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093a337-4fc8-495e-99e8-ed12c805d93b admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:56.962400 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093a337-4fc8-495e-99e8-ed12c805d93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:56.962804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093a337-4fc8-495e-99e8-ed12c805d93b admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:56.963469 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093a337-4fc8-495e-99e8-ed12c805d93b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:56.965355 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093a337-4fc8-495e-99e8-ed12c805d93b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:56.969295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0d853-9b08-4626-a55a-6849bb648a7c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:56.983862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d62aaf-1892-41e9-958c-bf139b5de8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:56.984472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d62aaf-1892-41e9-958c-bf139b5de8df admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:56.984742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d62aaf-1892-41e9-958c-bf139b5de8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:56.985017 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d62aaf-1892-41e9-958c-bf139b5de8df admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:56.986028 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d62aaf-1892-41e9-958c-bf139b5de8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:56.990507 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d62aaf-1892-41e9-958c-bf139b5de8df admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:57.011689 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1035/2056] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:56 2022] POST /identity/v3/users => generated 281 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:57.019459 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1022/2057] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:57.020093 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093a337-4fc8-495e-99e8-ed12c805d93b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:57.023377 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d62aaf-1892-41e9-958c-bf139b5de8df admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:57.040340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093a337-4fc8-495e-99e8-ed12c805d93b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:57.046167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dca7d7-41e0-439d-be0f-7e1fb9b8b46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:57.046620 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d62aaf-1892-41e9-958c-bf139b5de8df admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:57.046828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dca7d7-41e0-439d-be0f-7e1fb9b8b46d admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:57.047134 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dca7d7-41e0-439d-be0f-7e1fb9b8b46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:57.047415 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dca7d7-41e0-439d-be0f-7e1fb9b8b46d admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:57.048143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dca7d7-41e0-439d-be0f-7e1fb9b8b46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:57.050245 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dca7d7-41e0-439d-be0f-7e1fb9b8b46d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:57.066476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214337c-0116-4965-b94d-a5246f2e99e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:57.067436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214337c-0116-4965-b94d-a5246f2e99e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:57.067882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214337c-0116-4965-b94d-a5246f2e99e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:57.068160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214337c-0116-4965-b94d-a5246f2e99e2 admin admin] PATH_INFO: `/v3/projects/ff83e3121c9e41a28afdd97c15ee98dc/users/366e8f725066460cb8589954b548e50d/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:57.072004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214337c-0116-4965-b94d-a5246f2e99e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff83e3121c9e41a28afdd97c15ee98dc, user_id=366e8f725066460cb8589954b548e50d, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:57.072746 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1036/2058] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:57.076821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dca7d7-41e0-439d-be0f-7e1fb9b8b46d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:57.078286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214337c-0116-4965-b94d-a5246f2e99e2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:57.095201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1023/2059] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:57 2022] PUT /identity/v3/projects/ff83e3121c9e41a28afdd97c15ee98dc/users/366e8f725066460cb8589954b548e50d/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:57.095715 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dca7d7-41e0-439d-be0f-7e1fb9b8b46d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:57.107022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30447f4f-5900-4bbe-b511-acbfae84f273 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:57.107354 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30447f4f-5900-4bbe-b511-acbfae84f273 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:57.107627 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30447f4f-5900-4bbe-b511-acbfae84f273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:57.188212 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-30447f4f-5900-4bbe-b511-acbfae84f273 None None] MFA Rules not processed for user `366e8f725066460cb8589954b548e50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:57.189450 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-30447f4f-5900-4bbe-b511-acbfae84f273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:57.223188 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163069fe-fbc1-499d-a536-479c53142d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:57.224104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163069fe-fbc1-499d-a536-479c53142d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:57.224655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163069fe-fbc1-499d-a536-479c53142d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:57.225065 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163069fe-fbc1-499d-a536-479c53142d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:57.227605 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163069fe-fbc1-499d-a536-479c53142d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:57.230140 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163069fe-fbc1-499d-a536-479c53142d41 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:57.246376 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1037/2060] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:09:57.247894 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163069fe-fbc1-499d-a536-479c53142d41 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:57.260972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163069fe-fbc1-499d-a536-479c53142d41 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:57.270074 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98e294-dbe2-4807-b265-5371749ba004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:57.270856 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98e294-dbe2-4807-b265-5371749ba004 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:57.271497 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98e294-dbe2-4807-b265-5371749ba004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:57.271618 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98e294-dbe2-4807-b265-5371749ba004 admin admin] PATH_INFO: `/v3/projects/a48d8963e9e144f085b90ea536203ff3/users/6b5f1595b87840c5a1564e809454b1f8/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:57.279534 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1024/2061] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:57.290781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30447f4f-5900-4bbe-b511-acbfae84f273 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:57.290924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98e294-dbe2-4807-b265-5371749ba004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a48d8963e9e144f085b90ea536203ff3, user_id=6b5f1595b87840c5a1564e809454b1f8, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:57.292134 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-30447f4f-5900-4bbe-b511-acbfae84f273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:57.293785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98e294-dbe2-4807-b265-5371749ba004 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:57.308690 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1038/2062] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:57 2022] PUT /identity/v3/projects/a48d8963e9e144f085b90ea536203ff3/users/6b5f1595b87840c5a1564e809454b1f8/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:57.312170 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:57.320217 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25db19-336f-476f-bb88-7b3eb283056a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:57.320659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25db19-336f-476f-bb88-7b3eb283056a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:57.321002 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25db19-336f-476f-bb88-7b3eb283056a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:57.354144 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-da25db19-336f-476f-bb88-7b3eb283056a None None] MFA Rules not processed for user `6b5f1595b87840c5a1564e809454b1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:57.355471 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-da25db19-336f-476f-bb88-7b3eb283056a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:57.357161 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30447f4f-5900-4bbe-b511-acbfae84f273 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:57.405036 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:57.407943 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648071f-2ddf-4ef0-ac16-7260d361a1ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:57.408550 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648071f-2ddf-4ef0-ac16-7260d361a1ee service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:57.408872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648071f-2ddf-4ef0-ac16-7260d361a1ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:57.409312 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648071f-2ddf-4ef0-ac16-7260d361a1ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:57.427870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1039/2063] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:57.485260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648071f-2ddf-4ef0-ac16-7260d361a1ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:57.487234 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648071f-2ddf-4ef0-ac16-7260d361a1ee service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:57.505756 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1025/2064] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:09:57.548350 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25db19-336f-476f-bb88-7b3eb283056a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:57.558572 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25db19-336f-476f-bb88-7b3eb283056a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:57.563849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648071f-2ddf-4ef0-ac16-7260d361a1ee service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:57.565113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6f360-5582-4ddd-9d03-68281451b431 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:57.565269 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0648071f-2ddf-4ef0-ac16-7260d361a1ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:57.565845 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6f360-5582-4ddd-9d03-68281451b431 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:57.566182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6f360-5582-4ddd-9d03-68281451b431 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:57.566526 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6f360-5582-4ddd-9d03-68281451b431 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:57.576612 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6f360-5582-4ddd-9d03-68281451b431 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:57.578102 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6f360-5582-4ddd-9d03-68281451b431 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:57.587815 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1040/2065] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:57.603900 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6f360-5582-4ddd-9d03-68281451b431 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:57.649865 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648071f-2ddf-4ef0-ac16-7260d361a1ee service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:57.654581 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed3246-2fe0-4617-831a-a98b57abe479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:57.655244 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed3246-2fe0-4617-831a-a98b57abe479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:57.655521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed3246-2fe0-4617-831a-a98b57abe479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:57.655792 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed3246-2fe0-4617-831a-a98b57abe479 admin admin] PATH_INFO: `/v3/users/d851c46a6faa426ea70e17a084f79d5e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:57.656977 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed3246-2fe0-4617-831a-a98b57abe479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d851c46a6faa426ea70e17a084f79d5e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:57.658909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed3246-2fe0-4617-831a-a98b57abe479 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:57.680258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6f360-5582-4ddd-9d03-68281451b431 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:57.685936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:57.686279 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61056fa8-2fe7-48cf-a499-f9d13ed9b3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:57.687229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61056fa8-2fe7-48cf-a499-f9d13ed9b3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:57.687592 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61056fa8-2fe7-48cf-a499-f9d13ed9b3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:57.687887 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61056fa8-2fe7-48cf-a499-f9d13ed9b3c6 admin admin] PATH_INFO: `/v3/users/6b5f1595b87840c5a1564e809454b1f8` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:57.689361 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61056fa8-2fe7-48cf-a499-f9d13ed9b3c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b5f1595b87840c5a1564e809454b1f8)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:57.691407 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61056fa8-2fe7-48cf-a499-f9d13ed9b3c6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:57.716347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c7ed3246-2fe0-4617-831a-a98b57abe479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd851c46a6faa426ea70e17a084f79d5e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:57.718558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c7ed3246-2fe0-4617-831a-a98b57abe479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd851c46a6faa426ea70e17a084f79d5e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:57.722084 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c7ed3246-2fe0-4617-831a-a98b57abe479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd851c46a6faa426ea70e17a084f79d5e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:57.733981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c7ed3246-2fe0-4617-831a-a98b57abe479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd851c46a6faa426ea70e17a084f79d5e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:57.744328 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c7ed3246-2fe0-4617-831a-a98b57abe479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd851c46a6faa426ea70e17a084f79d5e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:57.755488 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-61056fa8-2fe7-48cf-a499-f9d13ed9b3c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b5f1595b87840c5a1564e809454b1f8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:57.764925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-61056fa8-2fe7-48cf-a499-f9d13ed9b3c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b5f1595b87840c5a1564e809454b1f8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:57.765885 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-61056fa8-2fe7-48cf-a499-f9d13ed9b3c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b5f1595b87840c5a1564e809454b1f8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:57.766088 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1026/2066] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:57 2022] DELETE /identity/v3/users/d851c46a6faa426ea70e17a084f79d5e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:09:57.770299 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa61b1-c02f-4580-b2fb-9871d7720660 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:57.770582 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa61b1-c02f-4580-b2fb-9871d7720660 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:57.770866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa61b1-c02f-4580-b2fb-9871d7720660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:57.783886 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-61056fa8-2fe7-48cf-a499-f9d13ed9b3c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b5f1595b87840c5a1564e809454b1f8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:57.791821 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6aaa61b1-c02f-4580-b2fb-9871d7720660 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:57.793027 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-61056fa8-2fe7-48cf-a499-f9d13ed9b3c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b5f1595b87840c5a1564e809454b1f8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:57.793142 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6aaa61b1-c02f-4580-b2fb-9871d7720660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:57.800092 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1041/2067] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:57 2022] DELETE /identity/v3/users/6b5f1595b87840c5a1564e809454b1f8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:09:57.804375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5dbf3-8637-478a-b518-d3e767bac9cb None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:57.804720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5dbf3-8637-478a-b518-d3e767bac9cb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:57.805001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5dbf3-8637-478a-b518-d3e767bac9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:57.832021 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6dd5dbf3-8637-478a-b518-d3e767bac9cb None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:57.833589 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6dd5dbf3-8637-478a-b518-d3e767bac9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:57.871211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1027/2068] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:57.882391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa61b1-c02f-4580-b2fb-9871d7720660 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:57.884575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6aaa61b1-c02f-4580-b2fb-9871d7720660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:57.908486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:57.953921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1042/2069] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:57.956295 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5dbf3-8637-478a-b518-d3e767bac9cb None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:57.961567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6dd5dbf3-8637-478a-b518-d3e767bac9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:58.000695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa61b1-c02f-4580-b2fb-9871d7720660 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:58.085634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5dbf3-8637-478a-b518-d3e767bac9cb None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:58.091019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b2738-e392-4889-baca-47f0deac8f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:58.091838 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b2738-e392-4889-baca-47f0deac8f46 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:58.092139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b2738-e392-4889-baca-47f0deac8f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:58.092406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b2738-e392-4889-baca-47f0deac8f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:58.104387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b2738-e392-4889-baca-47f0deac8f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:58.105807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b2738-e392-4889-baca-47f0deac8f46 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:58.107614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84609f81-0383-4e9d-b7bb-59e263b1acdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:58.108417 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84609f81-0383-4e9d-b7bb-59e263b1acdf service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:58.108862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84609f81-0383-4e9d-b7bb-59e263b1acdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:58.109270 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84609f81-0383-4e9d-b7bb-59e263b1acdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:58.119970 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1043/2070] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:58.150036 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84609f81-0383-4e9d-b7bb-59e263b1acdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:58.156742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84609f81-0383-4e9d-b7bb-59e263b1acdf service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:58.166005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:58.177357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1028/2071] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:09:58.264702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b2738-e392-4889-baca-47f0deac8f46 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:58.266397 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-195b2738-e392-4889-baca-47f0deac8f46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:58.283478 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b2738-e392-4889-baca-47f0deac8f46 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:58.291757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea8a56-e984-413c-b78f-8876a8ff2242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:58.292780 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea8a56-e984-413c-b78f-8876a8ff2242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:58.293302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea8a56-e984-413c-b78f-8876a8ff2242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:58.293707 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea8a56-e984-413c-b78f-8876a8ff2242 admin admin] PATH_INFO: `/v3/users/6b55ae7482564faaa1d61d143830d3a3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:58.295263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea8a56-e984-413c-b78f-8876a8ff2242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b55ae7482564faaa1d61d143830d3a3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:58.297370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea8a56-e984-413c-b78f-8876a8ff2242 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:58.308568 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84609f81-0383-4e9d-b7bb-59e263b1acdf service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:58.310296 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-84609f81-0383-4e9d-b7bb-59e263b1acdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:58.364375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-baea8a56-e984-413c-b78f-8876a8ff2242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b55ae7482564faaa1d61d143830d3a3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:58.376469 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-baea8a56-e984-413c-b78f-8876a8ff2242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b55ae7482564faaa1d61d143830d3a3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:58.383112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-baea8a56-e984-413c-b78f-8876a8ff2242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b55ae7482564faaa1d61d143830d3a3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:58.404389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-baea8a56-e984-413c-b78f-8876a8ff2242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b55ae7482564faaa1d61d143830d3a3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:58.413927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-baea8a56-e984-413c-b78f-8876a8ff2242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b55ae7482564faaa1d61d143830d3a3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:58.417975 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84609f81-0383-4e9d-b7bb-59e263b1acdf service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:58.421845 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1044/2072] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:58 2022] DELETE /identity/v3/users/6b55ae7482564faaa1d61d143830d3a3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:58.425160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ad4fb-7f40-4530-b995-52a87f932a47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:58.425160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ad4fb-7f40-4530-b995-52a87f932a47 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:58.425160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ad4fb-7f40-4530-b995-52a87f932a47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:58.425421 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ad4fb-7f40-4530-b995-52a87f932a47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:58.427502 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebfd05-96aa-41af-9162-51f455b99257 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:58.427667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-859ad4fb-7f40-4530-b995-52a87f932a47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:58.428114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebfd05-96aa-41af-9162-51f455b99257 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:58.429310 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebfd05-96aa-41af-9162-51f455b99257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:58.455388 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-46ebfd05-96aa-41af-9162-51f455b99257 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:58.457232 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-46ebfd05-96aa-41af-9162-51f455b99257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:58.539893 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ad4fb-7f40-4530-b995-52a87f932a47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:58.544695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ad4fb-7f40-4530-b995-52a87f932a47 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:58.579313 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1045/2073] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:58.585985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1029/2074] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:09:58.607547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebfd05-96aa-41af-9162-51f455b99257 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:58.609695 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-46ebfd05-96aa-41af-9162-51f455b99257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:58.635656 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:58.792996 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebfd05-96aa-41af-9162-51f455b99257 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:58.801118 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59784d-9f0b-42f3-b938-68439cdc2050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:58.802145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59784d-9f0b-42f3-b938-68439cdc2050 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:58.802604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59784d-9f0b-42f3-b938-68439cdc2050 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:58.803056 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59784d-9f0b-42f3-b938-68439cdc2050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:58.805302 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ad4fb-7f40-4530-b995-52a87f932a47 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:58.807396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-859ad4fb-7f40-4530-b995-52a87f932a47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:58.830228 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59784d-9f0b-42f3-b938-68439cdc2050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:58.832218 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59784d-9f0b-42f3-b938-68439cdc2050 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:58.833375 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ad4fb-7f40-4530-b995-52a87f932a47 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:58.846908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c310f-af39-49a1-b80c-2b1d102ae6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:58.849685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c310f-af39-49a1-b80c-2b1d102ae6a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:58.849992 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c310f-af39-49a1-b80c-2b1d102ae6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:58.851677 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c310f-af39-49a1-b80c-2b1d102ae6a3 admin admin] PATH_INFO: `/v3/projects/a48d8963e9e144f085b90ea536203ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:58.854150 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c310f-af39-49a1-b80c-2b1d102ae6a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a48d8963e9e144f085b90ea536203ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:58.856326 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1046/2075] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:09:58.856927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c310f-af39-49a1-b80c-2b1d102ae6a3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:58.874863 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59784d-9f0b-42f3-b938-68439cdc2050 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:58.879839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0e59784d-9f0b-42f3-b938-68439cdc2050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:58.906848 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59784d-9f0b-42f3-b938-68439cdc2050 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:58.927000 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-609c310f-af39-49a1-b80c-2b1d102ae6a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a48d8963e9e144f085b90ea536203ff3', 'request_id': 'req-609c310f-af39-49a1-b80c-2b1d102ae6a3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:58.937639 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-609c310f-af39-49a1-b80c-2b1d102ae6a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a48d8963e9e144f085b90ea536203ff3', 'request_id': 'req-609c310f-af39-49a1-b80c-2b1d102ae6a3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:58.947320 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-609c310f-af39-49a1-b80c-2b1d102ae6a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a48d8963e9e144f085b90ea536203ff3', 'request_id': 'req-609c310f-af39-49a1-b80c-2b1d102ae6a3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:58.969856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-609c310f-af39-49a1-b80c-2b1d102ae6a3 admin admin] The token cache is being invalidate because project a48d8963e9e144f085b90ea536203ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:58.970326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-609c310f-af39-49a1-b80c-2b1d102ae6a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:58.971018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-609c310f-af39-49a1-b80c-2b1d102ae6a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:58.976922 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1030/2076] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:58 2022] DELETE /identity/v3/projects/a48d8963e9e144f085b90ea536203ff3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:58.978958 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d130c-7f11-4a3b-9bdb-c80a4480e2a4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:58.978958 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d130c-7f11-4a3b-9bdb-c80a4480e2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:58.979161 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d130c-7f11-4a3b-9bdb-c80a4480e2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:59.023213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68f717-79db-4da2-baf2-686c9893c73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:59.024182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68f717-79db-4da2-baf2-686c9893c73f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:59.024516 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68f717-79db-4da2-baf2-686c9893c73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:59.024797 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68f717-79db-4da2-baf2-686c9893c73f admin admin] PATH_INFO: `/v3/projects/a509860d647e4672aea395738e47a19f` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:59.026138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68f717-79db-4da2-baf2-686c9893c73f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a509860d647e4672aea395738e47a19f)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:59.029419 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68f717-79db-4da2-baf2-686c9893c73f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:59.039798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-168d130c-7f11-4a3b-9bdb-c80a4480e2a4 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:59.041051 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-168d130c-7f11-4a3b-9bdb-c80a4480e2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:59.067138 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1031/2077] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:59.076108 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67730e4e-cf33-4fc2-a5f7-68b217cebd3f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:59.076677 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67730e4e-cf33-4fc2-a5f7-68b217cebd3f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:59.077140 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67730e4e-cf33-4fc2-a5f7-68b217cebd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:59.113685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-67730e4e-cf33-4fc2-a5f7-68b217cebd3f None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:59.116839 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-67730e4e-cf33-4fc2-a5f7-68b217cebd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:59.130042 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2d68f717-79db-4da2-baf2-686c9893c73f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a509860d647e4672aea395738e47a19f', 'request_id': 'req-2d68f717-79db-4da2-baf2-686c9893c73f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:59.140920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2d68f717-79db-4da2-baf2-686c9893c73f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a509860d647e4672aea395738e47a19f', 'request_id': 'req-2d68f717-79db-4da2-baf2-686c9893c73f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:59.152446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2d68f717-79db-4da2-baf2-686c9893c73f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a509860d647e4672aea395738e47a19f', 'request_id': 'req-2d68f717-79db-4da2-baf2-686c9893c73f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:59.152807 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:59.172212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2d68f717-79db-4da2-baf2-686c9893c73f admin admin] The token cache is being invalidate because project a509860d647e4672aea395738e47a19f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:59.172793 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2d68f717-79db-4da2-baf2-686c9893c73f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:59.174787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2d68f717-79db-4da2-baf2-686c9893c73f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:59.177176 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1047/2078] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:58 2022] DELETE /identity/v3/projects/a509860d647e4672aea395738e47a19f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:59.182481 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68f717-79db-4da2-baf2-686c9893c73f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:59.186996 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2d68f717-79db-4da2-baf2-686c9893c73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:59.195718 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1032/2079] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:59.200070 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67730e4e-cf33-4fc2-a5f7-68b217cebd3f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:59.208832 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68f717-79db-4da2-baf2-686c9893c73f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:59.209162 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67730e4e-cf33-4fc2-a5f7-68b217cebd3f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:59.215152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7d449-61b0-4084-afe8-2a254d29123e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:59.215789 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7d449-61b0-4084-afe8-2a254d29123e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:59.215972 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ce0d5-d104-474d-9713-224c789b03ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:59.216083 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7d449-61b0-4084-afe8-2a254d29123e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:59.216328 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7d449-61b0-4084-afe8-2a254d29123e admin admin] PATH_INFO: `/v3/users/9ae5f1e6ebba4a3badc4f1b0f8f21515` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:59.217207 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ce0d5-d104-474d-9713-224c789b03ad admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:59.217476 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7d449-61b0-4084-afe8-2a254d29123e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae5f1e6ebba4a3badc4f1b0f8f21515)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:59.217586 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ce0d5-d104-474d-9713-224c789b03ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:59.217843 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ce0d5-d104-474d-9713-224c789b03ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:59.218625 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ce0d5-d104-474d-9713-224c789b03ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:09:59.218950 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ce0d5-d104-474d-9713-224c789b03ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:59.219431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7d449-61b0-4084-afe8-2a254d29123e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:59.220544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ce0d5-d104-474d-9713-224c789b03ad admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:59.239149 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1033/2080] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 07:09:59.242518 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ce0d5-d104-474d-9713-224c789b03ad admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:59.255037 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ce0d5-d104-474d-9713-224c789b03ad admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:59.261775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fab44-ee94-41f1-b0cd-1437d5b3956f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:59.262391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fab44-ee94-41f1-b0cd-1437d5b3956f admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:59.262696 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fab44-ee94-41f1-b0cd-1437d5b3956f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:59.262968 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fab44-ee94-41f1-b0cd-1437d5b3956f admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:59.263717 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fab44-ee94-41f1-b0cd-1437d5b3956f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:59.265705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fab44-ee94-41f1-b0cd-1437d5b3956f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:59.273198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:59.287786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-70d7d449-61b0-4084-afe8-2a254d29123e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae5f1e6ebba4a3badc4f1b0f8f21515'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:59.299061 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-70d7d449-61b0-4084-afe8-2a254d29123e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae5f1e6ebba4a3badc4f1b0f8f21515'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:59.300104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-70d7d449-61b0-4084-afe8-2a254d29123e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae5f1e6ebba4a3badc4f1b0f8f21515'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:59.310914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1034/2081] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:09:59 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:09:59.310914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fab44-ee94-41f1-b0cd-1437d5b3956f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:59.310914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2d0fab44-ee94-41f1-b0cd-1437d5b3956f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:59.324292 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-70d7d449-61b0-4084-afe8-2a254d29123e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae5f1e6ebba4a3badc4f1b0f8f21515'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:59.332410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-70d7d449-61b0-4084-afe8-2a254d29123e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae5f1e6ebba4a3badc4f1b0f8f21515'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:59.343642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1048/2082] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:09:59 2022] DELETE /identity/v3/users/9ae5f1e6ebba4a3badc4f1b0f8f21515 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:59.344619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7d449-61b0-4084-afe8-2a254d29123e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:59.346136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-70d7d449-61b0-4084-afe8-2a254d29123e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:59.384981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fab44-ee94-41f1-b0cd-1437d5b3956f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:59.455211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7d449-61b0-4084-afe8-2a254d29123e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:59.462395 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a4e88-1f84-449c-9848-6841bc2b10fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:59.463167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a4e88-1f84-449c-9848-6841bc2b10fa admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:59.463644 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a4e88-1f84-449c-9848-6841bc2b10fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:59.463948 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a4e88-1f84-449c-9848-6841bc2b10fa admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:59.464584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a4e88-1f84-449c-9848-6841bc2b10fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:59.466966 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a4e88-1f84-449c-9848-6841bc2b10fa admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:59.467718 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520ae85-768d-4df4-830f-c2b0a6e36f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:59.468505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520ae85-768d-4df4-830f-c2b0a6e36f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:59.468852 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520ae85-768d-4df4-830f-c2b0a6e36f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:59.469193 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520ae85-768d-4df4-830f-c2b0a6e36f43 admin admin] PATH_INFO: `/v3/projects/ea1b559b2318440992e08f7c6c73a652` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:59.470493 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520ae85-768d-4df4-830f-c2b0a6e36f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea1b559b2318440992e08f7c6c73a652)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:59.473011 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520ae85-768d-4df4-830f-c2b0a6e36f43 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:59.501063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1049/2083] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:09:59 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:09:59.505024 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a4e88-1f84-449c-9848-6841bc2b10fa admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:59.529948 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a4e88-1f84-449c-9848-6841bc2b10fa admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:59.540591 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:59.548728 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3520ae85-768d-4df4-830f-c2b0a6e36f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea1b559b2318440992e08f7c6c73a652', 'request_id': 'req-3520ae85-768d-4df4-830f-c2b0a6e36f43'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:59.560715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3520ae85-768d-4df4-830f-c2b0a6e36f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea1b559b2318440992e08f7c6c73a652', 'request_id': 'req-3520ae85-768d-4df4-830f-c2b0a6e36f43'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:59.567731 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3520ae85-768d-4df4-830f-c2b0a6e36f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea1b559b2318440992e08f7c6c73a652', 'request_id': 'req-3520ae85-768d-4df4-830f-c2b0a6e36f43'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:59.584131 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3520ae85-768d-4df4-830f-c2b0a6e36f43 admin admin] The token cache is being invalidate because project ea1b559b2318440992e08f7c6c73a652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:09:59.584428 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3520ae85-768d-4df4-830f-c2b0a6e36f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:59.585328 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3520ae85-768d-4df4-830f-c2b0a6e36f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:59.591561 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1035/2084] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:59 2022] DELETE /identity/v3/projects/ea1b559b2318440992e08f7c6c73a652 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:59.593380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f01fb1-b36d-43b5-8bac-6d0afa81726d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:59.593675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f01fb1-b36d-43b5-8bac-6d0afa81726d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:59.593954 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f01fb1-b36d-43b5-8bac-6d0afa81726d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:59.624025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-71f01fb1-b36d-43b5-8bac-6d0afa81726d None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:59.625373 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-71f01fb1-b36d-43b5-8bac-6d0afa81726d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:59.667822 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5942c-d80a-4a53-9216-84c970f16aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:59.670398 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5942c-d80a-4a53-9216-84c970f16aac admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:59.670680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5942c-d80a-4a53-9216-84c970f16aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:59.670951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5942c-d80a-4a53-9216-84c970f16aac admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:59.671644 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5942c-d80a-4a53-9216-84c970f16aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:59.677900 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5942c-d80a-4a53-9216-84c970f16aac admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:59.701510 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1050/2085] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:59.705921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5942c-d80a-4a53-9216-84c970f16aac admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:59.707695 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-18a5942c-d80a-4a53-9216-84c970f16aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:59.721776 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5942c-d80a-4a53-9216-84c970f16aac admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:59.729323 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b4293-cbd1-4e5d-8d88-c6b409b67d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:59.729946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b4293-cbd1-4e5d-8d88-c6b409b67d53 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:59.730218 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b4293-cbd1-4e5d-8d88-c6b409b67d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:59.730644 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b4293-cbd1-4e5d-8d88-c6b409b67d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:59.731342 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b4293-cbd1-4e5d-8d88-c6b409b67d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:59.732989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b4293-cbd1-4e5d-8d88-c6b409b67d53 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:59.751924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1051/2086] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:09:59.753304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b4293-cbd1-4e5d-8d88-c6b409b67d53 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:59.765258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b4293-cbd1-4e5d-8d88-c6b409b67d53 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:59.770699 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad13b3-918b-418f-97ec-4842327176fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:59.770852 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1036/2087] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:09:59.771667 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad13b3-918b-418f-97ec-4842327176fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:59.772960 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad13b3-918b-418f-97ec-4842327176fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:59.773403 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad13b3-918b-418f-97ec-4842327176fa admin admin] PATH_INFO: `/v3/projects/486f019a176d4f5a9be5eb3360381ffb/users/53319ee454e748468474109c0b864d7a/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:59.779122 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797adba-4b40-422d-a8ad-96b973687ebd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:59.779712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797adba-4b40-422d-a8ad-96b973687ebd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:59.779944 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797adba-4b40-422d-a8ad-96b973687ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:59.793457 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad13b3-918b-418f-97ec-4842327176fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=486f019a176d4f5a9be5eb3360381ffb, user_id=53319ee454e748468474109c0b864d7a, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:59.796255 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad13b3-918b-418f-97ec-4842327176fa admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:59.810956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5797adba-4b40-422d-a8ad-96b973687ebd None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:59.813353 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5797adba-4b40-422d-a8ad-96b973687ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:59.817027 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1052/2088] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:09:59 2022] PUT /identity/v3/projects/486f019a176d4f5a9be5eb3360381ffb/users/53319ee454e748468474109c0b864d7a/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:09:59.828350 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f299c-d32f-44eb-a501-c3c306ee1bd0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:59.828627 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f299c-d32f-44eb-a501-c3c306ee1bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:59.828927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f299c-d32f-44eb-a501-c3c306ee1bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:59.837703 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:59.861753 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c44f299c-d32f-44eb-a501-c3c306ee1bd0 None None] MFA Rules not processed for user `53319ee454e748468474109c0b864d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:09:59.862942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c44f299c-d32f-44eb-a501-c3c306ee1bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:59.907283 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1037/2089] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:59.907283 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797adba-4b40-422d-a8ad-96b973687ebd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:59.907817 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5797adba-4b40-422d-a8ad-96b973687ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:59.924474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797adba-4b40-422d-a8ad-96b973687ebd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:59.929584 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aa88c-5658-49ce-bc8e-6abad06c2975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:59.930312 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aa88c-5658-49ce-bc8e-6abad06c2975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:59.930659 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aa88c-5658-49ce-bc8e-6abad06c2975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:59.931006 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aa88c-5658-49ce-bc8e-6abad06c2975 admin admin] PATH_INFO: `/v3/projects/ccc76a73f4fb4dc999f330386b77bf4a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:59.932241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276aa88c-5658-49ce-bc8e-6abad06c2975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc76a73f4fb4dc999f330386b77bf4a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:59.934221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276aa88c-5658-49ce-bc8e-6abad06c2975 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:59.945822 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1053/2090] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:09:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:09:59.946848 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f299c-d32f-44eb-a501-c3c306ee1bd0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:59.959327 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f299c-d32f-44eb-a501-c3c306ee1bd0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:09:59.964559 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b332a5-ecde-49e3-8631-448ebbf40ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:09:59.965166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b332a5-ecde-49e3-8631-448ebbf40ffb admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:09:59.965559 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b332a5-ecde-49e3-8631-448ebbf40ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:09:59.965909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b332a5-ecde-49e3-8631-448ebbf40ffb admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:09:59.966712 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b332a5-ecde-49e3-8631-448ebbf40ffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:09:59.967075 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b332a5-ecde-49e3-8631-448ebbf40ffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:09:59.969033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b332a5-ecde-49e3-8631-448ebbf40ffb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:09:59.981744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1054/2091] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:09:59.982681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b332a5-ecde-49e3-8631-448ebbf40ffb admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:09:59.984388 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-26b332a5-ecde-49e3-8631-448ebbf40ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:09:59.989052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-276aa88c-5658-49ce-bc8e-6abad06c2975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc76a73f4fb4dc999f330386b77bf4a', 'request_id': 'req-276aa88c-5658-49ce-bc8e-6abad06c2975'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:09:59.995471 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-276aa88c-5658-49ce-bc8e-6abad06c2975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc76a73f4fb4dc999f330386b77bf4a', 'request_id': 'req-276aa88c-5658-49ce-bc8e-6abad06c2975'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:00.000970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-276aa88c-5658-49ce-bc8e-6abad06c2975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc76a73f4fb4dc999f330386b77bf4a', 'request_id': 'req-276aa88c-5658-49ce-bc8e-6abad06c2975'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:00.010014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:00.015968 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-276aa88c-5658-49ce-bc8e-6abad06c2975 admin admin] The token cache is being invalidate because project ccc76a73f4fb4dc999f330386b77bf4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:00.016465 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-276aa88c-5658-49ce-bc8e-6abad06c2975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:00.017538 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-276aa88c-5658-49ce-bc8e-6abad06c2975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:00.019149 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1038/2092] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:09:59 2022] DELETE /identity/v3/projects/ccc76a73f4fb4dc999f330386b77bf4a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:00.019961 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aa88c-5658-49ce-bc8e-6abad06c2975 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:00.021229 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-276aa88c-5658-49ce-bc8e-6abad06c2975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:00.050228 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b332a5-ecde-49e3-8631-448ebbf40ffb admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:00.096812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aa88c-5658-49ce-bc8e-6abad06c2975 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:00.102416 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e27179-abf4-45ba-92a4-4f8499114910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:00.103040 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e27179-abf4-45ba-92a4-4f8499114910 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:00.103444 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e27179-abf4-45ba-92a4-4f8499114910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:00.103720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e27179-abf4-45ba-92a4-4f8499114910 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:00.104355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e27179-abf4-45ba-92a4-4f8499114910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:00.106566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e27179-abf4-45ba-92a4-4f8499114910 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:00.155026 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1039/2093] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:00 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:00.155026 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e27179-abf4-45ba-92a4-4f8499114910 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:00.155358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc93370-32d9-4ea9-9d14-d3f8b076fa71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:00.155469 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f8e27179-abf4-45ba-92a4-4f8499114910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:00.156036 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc93370-32d9-4ea9-9d14-d3f8b076fa71 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:00.156830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc93370-32d9-4ea9-9d14-d3f8b076fa71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:00.157200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc93370-32d9-4ea9-9d14-d3f8b076fa71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:00.161838 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ccc93370-32d9-4ea9-9d14-d3f8b076fa71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:00.228741 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e27179-abf4-45ba-92a4-4f8499114910 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:00.236052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d715d65-c5ac-4984-8047-ef581218f048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:00.237042 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d715d65-c5ac-4984-8047-ef581218f048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:00.237562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d715d65-c5ac-4984-8047-ef581218f048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:00.238039 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d715d65-c5ac-4984-8047-ef581218f048 admin admin] PATH_INFO: `/v3/users/be41a3d817e04b309d414f06e303368a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:00.239965 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d715d65-c5ac-4984-8047-ef581218f048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be41a3d817e04b309d414f06e303368a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:00.243065 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d715d65-c5ac-4984-8047-ef581218f048 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:00.263375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:00.277629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc93370-32d9-4ea9-9d14-d3f8b076fa71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:00.279292 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc93370-32d9-4ea9-9d14-d3f8b076fa71 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:00.334853 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5d715d65-c5ac-4984-8047-ef581218f048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be41a3d817e04b309d414f06e303368a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:00.339911 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5d715d65-c5ac-4984-8047-ef581218f048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be41a3d817e04b309d414f06e303368a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:00.340600 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5d715d65-c5ac-4984-8047-ef581218f048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be41a3d817e04b309d414f06e303368a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:00.344916 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1055/2094] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:09:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:00.346499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc93370-32d9-4ea9-9d14-d3f8b076fa71 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:00.354556 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5d715d65-c5ac-4984-8047-ef581218f048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be41a3d817e04b309d414f06e303368a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:00.370720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5d715d65-c5ac-4984-8047-ef581218f048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be41a3d817e04b309d414f06e303368a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:00.394283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc93370-32d9-4ea9-9d14-d3f8b076fa71 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:00.403410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1040/2095] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:00 2022] DELETE /identity/v3/users/be41a3d817e04b309d414f06e303368a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:00.408402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cec148-4f07-4fc2-b5b1-c627c16f3b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:00.409314 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cec148-4f07-4fc2-b5b1-c627c16f3b47 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:00.409755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cec148-4f07-4fc2-b5b1-c627c16f3b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:00.410103 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cec148-4f07-4fc2-b5b1-c627c16f3b47 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:00.411742 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cec148-4f07-4fc2-b5b1-c627c16f3b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:00.414582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cec148-4f07-4fc2-b5b1-c627c16f3b47 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:00.478829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1056/2096] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:00 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:00.480438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d715d65-c5ac-4984-8047-ef581218f048 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:00.481974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5d715d65-c5ac-4984-8047-ef581218f048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:00.488700 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:00.581889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d715d65-c5ac-4984-8047-ef581218f048 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:00.588776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd03c84-1e2f-4dd0-ab22-e6487ffb9fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:00.589740 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd03c84-1e2f-4dd0-ab22-e6487ffb9fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:00.589740 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd03c84-1e2f-4dd0-ab22-e6487ffb9fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:00.590006 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd03c84-1e2f-4dd0-ab22-e6487ffb9fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:00.590663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd03c84-1e2f-4dd0-ab22-e6487ffb9fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:00.593083 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd03c84-1e2f-4dd0-ab22-e6487ffb9fb4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:00.609474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1041/2097] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:00.613167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cec148-4f07-4fc2-b5b1-c627c16f3b47 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:00.630087 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cec148-4f07-4fc2-b5b1-c627c16f3b47 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:00.640295 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc7901-8dbd-4605-ab56-f822aafe61ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:00.640934 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc7901-8dbd-4605-ab56-f822aafe61ab admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:00.641546 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc7901-8dbd-4605-ab56-f822aafe61ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:00.642090 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc7901-8dbd-4605-ab56-f822aafe61ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:00.644696 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc7901-8dbd-4605-ab56-f822aafe61ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:00.648375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc7901-8dbd-4605-ab56-f822aafe61ab admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:00.670207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1057/2098] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:00.671990 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd03c84-1e2f-4dd0-ab22-e6487ffb9fb4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:00.689012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd03c84-1e2f-4dd0-ab22-e6487ffb9fb4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:00.705936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6ccef-4f45-438b-88e8-a956d9ed6c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:00.707888 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6ccef-4f45-438b-88e8-a956d9ed6c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:00.708858 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6ccef-4f45-438b-88e8-a956d9ed6c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:00.709383 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6ccef-4f45-438b-88e8-a956d9ed6c0f admin admin] PATH_INFO: `/v3/projects/798515aa210647d8adcdb2cfb2bc8ede/users/7e0a49cccc7c49f385fdfe774fec90fc/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:00.739862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6ccef-4f45-438b-88e8-a956d9ed6c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=798515aa210647d8adcdb2cfb2bc8ede, user_id=7e0a49cccc7c49f385fdfe774fec90fc, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:00.755996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6ccef-4f45-438b-88e8-a956d9ed6c0f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:00.810925 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1042/2099] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:00 2022] PUT /identity/v3/projects/798515aa210647d8adcdb2cfb2bc8ede/users/7e0a49cccc7c49f385fdfe774fec90fc/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:00.816191 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015cd83-1d1d-463c-8f8e-799b20943022 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:00.817321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015cd83-1d1d-463c-8f8e-799b20943022 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:00.817956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015cd83-1d1d-463c-8f8e-799b20943022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:00.831131 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6ccef-4f45-438b-88e8-a956d9ed6c0f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:00.836328 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6ea6ccef-4f45-438b-88e8-a956d9ed6c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:00.915707 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8015cd83-1d1d-463c-8f8e-799b20943022 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:00.922332 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8015cd83-1d1d-463c-8f8e-799b20943022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:01.052442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6ccef-4f45-438b-88e8-a956d9ed6c0f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:01.066289 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2da5e-6b28-4754-948f-b11bd9701690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:01.066942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2da5e-6b28-4754-948f-b11bd9701690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:01.067251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2da5e-6b28-4754-948f-b11bd9701690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:01.067527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2da5e-6b28-4754-948f-b11bd9701690 admin admin] PATH_INFO: `/v3/projects/f2abe0b4a77142aab41282e2b8290239` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:01.073086 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2da5e-6b28-4754-948f-b11bd9701690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2abe0b4a77142aab41282e2b8290239)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:01.075473 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2da5e-6b28-4754-948f-b11bd9701690 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:01.113515 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1058/2100] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:01.124079 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015cd83-1d1d-463c-8f8e-799b20943022 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:01.127375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8015cd83-1d1d-463c-8f8e-799b20943022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:01.158364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-22f2da5e-6b28-4754-948f-b11bd9701690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2abe0b4a77142aab41282e2b8290239', 'request_id': 'req-22f2da5e-6b28-4754-948f-b11bd9701690'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:01.165807 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-22f2da5e-6b28-4754-948f-b11bd9701690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2abe0b4a77142aab41282e2b8290239', 'request_id': 'req-22f2da5e-6b28-4754-948f-b11bd9701690'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:01.175912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-22f2da5e-6b28-4754-948f-b11bd9701690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2abe0b4a77142aab41282e2b8290239', 'request_id': 'req-22f2da5e-6b28-4754-948f-b11bd9701690'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:01.201762 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-22f2da5e-6b28-4754-948f-b11bd9701690 admin admin] The token cache is being invalidate because project f2abe0b4a77142aab41282e2b8290239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:01.202145 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-22f2da5e-6b28-4754-948f-b11bd9701690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:01.202894 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-22f2da5e-6b28-4754-948f-b11bd9701690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:01.205349 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1043/2101] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:00 2022] DELETE /identity/v3/projects/f2abe0b4a77142aab41282e2b8290239 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:01.212751 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d18d3-b959-44d2-8dbb-739ce387ea32 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:01.213033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d18d3-b959-44d2-8dbb-739ce387ea32 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:01.213346 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d18d3-b959-44d2-8dbb-739ce387ea32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:01.224027 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:01.239302 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fb0d18d3-b959-44d2-8dbb-739ce387ea32 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:01.241554 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fb0d18d3-b959-44d2-8dbb-739ce387ea32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:01.247120 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015cd83-1d1d-463c-8f8e-799b20943022 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:01.316453 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1044/2102] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:01.317789 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae072a4-9429-4f05-912d-2a3836cb41db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:01.318393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae072a4-9429-4f05-912d-2a3836cb41db service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:01.318664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae072a4-9429-4f05-912d-2a3836cb41db service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:01.318986 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae072a4-9429-4f05-912d-2a3836cb41db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:01.320739 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bae072a4-9429-4f05-912d-2a3836cb41db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:01.325794 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e892c-ec10-4f14-a8ef-0a52fa512fe1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:01.326083 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e892c-ec10-4f14-a8ef-0a52fa512fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:01.326360 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e892c-ec10-4f14-a8ef-0a52fa512fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:01.335463 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae072a4-9429-4f05-912d-2a3836cb41db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:01.337967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae072a4-9429-4f05-912d-2a3836cb41db service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:01.349817 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-393e892c-ec10-4f14-a8ef-0a52fa512fe1 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:01.350502 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1059/2103] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:10:01.351295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-393e892c-ec10-4f14-a8ef-0a52fa512fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:01.360768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1045/2104] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:01.370766 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae072a4-9429-4f05-912d-2a3836cb41db service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:01.388390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae072a4-9429-4f05-912d-2a3836cb41db service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:01.396567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1578f4-e4b1-4ec2-a24c-f1667297305a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:01.397888 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1578f4-e4b1-4ec2-a24c-f1667297305a admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:01.398362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1578f4-e4b1-4ec2-a24c-f1667297305a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:01.399448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1578f4-e4b1-4ec2-a24c-f1667297305a admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:01.400539 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1578f4-e4b1-4ec2-a24c-f1667297305a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:10:01.401031 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1578f4-e4b1-4ec2-a24c-f1667297305a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:01.403909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1578f4-e4b1-4ec2-a24c-f1667297305a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:01.441231 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1060/2105] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:10:01.447991 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e892c-ec10-4f14-a8ef-0a52fa512fe1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:01.463200 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e892c-ec10-4f14-a8ef-0a52fa512fe1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:01.470420 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b10009-9989-4cfa-b6e7-dc858aa68080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:01.471873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b10009-9989-4cfa-b6e7-dc858aa68080 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:01.471873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b10009-9989-4cfa-b6e7-dc858aa68080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:01.472216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b10009-9989-4cfa-b6e7-dc858aa68080 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:01.472777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b10009-9989-4cfa-b6e7-dc858aa68080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:01.474820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b10009-9989-4cfa-b6e7-dc858aa68080 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:01.541650 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1578f4-e4b1-4ec2-a24c-f1667297305a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:01.543284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1046/2106] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:01 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:01.552429 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1578f4-e4b1-4ec2-a24c-f1667297305a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:01.558974 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:01.638449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0a3d5-bd81-4b2e-a9f3-4b8be083426d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:01.639385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0a3d5-bd81-4b2e-a9f3-4b8be083426d admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:01.639385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0a3d5-bd81-4b2e-a9f3-4b8be083426d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:01.639716 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0a3d5-bd81-4b2e-a9f3-4b8be083426d admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:01.640363 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0a3d5-bd81-4b2e-a9f3-4b8be083426d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:01.642822 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0a3d5-bd81-4b2e-a9f3-4b8be083426d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:01.671205 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1061/2107] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:01 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:10:01.672171 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b10009-9989-4cfa-b6e7-dc858aa68080 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:01.684773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b10009-9989-4cfa-b6e7-dc858aa68080 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:01.690739 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398fb3f-aa28-4726-8286-c7b7bf469e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:01.691630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398fb3f-aa28-4726-8286-c7b7bf469e6f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:01.692145 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398fb3f-aa28-4726-8286-c7b7bf469e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:01.692635 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398fb3f-aa28-4726-8286-c7b7bf469e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:01.693357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398fb3f-aa28-4726-8286-c7b7bf469e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:01.696997 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398fb3f-aa28-4726-8286-c7b7bf469e6f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:01.709560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1047/2108] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:01.715236 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0a3d5-bd81-4b2e-a9f3-4b8be083426d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:01.730839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0a3d5-bd81-4b2e-a9f3-4b8be083426d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:01.760379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dc409-4156-4b3e-a69a-5a21147a123f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:01.761357 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dc409-4156-4b3e-a69a-5a21147a123f admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:01.761649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dc409-4156-4b3e-a69a-5a21147a123f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:01.761960 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dc409-4156-4b3e-a69a-5a21147a123f admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:01.762736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1dc409-4156-4b3e-a69a-5a21147a123f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:01.764412 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1dc409-4156-4b3e-a69a-5a21147a123f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:01.785534 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1062/2109] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:01.796452 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398fb3f-aa28-4726-8286-c7b7bf469e6f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:01.813512 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398fb3f-aa28-4726-8286-c7b7bf469e6f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:01.827190 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14225e0d-464f-4df0-91df-432b3dba683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:01.830496 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14225e0d-464f-4df0-91df-432b3dba683c admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:01.830785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14225e0d-464f-4df0-91df-432b3dba683c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:01.831064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14225e0d-464f-4df0-91df-432b3dba683c admin admin] PATH_INFO: `/v3/projects/4d42de6592714edba7439d5a31639dd9/users/c2bffe144c8c448c8c978cc3d7df2628/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:01.864914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14225e0d-464f-4df0-91df-432b3dba683c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d42de6592714edba7439d5a31639dd9, user_id=c2bffe144c8c448c8c978cc3d7df2628, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:01.868563 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14225e0d-464f-4df0-91df-432b3dba683c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:01.889148 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1048/2110] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:01 2022] PUT /identity/v3/projects/4d42de6592714edba7439d5a31639dd9/users/c2bffe144c8c448c8c978cc3d7df2628/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:01.905935 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea1beb-56c3-455d-83dd-50ba42d5588c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:01.907907 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea1beb-56c3-455d-83dd-50ba42d5588c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:01.908445 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea1beb-56c3-455d-83dd-50ba42d5588c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:01.960451 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e8ea1beb-56c3-455d-83dd-50ba42d5588c None None] MFA Rules not processed for user `c2bffe144c8c448c8c978cc3d7df2628`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:01.962132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e8ea1beb-56c3-455d-83dd-50ba42d5588c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:02.041801 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1063/2111] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:02.053079 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14225e0d-464f-4df0-91df-432b3dba683c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:02.055395 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-14225e0d-464f-4df0-91df-432b3dba683c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:02.208425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14225e0d-464f-4df0-91df-432b3dba683c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:02.229358 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f6fe6-3396-4f57-83f4-e5ac8d2cd4e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44c764958784616b8bdbf59e5692ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:02.231402 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f6fe6-3396-4f57-83f4-e5ac8d2cd4e5 service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:02.231876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f6fe6-3396-4f57-83f4-e5ac8d2cd4e5 service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:02.233660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f6fe6-3396-4f57-83f4-e5ac8d2cd4e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:02.260114 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f6fe6-3396-4f57-83f4-e5ac8d2cd4e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:02.262448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f6fe6-3396-4f57-83f4-e5ac8d2cd4e5 service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:02.291883 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1049/2112] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:03.251471 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea1beb-56c3-455d-83dd-50ba42d5588c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:03.253067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e8ea1beb-56c3-455d-83dd-50ba42d5588c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:03.368315 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea1beb-56c3-455d-83dd-50ba42d5588c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:03.372546 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24c270-0c55-4527-8049-8740a1b8f7ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:03.373610 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24c270-0c55-4527-8049-8740a1b8f7ff service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:03.374072 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24c270-0c55-4527-8049-8740a1b8f7ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:03.374517 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24c270-0c55-4527-8049-8740a1b8f7ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:03.377313 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7c24c270-0c55-4527-8049-8740a1b8f7ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:03.467613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:03.493988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24c270-0c55-4527-8049-8740a1b8f7ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:03.495549 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24c270-0c55-4527-8049-8740a1b8f7ff service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:03.505582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1064/2113] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:06.643398 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f6fe6-3396-4f57-83f4-e5ac8d2cd4e5 service glance] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:06.645775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-262f6fe6-3396-4f57-83f4-e5ac8d2cd4e5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:06.729767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:06.794032 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f6fe6-3396-4f57-83f4-e5ac8d2cd4e5 service glance] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:06.801147 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dc49a-7a99-42a6-b3e8-bb01ac041628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:06.804358 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dc49a-7a99-42a6-b3e8-bb01ac041628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:06.804588 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dc49a-7a99-42a6-b3e8-bb01ac041628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:06.806603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dc49a-7a99-42a6-b3e8-bb01ac041628 admin admin] PATH_INFO: `/v3/users/f9a0c86367b64d82b054f81255bac4e9` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:06.810033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2dc49a-7a99-42a6-b3e8-bb01ac041628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a0c86367b64d82b054f81255bac4e9)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:06.829772 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2dc49a-7a99-42a6-b3e8-bb01ac041628 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:06.964968 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0e2dc49a-7a99-42a6-b3e8-bb01ac041628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a0c86367b64d82b054f81255bac4e9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:06.965344 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0e2dc49a-7a99-42a6-b3e8-bb01ac041628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a0c86367b64d82b054f81255bac4e9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:06.965984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0e2dc49a-7a99-42a6-b3e8-bb01ac041628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a0c86367b64d82b054f81255bac4e9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:07.008005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0e2dc49a-7a99-42a6-b3e8-bb01ac041628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a0c86367b64d82b054f81255bac4e9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:07.028428 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0e2dc49a-7a99-42a6-b3e8-bb01ac041628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a0c86367b64d82b054f81255bac4e9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:07.069554 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1050/2114] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:06 2022] DELETE /identity/v3/users/f9a0c86367b64d82b054f81255bac4e9 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:07.075134 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb264ff-c062-475b-951f-e418fa4a4a5e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:07.076420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb264ff-c062-475b-951f-e418fa4a4a5e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:07.076852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb264ff-c062-475b-951f-e418fa4a4a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:07.121036 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-fbb264ff-c062-475b-951f-e418fa4a4a5e None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:07.126921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fbb264ff-c062-475b-951f-e418fa4a4a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:07.325381 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1065/2115] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:07.337482 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dc49a-7a99-42a6-b3e8-bb01ac041628 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:07.339202 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0e2dc49a-7a99-42a6-b3e8-bb01ac041628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:07.585669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dc49a-7a99-42a6-b3e8-bb01ac041628 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:07.619404 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b34a5-4dac-439a-b715-0940749a2cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:07.620335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b34a5-4dac-439a-b715-0940749a2cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:07.620754 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b34a5-4dac-439a-b715-0940749a2cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:07.623734 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b34a5-4dac-439a-b715-0940749a2cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:07.645024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b34a5-4dac-439a-b715-0940749a2cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:07.651531 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b34a5-4dac-439a-b715-0940749a2cf2 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:07.691114 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1051/2116] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:09.239070 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb264ff-c062-475b-951f-e418fa4a4a5e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:09.241757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fbb264ff-c062-475b-951f-e418fa4a4a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:09.262401 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb264ff-c062-475b-951f-e418fa4a4a5e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:09.280734 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cebf79-06e2-4e30-84d1-942468297a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:09.281399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cebf79-06e2-4e30-84d1-942468297a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:09.281678 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cebf79-06e2-4e30-84d1-942468297a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:09.281946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cebf79-06e2-4e30-84d1-942468297a6b admin admin] PATH_INFO: `/v3/projects/f84cc1f037f34902943fb523697cd96e` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:09.283444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cebf79-06e2-4e30-84d1-942468297a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f84cc1f037f34902943fb523697cd96e)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:09.302059 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cebf79-06e2-4e30-84d1-942468297a6b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:09.406167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d8cebf79-06e2-4e30-84d1-942468297a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f84cc1f037f34902943fb523697cd96e', 'request_id': 'req-d8cebf79-06e2-4e30-84d1-942468297a6b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:09.430327 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d8cebf79-06e2-4e30-84d1-942468297a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f84cc1f037f34902943fb523697cd96e', 'request_id': 'req-d8cebf79-06e2-4e30-84d1-942468297a6b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:09.443298 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d8cebf79-06e2-4e30-84d1-942468297a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f84cc1f037f34902943fb523697cd96e', 'request_id': 'req-d8cebf79-06e2-4e30-84d1-942468297a6b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:09.467567 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d8cebf79-06e2-4e30-84d1-942468297a6b admin admin] The token cache is being invalidate because project f84cc1f037f34902943fb523697cd96e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:09.468020 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d8cebf79-06e2-4e30-84d1-942468297a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:09.468914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d8cebf79-06e2-4e30-84d1-942468297a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:09.473812 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1066/2117] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:09 2022] DELETE /identity/v3/projects/f84cc1f037f34902943fb523697cd96e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:09.475065 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b34a5-4dac-439a-b715-0940749a2cf2 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:09.491701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b34a5-4dac-439a-b715-0940749a2cf2 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:09.577191 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:09.604582 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdeb5f-effc-4ad0-95ea-e1a6e1defc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:09.605257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdeb5f-effc-4ad0-95ea-e1a6e1defc3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:09.605562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdeb5f-effc-4ad0-95ea-e1a6e1defc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:09.606051 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdeb5f-effc-4ad0-95ea-e1a6e1defc3c admin admin] PATH_INFO: `/v3/users/de941a2350764cf09a7644b58dac1986` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:09.608163 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cdeb5f-effc-4ad0-95ea-e1a6e1defc3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=de941a2350764cf09a7644b58dac1986)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:09.610254 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cdeb5f-effc-4ad0-95ea-e1a6e1defc3c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:09.676944 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-44cdeb5f-effc-4ad0-95ea-e1a6e1defc3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de941a2350764cf09a7644b58dac1986'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:09.678505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-44cdeb5f-effc-4ad0-95ea-e1a6e1defc3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de941a2350764cf09a7644b58dac1986'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:09.679480 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-44cdeb5f-effc-4ad0-95ea-e1a6e1defc3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de941a2350764cf09a7644b58dac1986'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:09.689082 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-44cdeb5f-effc-4ad0-95ea-e1a6e1defc3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de941a2350764cf09a7644b58dac1986'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:09.710797 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-44cdeb5f-effc-4ad0-95ea-e1a6e1defc3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de941a2350764cf09a7644b58dac1986'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:09.748952 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1052/2118] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:09 2022] DELETE /identity/v3/users/de941a2350764cf09a7644b58dac1986 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:09.845126 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc0635-2e62-463a-927c-a074cd87daf1 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:09.845411 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc0635-2e62-463a-927c-a074cd87daf1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:09.845682 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc0635-2e62-463a-927c-a074cd87daf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:09.918968 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f7cc0635-2e62-463a-927c-a074cd87daf1 None None] MFA Rules not processed for user `7e0a49cccc7c49f385fdfe774fec90fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:09.920719 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f7cc0635-2e62-463a-927c-a074cd87daf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:10.007747 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:10.086406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1067/2119] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:10.089621 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdeb5f-effc-4ad0-95ea-e1a6e1defc3c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:10.091286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-44cdeb5f-effc-4ad0-95ea-e1a6e1defc3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:10.209222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdeb5f-effc-4ad0-95ea-e1a6e1defc3c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:10.216113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590605c0-2f27-43a1-b24d-ba30cc182a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:10.217295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590605c0-2f27-43a1-b24d-ba30cc182a44 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:10.218487 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590605c0-2f27-43a1-b24d-ba30cc182a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:10.218824 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590605c0-2f27-43a1-b24d-ba30cc182a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:10.219927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590605c0-2f27-43a1-b24d-ba30cc182a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:10.223133 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590605c0-2f27-43a1-b24d-ba30cc182a44 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:10.274710 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1053/2120] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:10 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:10.278993 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc0635-2e62-463a-927c-a074cd87daf1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:10.295804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc0635-2e62-463a-927c-a074cd87daf1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:10.400747 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148f1ea-4da3-4bdc-9dee-785fbbe30e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:10.401755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148f1ea-4da3-4bdc-9dee-785fbbe30e1b admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:10.402139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148f1ea-4da3-4bdc-9dee-785fbbe30e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:10.402519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148f1ea-4da3-4bdc-9dee-785fbbe30e1b admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:10.403408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148f1ea-4da3-4bdc-9dee-785fbbe30e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:10.405898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148f1ea-4da3-4bdc-9dee-785fbbe30e1b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:10.446119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590605c0-2f27-43a1-b24d-ba30cc182a44 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:10.450738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-590605c0-2f27-43a1-b24d-ba30cc182a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:10.465111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1068/2121] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:10 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:10:10.472478 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148f1ea-4da3-4bdc-9dee-785fbbe30e1b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:10.476265 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590605c0-2f27-43a1-b24d-ba30cc182a44 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:10.483612 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561780b-5c42-4830-8874-11dbbe3ac9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:10.484548 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561780b-5c42-4830-8874-11dbbe3ac9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:10.484955 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561780b-5c42-4830-8874-11dbbe3ac9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:10.485328 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561780b-5c42-4830-8874-11dbbe3ac9f5 admin admin] PATH_INFO: `/v3/projects/f738d35665924c8fa493cd0624d70d87` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:10.487240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561780b-5c42-4830-8874-11dbbe3ac9f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f738d35665924c8fa493cd0624d70d87)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:10.490148 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561780b-5c42-4830-8874-11dbbe3ac9f5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:10.503250 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148f1ea-4da3-4bdc-9dee-785fbbe30e1b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:10.514341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfe8ae-4ebe-4dae-9e5c-5e358b87db0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:10.516403 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfe8ae-4ebe-4dae-9e5c-5e358b87db0c admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:10.516712 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfe8ae-4ebe-4dae-9e5c-5e358b87db0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:10.516988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfe8ae-4ebe-4dae-9e5c-5e358b87db0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:10.518684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfe8ae-4ebe-4dae-9e5c-5e358b87db0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:10.531151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfe8ae-4ebe-4dae-9e5c-5e358b87db0c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:10.546730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:10.550975 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7561780b-5c42-4830-8874-11dbbe3ac9f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f738d35665924c8fa493cd0624d70d87', 'request_id': 'req-7561780b-5c42-4830-8874-11dbbe3ac9f5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:10.556967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1069/2122] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:10.561822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7561780b-5c42-4830-8874-11dbbe3ac9f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f738d35665924c8fa493cd0624d70d87', 'request_id': 'req-7561780b-5c42-4830-8874-11dbbe3ac9f5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:10.562330 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfe8ae-4ebe-4dae-9e5c-5e358b87db0c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:10.569890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7561780b-5c42-4830-8874-11dbbe3ac9f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f738d35665924c8fa493cd0624d70d87', 'request_id': 'req-7561780b-5c42-4830-8874-11dbbe3ac9f5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:10.577279 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfe8ae-4ebe-4dae-9e5c-5e358b87db0c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:10.599385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7561780b-5c42-4830-8874-11dbbe3ac9f5 admin admin] The token cache is being invalidate because project f738d35665924c8fa493cd0624d70d87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:10.600684 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7561780b-5c42-4830-8874-11dbbe3ac9f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:10.601911 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7561780b-5c42-4830-8874-11dbbe3ac9f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:10.604399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1054/2123] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:10 2022] DELETE /identity/v3/projects/f738d35665924c8fa493cd0624d70d87 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:10.608527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561780b-5c42-4830-8874-11dbbe3ac9f5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:10.610211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7561780b-5c42-4830-8874-11dbbe3ac9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:10.680274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63747df-17ff-49c9-9d53-7ee79a5e51df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:10.681193 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63747df-17ff-49c9-9d53-7ee79a5e51df admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:10.681598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63747df-17ff-49c9-9d53-7ee79a5e51df admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:10.682204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63747df-17ff-49c9-9d53-7ee79a5e51df admin admin] PATH_INFO: `/v3/projects/1f0e7f10dd7948bba36f42bc02a500d8/users/40bc5c1813774dbd843778b02de1c492/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:10.710661 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63747df-17ff-49c9-9d53-7ee79a5e51df admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0e7f10dd7948bba36f42bc02a500d8, user_id=40bc5c1813774dbd843778b02de1c492, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:10.716077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63747df-17ff-49c9-9d53-7ee79a5e51df admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:10.742715 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1070/2124] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:10 2022] PUT /identity/v3/projects/1f0e7f10dd7948bba36f42bc02a500d8/users/40bc5c1813774dbd843778b02de1c492/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:10.747353 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63747df-17ff-49c9-9d53-7ee79a5e51df admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:10.751143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f63747df-17ff-49c9-9d53-7ee79a5e51df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:10.774953 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561780b-5c42-4830-8874-11dbbe3ac9f5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:10.872207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:10.899952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63747df-17ff-49c9-9d53-7ee79a5e51df admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:10.918243 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a01a4d-70c1-4436-a790-e3a21b2bcce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:10.922056 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a01a4d-70c1-4436-a790-e3a21b2bcce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:10.923142 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a01a4d-70c1-4436-a790-e3a21b2bcce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:10.924134 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a01a4d-70c1-4436-a790-e3a21b2bcce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:10.924985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a01a4d-70c1-4436-a790-e3a21b2bcce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:10.926679 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a01a4d-70c1-4436-a790-e3a21b2bcce3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:10.961139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908b83e-ac96-4283-8896-7c42dfc09fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:10.965555 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1071/2125] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:10.966256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908b83e-ac96-4283-8896-7c42dfc09fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:10.966552 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908b83e-ac96-4283-8896-7c42dfc09fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:10.966835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908b83e-ac96-4283-8896-7c42dfc09fe4 admin admin] PATH_INFO: `/v3/users/366e8f725066460cb8589954b548e50d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:10.968954 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a01a4d-70c1-4436-a790-e3a21b2bcce3 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:10.970314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908b83e-ac96-4283-8896-7c42dfc09fe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=366e8f725066460cb8589954b548e50d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:10.976989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908b83e-ac96-4283-8896-7c42dfc09fe4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:11.000826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a01a4d-70c1-4436-a790-e3a21b2bcce3 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:11.011129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a831c4-8bb6-4faf-b0bd-221e7d63fa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:11.011832 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a831c4-8bb6-4faf-b0bd-221e7d63fa0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:11.012104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a831c4-8bb6-4faf-b0bd-221e7d63fa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:11.012381 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a831c4-8bb6-4faf-b0bd-221e7d63fa0d admin admin] PATH_INFO: `/v3/projects/1f0e7f10dd7948bba36f42bc02a500d8/users/40bc5c1813774dbd843778b02de1c492/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:11.014542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a831c4-8bb6-4faf-b0bd-221e7d63fa0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0e7f10dd7948bba36f42bc02a500d8, user_id=40bc5c1813774dbd843778b02de1c492, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:11.024032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a831c4-8bb6-4faf-b0bd-221e7d63fa0d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:11.043550 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1072/2126] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:10 2022] PUT /identity/v3/projects/1f0e7f10dd7948bba36f42bc02a500d8/users/40bc5c1813774dbd843778b02de1c492/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:11.092790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2908b83e-ac96-4283-8896-7c42dfc09fe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366e8f725066460cb8589954b548e50d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:11.093672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2908b83e-ac96-4283-8896-7c42dfc09fe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366e8f725066460cb8589954b548e50d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:11.094313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2908b83e-ac96-4283-8896-7c42dfc09fe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366e8f725066460cb8589954b548e50d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:11.108564 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2908b83e-ac96-4283-8896-7c42dfc09fe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366e8f725066460cb8589954b548e50d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:11.125950 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2908b83e-ac96-4283-8896-7c42dfc09fe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366e8f725066460cb8589954b548e50d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:11.161704 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:11.173766 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1055/2127] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:10 2022] DELETE /identity/v3/users/366e8f725066460cb8589954b548e50d => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:12.638511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a831c4-8bb6-4faf-b0bd-221e7d63fa0d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:12.641554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-31a831c4-8bb6-4faf-b0bd-221e7d63fa0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:12.741979 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a831c4-8bb6-4faf-b0bd-221e7d63fa0d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:12.831903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70207f-7cb7-431f-9b75-6c2c91bbbbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:12.832965 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70207f-7cb7-431f-9b75-6c2c91bbbbc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:12.833478 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70207f-7cb7-431f-9b75-6c2c91bbbbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:12.835669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70207f-7cb7-431f-9b75-6c2c91bbbbc6 admin admin] PATH_INFO: `/v3/projects/ff83e3121c9e41a28afdd97c15ee98dc` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:12.837557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70207f-7cb7-431f-9b75-6c2c91bbbbc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff83e3121c9e41a28afdd97c15ee98dc)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:12.841739 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70207f-7cb7-431f-9b75-6c2c91bbbbc6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:12.924390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8a70207f-7cb7-431f-9b75-6c2c91bbbbc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff83e3121c9e41a28afdd97c15ee98dc', 'request_id': 'req-8a70207f-7cb7-431f-9b75-6c2c91bbbbc6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:12.938018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8a70207f-7cb7-431f-9b75-6c2c91bbbbc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff83e3121c9e41a28afdd97c15ee98dc', 'request_id': 'req-8a70207f-7cb7-431f-9b75-6c2c91bbbbc6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:12.949241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8a70207f-7cb7-431f-9b75-6c2c91bbbbc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff83e3121c9e41a28afdd97c15ee98dc', 'request_id': 'req-8a70207f-7cb7-431f-9b75-6c2c91bbbbc6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:12.973390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8a70207f-7cb7-431f-9b75-6c2c91bbbbc6 admin admin] The token cache is being invalidate because project ff83e3121c9e41a28afdd97c15ee98dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:12.973920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8a70207f-7cb7-431f-9b75-6c2c91bbbbc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:12.975652 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8a70207f-7cb7-431f-9b75-6c2c91bbbbc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:12.978675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1073/2128] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:12 2022] DELETE /identity/v3/projects/ff83e3121c9e41a28afdd97c15ee98dc => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:12.984269 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ce1e1-3582-4199-849b-052a2707e733 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:12.985126 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ce1e1-3582-4199-849b-052a2707e733 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:12.985712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ce1e1-3582-4199-849b-052a2707e733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:13.016569 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-895ce1e1-3582-4199-849b-052a2707e733 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:13.018576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-895ce1e1-3582-4199-849b-052a2707e733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:13.117226 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1056/2129] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:13.126870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cac73-5efd-4372-8eb8-71def9dc888c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:13.127215 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cac73-5efd-4372-8eb8-71def9dc888c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:13.127525 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cac73-5efd-4372-8eb8-71def9dc888c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:13.148042 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:13.154338 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2f6cac73-5efd-4372-8eb8-71def9dc888c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:13.157086 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2f6cac73-5efd-4372-8eb8-71def9dc888c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:13.172015 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1074/2130] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:13.173810 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ce1e1-3582-4199-849b-052a2707e733 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:13.187769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ce1e1-3582-4199-849b-052a2707e733 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:13.193746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999e7c1-e0c2-4703-970c-53b374973cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:13.194387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999e7c1-e0c2-4703-970c-53b374973cfe admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:13.194657 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999e7c1-e0c2-4703-970c-53b374973cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:13.197012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999e7c1-e0c2-4703-970c-53b374973cfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:13.198362 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d999e7c1-e0c2-4703-970c-53b374973cfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:10:13.198748 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d999e7c1-e0c2-4703-970c-53b374973cfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:13.200982 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d999e7c1-e0c2-4703-970c-53b374973cfe admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:13.218507 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1057/2131] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:10:13.219741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cac73-5efd-4372-8eb8-71def9dc888c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:13.234475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cac73-5efd-4372-8eb8-71def9dc888c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:13.239758 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668fcca-fc84-49c1-b8ea-af639297751a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:13.241039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668fcca-fc84-49c1-b8ea-af639297751a admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:13.241602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668fcca-fc84-49c1-b8ea-af639297751a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:13.242651 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668fcca-fc84-49c1-b8ea-af639297751a admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:13.243836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668fcca-fc84-49c1-b8ea-af639297751a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:13.245854 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668fcca-fc84-49c1-b8ea-af639297751a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:13.291198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1075/2132] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:13 2022] POST /identity/v3/projects => generated 401 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:13.293051 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999e7c1-e0c2-4703-970c-53b374973cfe admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:13.308795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999e7c1-e0c2-4703-970c-53b374973cfe admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:13.451828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee406d-fe19-4392-865f-55d048213e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:13.452358 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee406d-fe19-4392-865f-55d048213e16 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:13.452629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee406d-fe19-4392-865f-55d048213e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:13.452949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee406d-fe19-4392-865f-55d048213e16 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:13.453630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee406d-fe19-4392-865f-55d048213e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:13.456540 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee406d-fe19-4392-865f-55d048213e16 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:13.537078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1058/2133] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:13 2022] POST /identity/v3/users => generated 301 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:13.541423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668fcca-fc84-49c1-b8ea-af639297751a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:13.561075 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668fcca-fc84-49c1-b8ea-af639297751a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:13.573817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6694c5-e646-4a07-b2a5-48208c243f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:13.579157 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6694c5-e646-4a07-b2a5-48208c243f4c admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:13.579157 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6694c5-e646-4a07-b2a5-48208c243f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:13.579157 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6694c5-e646-4a07-b2a5-48208c243f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:13.579157 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6694c5-e646-4a07-b2a5-48208c243f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:13.584881 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6694c5-e646-4a07-b2a5-48208c243f4c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:13.610845 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1076/2134] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:13.612960 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee406d-fe19-4392-865f-55d048213e16 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:13.633845 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee406d-fe19-4392-865f-55d048213e16 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:13.651910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b14f5-bae6-49bf-bae6-2647b4c37c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:13.652892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b14f5-bae6-49bf-bae6-2647b4c37c0d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:13.654032 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b14f5-bae6-49bf-bae6-2647b4c37c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:13.654318 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b14f5-bae6-49bf-bae6-2647b4c37c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:13.655314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b14f5-bae6-49bf-bae6-2647b4c37c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:13.659776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b14f5-bae6-49bf-bae6-2647b4c37c0d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:13.682778 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1059/2135] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:13.696438 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6694c5-e646-4a07-b2a5-48208c243f4c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:13.713565 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6694c5-e646-4a07-b2a5-48208c243f4c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:13.731175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13828128-c455-432a-a0f0-84e228640e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:13.731978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13828128-c455-432a-a0f0-84e228640e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:13.732268 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13828128-c455-432a-a0f0-84e228640e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:13.732545 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13828128-c455-432a-a0f0-84e228640e37 admin admin] PATH_INFO: `/v3/projects/d541cba6614a48f3be8500c4aa80d365/users/46d3b3b58d8e4b2c812f034c674bae99/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:13.767802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13828128-c455-432a-a0f0-84e228640e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d541cba6614a48f3be8500c4aa80d365, user_id=46d3b3b58d8e4b2c812f034c674bae99, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:13.770467 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13828128-c455-432a-a0f0-84e228640e37 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:13.820094 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1077/2136] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:13 2022] PUT /identity/v3/projects/d541cba6614a48f3be8500c4aa80d365/users/46d3b3b58d8e4b2c812f034c674bae99/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:13.833659 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3a7da-d487-4d85-9cd7-ace375ba6a9e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:13.834815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3a7da-d487-4d85-9cd7-ace375ba6a9e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:13.835751 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3a7da-d487-4d85-9cd7-ace375ba6a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:13.920343 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c4d3a7da-d487-4d85-9cd7-ace375ba6a9e None None] MFA Rules not processed for user `46d3b3b58d8e4b2c812f034c674bae99`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:13.921659 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c4d3a7da-d487-4d85-9cd7-ace375ba6a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:14.012007 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:14.032427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1060/2137] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:13 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:14.033840 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13828128-c455-432a-a0f0-84e228640e37 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:14.186756 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13828128-c455-432a-a0f0-84e228640e37 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:14.200006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c4e4d-33df-40ae-9cc1-01fae1ec33c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:14.200640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c4e4d-33df-40ae-9cc1-01fae1ec33c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:14.201077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c4e4d-33df-40ae-9cc1-01fae1ec33c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:14.201357 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c4e4d-33df-40ae-9cc1-01fae1ec33c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:14.202009 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c4e4d-33df-40ae-9cc1-01fae1ec33c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:14.206233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c4e4d-33df-40ae-9cc1-01fae1ec33c7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:14.256668 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1078/2138] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:14 2022] POST /identity/v3/projects => generated 397 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:14.261010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3a7da-d487-4d85-9cd7-ace375ba6a9e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:14.273719 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3a7da-d487-4d85-9cd7-ace375ba6a9e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:14.383021 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef12820-800e-4440-8666-0344db08e30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:14.383889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef12820-800e-4440-8666-0344db08e30d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:14.384449 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef12820-800e-4440-8666-0344db08e30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:14.384803 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef12820-800e-4440-8666-0344db08e30d admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:14.388086 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef12820-800e-4440-8666-0344db08e30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:14.405429 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef12820-800e-4440-8666-0344db08e30d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:14.444882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1061/2139] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:14 2022] POST /identity/v3/users => generated 305 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:14.449747 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c4e4d-33df-40ae-9cc1-01fae1ec33c7 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:14.469658 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c4e4d-33df-40ae-9cc1-01fae1ec33c7 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:14.490822 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6a991-3e51-4b2b-a5e4-576499c39a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:14.491941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6a991-3e51-4b2b-a5e4-576499c39a92 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:14.492365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6a991-3e51-4b2b-a5e4-576499c39a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:14.492775 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6a991-3e51-4b2b-a5e4-576499c39a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:14.493574 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6a991-3e51-4b2b-a5e4-576499c39a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:14.499011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6a991-3e51-4b2b-a5e4-576499c39a92 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:14.526583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1079/2140] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:14.530781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef12820-800e-4440-8666-0344db08e30d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:14.549104 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef12820-800e-4440-8666-0344db08e30d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:14.561213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7736dad-aaf3-4b93-b103-63cf39bd7c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:14.561213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7736dad-aaf3-4b93-b103-63cf39bd7c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:14.561213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7736dad-aaf3-4b93-b103-63cf39bd7c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:14.561213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7736dad-aaf3-4b93-b103-63cf39bd7c70 admin admin] PATH_INFO: `/v3/projects/14f889ab0a2c4d289d21aaa799c83726/users/656eef2304e944f7ba594b81c6de04e4/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:14.585299 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7736dad-aaf3-4b93-b103-63cf39bd7c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f889ab0a2c4d289d21aaa799c83726, user_id=656eef2304e944f7ba594b81c6de04e4, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:14.588198 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7736dad-aaf3-4b93-b103-63cf39bd7c70 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:14.612851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1062/2141] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:14 2022] PUT /identity/v3/projects/14f889ab0a2c4d289d21aaa799c83726/users/656eef2304e944f7ba594b81c6de04e4/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:14.614789 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6a991-3e51-4b2b-a5e4-576499c39a92 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:14.638066 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6a991-3e51-4b2b-a5e4-576499c39a92 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:14.746350 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d208a8-b871-4521-bc10-57564dfcc8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:14.751928 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d208a8-b871-4521-bc10-57564dfcc8ad admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:14.752214 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d208a8-b871-4521-bc10-57564dfcc8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:14.752480 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d208a8-b871-4521-bc10-57564dfcc8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:14.753150 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d208a8-b871-4521-bc10-57564dfcc8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:14.754761 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d208a8-b871-4521-bc10-57564dfcc8ad admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:14.766868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1080/2142] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:14.770919 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7736dad-aaf3-4b93-b103-63cf39bd7c70 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:14.787873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7736dad-aaf3-4b93-b103-63cf39bd7c70 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:14.807762 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df65b53-2abd-4285-9e12-e3b6fe3c185a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:14.811740 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df65b53-2abd-4285-9e12-e3b6fe3c185a admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:14.812107 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df65b53-2abd-4285-9e12-e3b6fe3c185a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:14.812457 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df65b53-2abd-4285-9e12-e3b6fe3c185a admin admin] PATH_INFO: `/v3/projects/14f889ab0a2c4d289d21aaa799c83726/users/656eef2304e944f7ba594b81c6de04e4/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:14.814678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df65b53-2abd-4285-9e12-e3b6fe3c185a admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f889ab0a2c4d289d21aaa799c83726, user_id=656eef2304e944f7ba594b81c6de04e4, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:14.818085 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df65b53-2abd-4285-9e12-e3b6fe3c185a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:14.851588 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1063/2143] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:14 2022] PUT /identity/v3/projects/14f889ab0a2c4d289d21aaa799c83726/users/656eef2304e944f7ba594b81c6de04e4/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:14.853633 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e045d4-78f0-48e7-89b3-66c3abd18569 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:14.853923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e045d4-78f0-48e7-89b3-66c3abd18569 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:14.854207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e045d4-78f0-48e7-89b3-66c3abd18569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:14.928266 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:14.937402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-76e045d4-78f0-48e7-89b3-66c3abd18569 None None] MFA Rules not processed for user `656eef2304e944f7ba594b81c6de04e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:14.941910 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-76e045d4-78f0-48e7-89b3-66c3abd18569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:15.134872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1081/2144] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:14 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:15.145478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df65b53-2abd-4285-9e12-e3b6fe3c185a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:15.149115 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6df65b53-2abd-4285-9e12-e3b6fe3c185a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:15.304762 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df65b53-2abd-4285-9e12-e3b6fe3c185a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:15.329236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d598803-ad8d-49f3-a41c-32ee01f49ba2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:15.329966 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d598803-ad8d-49f3-a41c-32ee01f49ba2 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:15.330488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d598803-ad8d-49f3-a41c-32ee01f49ba2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:15.330768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d598803-ad8d-49f3-a41c-32ee01f49ba2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:15.361739 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d598803-ad8d-49f3-a41c-32ee01f49ba2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:15.363253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d598803-ad8d-49f3-a41c-32ee01f49ba2 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:15.403222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1064/2145] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:15 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:15.598683 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e045d4-78f0-48e7-89b3-66c3abd18569 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:15.618877 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e045d4-78f0-48e7-89b3-66c3abd18569 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:15.637283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833d74d-ed3e-46ef-b8af-7d31fb76a43d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:15.638067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833d74d-ed3e-46ef-b8af-7d31fb76a43d service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:15.638067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833d74d-ed3e-46ef-b8af-7d31fb76a43d service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:15.638067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833d74d-ed3e-46ef-b8af-7d31fb76a43d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:15.786856 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833d74d-ed3e-46ef-b8af-7d31fb76a43d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:15.788778 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833d74d-ed3e-46ef-b8af-7d31fb76a43d service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:15.808384 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1082/2146] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:15 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:16.865015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d598803-ad8d-49f3-a41c-32ee01f49ba2 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:16.867820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3d598803-ad8d-49f3-a41c-32ee01f49ba2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:16.958636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:16.991955 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d598803-ad8d-49f3-a41c-32ee01f49ba2 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:16.998908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56171654-0d53-4744-af24-74fb7e3bc2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:17.000546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56171654-0d53-4744-af24-74fb7e3bc2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:17.000976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56171654-0d53-4744-af24-74fb7e3bc2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:17.001472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56171654-0d53-4744-af24-74fb7e3bc2cc admin admin] PATH_INFO: `/v3/users/53319ee454e748468474109c0b864d7a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:17.002802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56171654-0d53-4744-af24-74fb7e3bc2cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=53319ee454e748468474109c0b864d7a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:17.010005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56171654-0d53-4744-af24-74fb7e3bc2cc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:17.102055 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56171654-0d53-4744-af24-74fb7e3bc2cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53319ee454e748468474109c0b864d7a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:17.103963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56171654-0d53-4744-af24-74fb7e3bc2cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53319ee454e748468474109c0b864d7a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:17.104600 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56171654-0d53-4744-af24-74fb7e3bc2cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53319ee454e748468474109c0b864d7a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:17.119936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56171654-0d53-4744-af24-74fb7e3bc2cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53319ee454e748468474109c0b864d7a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:17.136109 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56171654-0d53-4744-af24-74fb7e3bc2cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53319ee454e748468474109c0b864d7a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:17.162620 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1065/2147] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:16 2022] DELETE /identity/v3/users/53319ee454e748468474109c0b864d7a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:17.169921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502c8c0-09e3-40fd-8990-d36b80c52906 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:17.170806 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502c8c0-09e3-40fd-8990-d36b80c52906 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:17.172154 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502c8c0-09e3-40fd-8990-d36b80c52906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:17.200572 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4502c8c0-09e3-40fd-8990-d36b80c52906 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:17.202511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4502c8c0-09e3-40fd-8990-d36b80c52906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:17.290346 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1083/2148] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:17.306045 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56171654-0d53-4744-af24-74fb7e3bc2cc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:17.307597 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-56171654-0d53-4744-af24-74fb7e3bc2cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:17.453642 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56171654-0d53-4744-af24-74fb7e3bc2cc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:17.457636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044ebf8-2f4e-4240-8421-8480cc4de7cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:17.458451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044ebf8-2f4e-4240-8421-8480cc4de7cb service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:17.460113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044ebf8-2f4e-4240-8421-8480cc4de7cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:17.467282 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044ebf8-2f4e-4240-8421-8480cc4de7cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:17.491994 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044ebf8-2f4e-4240-8421-8480cc4de7cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:17.494066 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044ebf8-2f4e-4240-8421-8480cc4de7cb service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:17.522397 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1066/2149] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:18.014882 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f08c57-7d48-46af-915a-c2022442c3a3 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:18.015226 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f08c57-7d48-46af-915a-c2022442c3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:18.015513 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f08c57-7d48-46af-915a-c2022442c3a3 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:18.017511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1084/2150] 10.222.0.40 () {54 vars in 921 bytes} [Tue Aug 9 07:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:10:18.074859 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c4452-9493-4209-b1e2-f680418d2277 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:18.075755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c4452-9493-4209-b1e2-f680418d2277 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:18.076203 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c4452-9493-4209-b1e2-f680418d2277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:18.121203 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7d9c4452-9493-4209-b1e2-f680418d2277 None None] MFA Rules not processed for user `07d2ee351e734fd09938cea9be3bb08a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:18.122711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7d9c4452-9493-4209-b1e2-f680418d2277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:18.147986 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f08c57-7d48-46af-915a-c2022442c3a3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:18.150658 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-30f08c57-7d48-46af-915a-c2022442c3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:18.175676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f08c57-7d48-46af-915a-c2022442c3a3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:18.184883 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b87f11-60f4-4855-af98-b0dd0e2d47c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:18.186152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b87f11-60f4-4855-af98-b0dd0e2d47c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:18.186600 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b87f11-60f4-4855-af98-b0dd0e2d47c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:18.187350 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b87f11-60f4-4855-af98-b0dd0e2d47c6 admin admin] PATH_INFO: `/v3/users/a7d50e164ef94115b2a5774480a8155d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:18.189731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b87f11-60f4-4855-af98-b0dd0e2d47c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7d50e164ef94115b2a5774480a8155d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:18.192239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b87f11-60f4-4855-af98-b0dd0e2d47c6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:18.227310 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1067/2151] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Aug 9 07:10:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:18.244792 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c4452-9493-4209-b1e2-f680418d2277 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:18.246900 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7d9c4452-9493-4209-b1e2-f680418d2277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:18.269384 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:18.270140 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c4452-9493-4209-b1e2-f680418d2277 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:18.281559 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96675d4d-07ae-4aac-a45b-b46d1a5d7a93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07d2ee351e734fd09938cea9be3bb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:18.283275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96675d4d-07ae-4aac-a45b-b46d1a5d7a93 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:18.284010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96675d4d-07ae-4aac-a45b-b46d1a5d7a93 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:18.284705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96675d4d-07ae-4aac-a45b-b46d1a5d7a93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:18.292113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c8b87f11-60f4-4855-af98-b0dd0e2d47c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7d50e164ef94115b2a5774480a8155d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:18.293578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:18.297355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96675d4d-07ae-4aac-a45b-b46d1a5d7a93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:18.300695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96675d4d-07ae-4aac-a45b-b46d1a5d7a93 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:18.305912 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c8b87f11-60f4-4855-af98-b0dd0e2d47c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7d50e164ef94115b2a5774480a8155d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:18.308169 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c8b87f11-60f4-4855-af98-b0dd0e2d47c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7d50e164ef94115b2a5774480a8155d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:18.316097 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1068/2152] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:18.329971 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c8b87f11-60f4-4855-af98-b0dd0e2d47c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7d50e164ef94115b2a5774480a8155d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:18.338854 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c8b87f11-60f4-4855-af98-b0dd0e2d47c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7d50e164ef94115b2a5774480a8155d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:18.351944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1085/2153] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:18 2022] DELETE /identity/v3/users/a7d50e164ef94115b2a5774480a8155d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:18.460433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96675d4d-07ae-4aac-a45b-b46d1a5d7a93 service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:18.463051 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-96675d4d-07ae-4aac-a45b-b46d1a5d7a93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:18.515531 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96675d4d-07ae-4aac-a45b-b46d1a5d7a93 service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:18.579684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b87f11-60f4-4855-af98-b0dd0e2d47c6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:18.581296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c8b87f11-60f4-4855-af98-b0dd0e2d47c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:18.629025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272018d-b9b0-4f4f-902f-5e8c10641c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:18.631586 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272018d-b9b0-4f4f-902f-5e8c10641c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:18.632233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272018d-b9b0-4f4f-902f-5e8c10641c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:18.632809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272018d-b9b0-4f4f-902f-5e8c10641c12 admin admin] PATH_INFO: `/v3/projects/486f019a176d4f5a9be5eb3360381ffb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:18.638506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272018d-b9b0-4f4f-902f-5e8c10641c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=486f019a176d4f5a9be5eb3360381ffb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:18.640303 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272018d-b9b0-4f4f-902f-5e8c10641c12 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:18.692954 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b87f11-60f4-4855-af98-b0dd0e2d47c6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:18.700005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8272018d-b9b0-4f4f-902f-5e8c10641c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '486f019a176d4f5a9be5eb3360381ffb', 'request_id': 'req-8272018d-b9b0-4f4f-902f-5e8c10641c12'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:18.706466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8272018d-b9b0-4f4f-902f-5e8c10641c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '486f019a176d4f5a9be5eb3360381ffb', 'request_id': 'req-8272018d-b9b0-4f4f-902f-5e8c10641c12'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:18.713192 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8272018d-b9b0-4f4f-902f-5e8c10641c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '486f019a176d4f5a9be5eb3360381ffb', 'request_id': 'req-8272018d-b9b0-4f4f-902f-5e8c10641c12'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:18.729600 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8272018d-b9b0-4f4f-902f-5e8c10641c12 admin admin] The token cache is being invalidate because project 486f019a176d4f5a9be5eb3360381ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:18.729976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8272018d-b9b0-4f4f-902f-5e8c10641c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:18.731275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8272018d-b9b0-4f4f-902f-5e8c10641c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:18.733022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1069/2154] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:18 2022] DELETE /identity/v3/projects/486f019a176d4f5a9be5eb3360381ffb => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:18.739658 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38378408-e3d6-49c4-92f7-0523c0a378a2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:18.739994 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38378408-e3d6-49c4-92f7-0523c0a378a2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:18.740271 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38378408-e3d6-49c4-92f7-0523c0a378a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:18.767628 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-38378408-e3d6-49c4-92f7-0523c0a378a2 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:18.769001 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-38378408-e3d6-49c4-92f7-0523c0a378a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:18.820945 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691db47-3048-46bd-8950-4bd001b68b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:18.821594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691db47-3048-46bd-8950-4bd001b68b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:18.821875 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691db47-3048-46bd-8950-4bd001b68b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:18.822162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691db47-3048-46bd-8950-4bd001b68b2d admin admin] PATH_INFO: `/v3/projects/d5f64f07e4b44a2cb6821147609a35a3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:18.826731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691db47-3048-46bd-8950-4bd001b68b2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5f64f07e4b44a2cb6821147609a35a3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:18.828718 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691db47-3048-46bd-8950-4bd001b68b2d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:18.890884 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1070/2155] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:18.901212 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05aa70a-fc31-4456-891d-50abbb65bf6a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:18.901777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05aa70a-fc31-4456-891d-50abbb65bf6a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:18.902152 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05aa70a-fc31-4456-891d-50abbb65bf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:18.940666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b691db47-3048-46bd-8950-4bd001b68b2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5f64f07e4b44a2cb6821147609a35a3', 'request_id': 'req-b691db47-3048-46bd-8950-4bd001b68b2d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:18.955866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e05aa70a-fc31-4456-891d-50abbb65bf6a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:18.959507 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e05aa70a-fc31-4456-891d-50abbb65bf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:18.963490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b691db47-3048-46bd-8950-4bd001b68b2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5f64f07e4b44a2cb6821147609a35a3', 'request_id': 'req-b691db47-3048-46bd-8950-4bd001b68b2d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:18.964918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:18.980045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b691db47-3048-46bd-8950-4bd001b68b2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5f64f07e4b44a2cb6821147609a35a3', 'request_id': 'req-b691db47-3048-46bd-8950-4bd001b68b2d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:19.006432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b691db47-3048-46bd-8950-4bd001b68b2d admin admin] The token cache is being invalidate because project d5f64f07e4b44a2cb6821147609a35a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:19.006909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b691db47-3048-46bd-8950-4bd001b68b2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:19.009620 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b691db47-3048-46bd-8950-4bd001b68b2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:19.012517 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1086/2156] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:18 2022] DELETE /identity/v3/projects/d5f64f07e4b44a2cb6821147609a35a3 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:19.017374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c584f-0ec6-45b1-a62b-c40e96cb369f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:19.017662 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c584f-0ec6-45b1-a62b-c40e96cb369f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:19.017938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c584f-0ec6-45b1-a62b-c40e96cb369f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:19.033902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:19.060238 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-464c584f-0ec6-45b1-a62b-c40e96cb369f None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:19.061478 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-464c584f-0ec6-45b1-a62b-c40e96cb369f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:19.139229 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1071/2157] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:19.141470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05aa70a-fc31-4456-891d-50abbb65bf6a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:19.155709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05aa70a-fc31-4456-891d-50abbb65bf6a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:19.166501 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f9d86-8c1a-4144-a9f7-e8462860971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:19.167557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f9d86-8c1a-4144-a9f7-e8462860971e admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:19.168943 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f9d86-8c1a-4144-a9f7-e8462860971e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:19.169321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f9d86-8c1a-4144-a9f7-e8462860971e admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:19.170616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f9d86-8c1a-4144-a9f7-e8462860971e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:10:19.174039 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f9d86-8c1a-4144-a9f7-e8462860971e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:19.192669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f9d86-8c1a-4144-a9f7-e8462860971e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:19.213264 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1087/2158] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:19.214820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e6d57-f061-4c8b-9da4-880e80cceb21 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:19.215336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e6d57-f061-4c8b-9da4-880e80cceb21 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:19.215763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e6d57-f061-4c8b-9da4-880e80cceb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:19.221139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1072/2159] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:10:19.226313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f9d86-8c1a-4144-a9f7-e8462860971e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:19.283348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f9d86-8c1a-4144-a9f7-e8462860971e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:19.290799 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60352609-671d-4be7-85b4-8741c1ed69d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:19.291545 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352609-671d-4be7-85b4-8741c1ed69d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:19.291896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352609-671d-4be7-85b4-8741c1ed69d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:19.292001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-bf8e6d57-f061-4c8b-9da4-880e80cceb21 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:19.292370 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352609-671d-4be7-85b4-8741c1ed69d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:19.293371 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bf8e6d57-f061-4c8b-9da4-880e80cceb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:19.293484 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60352609-671d-4be7-85b4-8741c1ed69d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:19.295481 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60352609-671d-4be7-85b4-8741c1ed69d1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:19.325235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1088/2160] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:19.329471 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e6d57-f061-4c8b-9da4-880e80cceb21 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:19.347298 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e6d57-f061-4c8b-9da4-880e80cceb21 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:19.365440 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1073/2161] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:19 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:19.365440 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51498b79-ebe2-4815-926a-73f96dc9e9fa None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:19.365440 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51498b79-ebe2-4815-926a-73f96dc9e9fa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:19.365440 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51498b79-ebe2-4815-926a-73f96dc9e9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:19.367448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4697cc-6a92-4b73-96b1-51295b920cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:19.368073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4697cc-6a92-4b73-96b1-51295b920cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:19.368456 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4697cc-6a92-4b73-96b1-51295b920cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:19.368735 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4697cc-6a92-4b73-96b1-51295b920cf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:19.370110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4697cc-6a92-4b73-96b1-51295b920cf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:10:19.370414 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4697cc-6a92-4b73-96b1-51295b920cf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:19.373255 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4697cc-6a92-4b73-96b1-51295b920cf7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:19.395714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1089/2162] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 07:10:19.395714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4697cc-6a92-4b73-96b1-51295b920cf7 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:19.403810 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-51498b79-ebe2-4815-926a-73f96dc9e9fa None None] MFA Rules not processed for user `40bc5c1813774dbd843778b02de1c492`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:19.405429 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-51498b79-ebe2-4815-926a-73f96dc9e9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:19.409995 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4697cc-6a92-4b73-96b1-51295b920cf7 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:19.498557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1074/2163] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:19.499557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51498b79-ebe2-4815-926a-73f96dc9e9fa None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:19.507189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb70c0-7a04-4b42-bb73-86c13d03cd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:19.507974 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb70c0-7a04-4b42-bb73-86c13d03cd49 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:19.508234 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb70c0-7a04-4b42-bb73-86c13d03cd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:19.508491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb70c0-7a04-4b42-bb73-86c13d03cd49 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:19.509137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb70c0-7a04-4b42-bb73-86c13d03cd49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:19.511139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb70c0-7a04-4b42-bb73-86c13d03cd49 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:19.518195 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51498b79-ebe2-4815-926a-73f96dc9e9fa None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:19.524692 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76438f0e-b948-43ac-a11a-26b240a4bc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:19.525443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76438f0e-b948-43ac-a11a-26b240a4bc1b admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:19.525657 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76438f0e-b948-43ac-a11a-26b240a4bc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:19.525991 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76438f0e-b948-43ac-a11a-26b240a4bc1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:19.526667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76438f0e-b948-43ac-a11a-26b240a4bc1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:19.528757 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76438f0e-b948-43ac-a11a-26b240a4bc1b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:19.542823 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1090/2164] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:19 2022] POST /identity/v3/users => generated 291 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:19.543765 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb70c0-7a04-4b42-bb73-86c13d03cd49 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:19.546326 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7cbb70c0-7a04-4b42-bb73-86c13d03cd49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:19.572146 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1075/2165] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:19 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:19.576326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76438f0e-b948-43ac-a11a-26b240a4bc1b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:19.637917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:19.653997 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:19.659575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76438f0e-b948-43ac-a11a-26b240a4bc1b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:19.662658 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb70c0-7a04-4b42-bb73-86c13d03cd49 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:19.666134 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a16a7-5109-4bf9-84e2-35520cec984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:19.666753 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a16a7-5109-4bf9-84e2-35520cec984c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:19.667029 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a16a7-5109-4bf9-84e2-35520cec984c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:19.667329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a16a7-5109-4bf9-84e2-35520cec984c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:19.667973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a16a7-5109-4bf9-84e2-35520cec984c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:19.669558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a16a7-5109-4bf9-84e2-35520cec984c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:19.681631 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1076/2166] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:19.682985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a16a7-5109-4bf9-84e2-35520cec984c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:19.698727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a16a7-5109-4bf9-84e2-35520cec984c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:19.706563 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba400ac-7450-49c1-b6a7-6c32167ae140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:19.707232 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba400ac-7450-49c1-b6a7-6c32167ae140 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:19.707499 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba400ac-7450-49c1-b6a7-6c32167ae140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:19.707765 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba400ac-7450-49c1-b6a7-6c32167ae140 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:19.708391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba400ac-7450-49c1-b6a7-6c32167ae140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:19.711664 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba400ac-7450-49c1-b6a7-6c32167ae140 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:19.748243 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1077/2167] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:19 2022] POST /identity/v3/users => generated 284 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:19.749551 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba400ac-7450-49c1-b6a7-6c32167ae140 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:19.763262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba400ac-7450-49c1-b6a7-6c32167ae140 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:19.770431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b3935-6ef9-4f9f-be62-6b75654f86c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:19.771045 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b3935-6ef9-4f9f-be62-6b75654f86c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:19.772612 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85abbe2-1803-4aca-b5a4-5da84f60350e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:19.773397 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85abbe2-1803-4aca-b5a4-5da84f60350e service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:19.773486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85abbe2-1803-4aca-b5a4-5da84f60350e service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:19.773758 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85abbe2-1803-4aca-b5a4-5da84f60350e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:19.774496 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b3935-6ef9-4f9f-be62-6b75654f86c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:19.774776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b3935-6ef9-4f9f-be62-6b75654f86c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:19.775427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b3935-6ef9-4f9f-be62-6b75654f86c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:19.777448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b3935-6ef9-4f9f-be62-6b75654f86c8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:19.779802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f85abbe2-1803-4aca-b5a4-5da84f60350e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:19.789178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1078/2168] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:19.790097 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b3935-6ef9-4f9f-be62-6b75654f86c8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:19.801691 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b3935-6ef9-4f9f-be62-6b75654f86c8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:19.807061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bd59c-9e64-4f1f-9e9f-50c649d8c0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:19.807690 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bd59c-9e64-4f1f-9e9f-50c649d8c0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:19.807962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bd59c-9e64-4f1f-9e9f-50c649d8c0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:19.808362 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bd59c-9e64-4f1f-9e9f-50c649d8c0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:19.809478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bd59c-9e64-4f1f-9e9f-50c649d8c0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:19.811108 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bd59c-9e64-4f1f-9e9f-50c649d8c0a2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:19.831207 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1079/2169] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:19.831207 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bd59c-9e64-4f1f-9e9f-50c649d8c0a2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:19.851410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bd59c-9e64-4f1f-9e9f-50c649d8c0a2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:19.856689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c5d25-4c9b-4c7f-902a-cf9630c9dabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:19.857554 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c5d25-4c9b-4c7f-902a-cf9630c9dabe admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:19.857842 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c5d25-4c9b-4c7f-902a-cf9630c9dabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:19.858121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c5d25-4c9b-4c7f-902a-cf9630c9dabe admin admin] PATH_INFO: `/v3/projects/e6f8f2acb2b9479e99a9858dfbc0c055/users/41e5fc59cdc14008b05fd15ca180542a/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:19.872315 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85abbe2-1803-4aca-b5a4-5da84f60350e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:19.874073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85abbe2-1803-4aca-b5a4-5da84f60350e service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:19.874882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c5d25-4c9b-4c7f-902a-cf9630c9dabe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f8f2acb2b9479e99a9858dfbc0c055, user_id=41e5fc59cdc14008b05fd15ca180542a, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:19.877739 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c5d25-4c9b-4c7f-902a-cf9630c9dabe admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:19.890995 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1091/2170] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:19.892276 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85abbe2-1803-4aca-b5a4-5da84f60350e service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:19.898881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1080/2171] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:19 2022] PUT /identity/v3/projects/e6f8f2acb2b9479e99a9858dfbc0c055/users/41e5fc59cdc14008b05fd15ca180542a/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:19.904144 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bdf88-b15e-4f74-b44c-7b9c92e9a88a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:19.904144 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bdf88-b15e-4f74-b44c-7b9c92e9a88a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:19.904404 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bdf88-b15e-4f74-b44c-7b9c92e9a88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:19.905340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85abbe2-1803-4aca-b5a4-5da84f60350e service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:19.926303 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0b6bdf88-b15e-4f74-b44c-7b9c92e9a88a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:19.928099 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0b6bdf88-b15e-4f74-b44c-7b9c92e9a88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:20.003867 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10ab88-c4cc-4786-aac8-ad67c85edaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:20.004598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10ab88-c4cc-4786-aac8-ad67c85edaee admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:20.004942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10ab88-c4cc-4786-aac8-ad67c85edaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:20.005332 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10ab88-c4cc-4786-aac8-ad67c85edaee admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:20.006662 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10ab88-c4cc-4786-aac8-ad67c85edaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:20.008999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10ab88-c4cc-4786-aac8-ad67c85edaee admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:20.019072 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1081/2172] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:20.023685 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1092/2173] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:20.028174 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bdf88-b15e-4f74-b44c-7b9c92e9a88a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:20.034158 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10ab88-c4cc-4786-aac8-ad67c85edaee admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:20.037211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4e10ab88-c4cc-4786-aac8-ad67c85edaee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:20.038940 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bdf88-b15e-4f74-b44c-7b9c92e9a88a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:20.044397 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29870c0-2d8b-40c5-8146-d65ff7fbce86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:20.045063 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29870c0-2d8b-40c5-8146-d65ff7fbce86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:20.045335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29870c0-2d8b-40c5-8146-d65ff7fbce86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:20.045654 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29870c0-2d8b-40c5-8146-d65ff7fbce86 admin admin] PATH_INFO: `/v3/projects/3dc4dfdc28074694a18a676f65ba4c46/users/93db9a3e253846f8bc38971049a46697/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:20.064284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29870c0-2d8b-40c5-8146-d65ff7fbce86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc4dfdc28074694a18a676f65ba4c46, user_id=93db9a3e253846f8bc38971049a46697, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:20.067402 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29870c0-2d8b-40c5-8146-d65ff7fbce86 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:20.087153 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1082/2174] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:20 2022] PUT /identity/v3/projects/3dc4dfdc28074694a18a676f65ba4c46/users/93db9a3e253846f8bc38971049a46697/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:20.097093 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f672d-9460-4c43-acb8-832d9759c717 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:20.097471 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:20.097657 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f672d-9460-4c43-acb8-832d9759c717 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:20.097941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f672d-9460-4c43-acb8-832d9759c717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:20.131619 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7b5f672d-9460-4c43-acb8-832d9759c717 None None] MFA Rules not processed for user `93db9a3e253846f8bc38971049a46697`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:20.133160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7b5f672d-9460-4c43-acb8-832d9759c717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:20.139453 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10ab88-c4cc-4786-aac8-ad67c85edaee admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:20.206665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d192a72-9322-4c58-8da7-fb34b71d81cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:20.207478 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d192a72-9322-4c58-8da7-fb34b71d81cb service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:20.207886 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d192a72-9322-4c58-8da7-fb34b71d81cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:20.208214 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d192a72-9322-4c58-8da7-fb34b71d81cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:20.210569 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:20.225540 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1083/2175] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:20.229562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f672d-9460-4c43-acb8-832d9759c717 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:20.319811 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d192a72-9322-4c58-8da7-fb34b71d81cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:20.321433 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d192a72-9322-4c58-8da7-fb34b71d81cb service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:20.339555 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f672d-9460-4c43-acb8-832d9759c717 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:20.340756 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1093/2176] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:10:20.348187 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311c810-f079-4f0e-8f71-b8f961c5d034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:20.349821 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311c810-f079-4f0e-8f71-b8f961c5d034 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:20.350393 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311c810-f079-4f0e-8f71-b8f961c5d034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:20.350882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311c810-f079-4f0e-8f71-b8f961c5d034 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:20.352782 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311c810-f079-4f0e-8f71-b8f961c5d034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:20.369568 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311c810-f079-4f0e-8f71-b8f961c5d034 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:20.438029 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1084/2177] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:20 2022] POST /identity/v3/projects => generated 369 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:20.442253 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d192a72-9322-4c58-8da7-fb34b71d81cb service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:20.457636 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d192a72-9322-4c58-8da7-fb34b71d81cb service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:20.563135 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9dba7-f32b-49a4-a619-3d3f53c94b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:20.563773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9dba7-f32b-49a4-a619-3d3f53c94b32 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:20.564054 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9dba7-f32b-49a4-a619-3d3f53c94b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:20.564321 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9dba7-f32b-49a4-a619-3d3f53c94b32 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:20.564975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9dba7-f32b-49a4-a619-3d3f53c94b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:20.567552 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9dba7-f32b-49a4-a619-3d3f53c94b32 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:20.592698 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1094/2178] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:20 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:20.596860 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311c810-f079-4f0e-8f71-b8f961c5d034 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:20.610149 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311c810-f079-4f0e-8f71-b8f961c5d034 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:20.619444 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bc202-d342-4e39-94af-b05a1258eda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:20.620139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bc202-d342-4e39-94af-b05a1258eda6 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:20.620515 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bc202-d342-4e39-94af-b05a1258eda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:20.620736 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bc202-d342-4e39-94af-b05a1258eda6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:20.621995 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bc202-d342-4e39-94af-b05a1258eda6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:20.623962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bc202-d342-4e39-94af-b05a1258eda6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:20.657814 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1085/2179] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:20.661765 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9dba7-f32b-49a4-a619-3d3f53c94b32 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:20.673496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9dba7-f32b-49a4-a619-3d3f53c94b32 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:20.678463 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921cdc7-f6c1-470d-bbae-993038b8e9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:20.679239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921cdc7-f6c1-470d-bbae-993038b8e9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:20.679783 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921cdc7-f6c1-470d-bbae-993038b8e9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:20.679932 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921cdc7-f6c1-470d-bbae-993038b8e9ae admin admin] PATH_INFO: `/v3/projects/aefe010bc49442e886fb96e9ad3a03ca/users/970cf8fd751744d195209d7bde40e099/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:20.701629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921cdc7-f6c1-470d-bbae-993038b8e9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=aefe010bc49442e886fb96e9ad3a03ca, user_id=970cf8fd751744d195209d7bde40e099, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:20.704450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921cdc7-f6c1-470d-bbae-993038b8e9ae admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:20.718301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:20.732446 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1095/2180] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:20 2022] PUT /identity/v3/projects/aefe010bc49442e886fb96e9ad3a03ca/users/970cf8fd751744d195209d7bde40e099/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:20.734695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bc202-d342-4e39-94af-b05a1258eda6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:20.753472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bc202-d342-4e39-94af-b05a1258eda6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:20.938412 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921cdc7-f6c1-470d-bbae-993038b8e9ae admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:20.940380 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5921cdc7-f6c1-470d-bbae-993038b8e9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:21.014494 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03aba3b-f549-4912-bc05-09df0c61ffdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:21.015380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03aba3b-f549-4912-bc05-09df0c61ffdc admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:21.016146 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03aba3b-f549-4912-bc05-09df0c61ffdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:21.016543 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03aba3b-f549-4912-bc05-09df0c61ffdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:21.017722 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03aba3b-f549-4912-bc05-09df0c61ffdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:21.021854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03aba3b-f549-4912-bc05-09df0c61ffdc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:21.042595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1086/2181] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:21.046153 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03aba3b-f549-4912-bc05-09df0c61ffdc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:21.060486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921cdc7-f6c1-470d-bbae-993038b8e9ae admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:21.062406 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03aba3b-f549-4912-bc05-09df0c61ffdc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:21.070145 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a4a81-9def-48f9-92e5-2a29cf2c11cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:21.071624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a4a81-9def-48f9-92e5-2a29cf2c11cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:21.072018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a4a81-9def-48f9-92e5-2a29cf2c11cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:21.072351 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a4a81-9def-48f9-92e5-2a29cf2c11cf admin admin] PATH_INFO: `/v3/projects/aefe010bc49442e886fb96e9ad3a03ca/users/970cf8fd751744d195209d7bde40e099/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:21.072694 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891dab2-e2b5-4126-9f9e-fae72736da07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:21.073396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891dab2-e2b5-4126-9f9e-fae72736da07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:21.074330 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891dab2-e2b5-4126-9f9e-fae72736da07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:21.074582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891dab2-e2b5-4126-9f9e-fae72736da07 admin admin] PATH_INFO: `/v3/users/46d3b3b58d8e4b2c812f034c674bae99` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:21.075983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891dab2-e2b5-4126-9f9e-fae72736da07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d3b3b58d8e4b2c812f034c674bae99)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:21.078048 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891dab2-e2b5-4126-9f9e-fae72736da07 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:21.079287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a4a81-9def-48f9-92e5-2a29cf2c11cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=aefe010bc49442e886fb96e9ad3a03ca, user_id=970cf8fd751744d195209d7bde40e099, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:21.081931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a4a81-9def-48f9-92e5-2a29cf2c11cf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:21.098137 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1087/2182] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:21 2022] PUT /identity/v3/projects/aefe010bc49442e886fb96e9ad3a03ca/users/970cf8fd751744d195209d7bde40e099/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:21.112219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b2467-22be-4b52-97e6-fdb1f88b837b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:21.113143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b2467-22be-4b52-97e6-fdb1f88b837b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:21.113666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b2467-22be-4b52-97e6-fdb1f88b837b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:21.170244 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b62b2467-22be-4b52-97e6-fdb1f88b837b None None] MFA Rules not processed for user `970cf8fd751744d195209d7bde40e099`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:21.171951 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b62b2467-22be-4b52-97e6-fdb1f88b837b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:21.188888 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0891dab2-e2b5-4126-9f9e-fae72736da07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d3b3b58d8e4b2c812f034c674bae99'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:21.201243 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0891dab2-e2b5-4126-9f9e-fae72736da07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d3b3b58d8e4b2c812f034c674bae99'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:21.203786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0891dab2-e2b5-4126-9f9e-fae72736da07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d3b3b58d8e4b2c812f034c674bae99'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:21.234503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0891dab2-e2b5-4126-9f9e-fae72736da07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d3b3b58d8e4b2c812f034c674bae99'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:21.244613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0891dab2-e2b5-4126-9f9e-fae72736da07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d3b3b58d8e4b2c812f034c674bae99'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:21.259213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1096/2183] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:20 2022] DELETE /identity/v3/users/46d3b3b58d8e4b2c812f034c674bae99 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:21.259661 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:21.264533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcfe1f-be65-4dd2-b6b9-0dafdce1a1b4 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:21.264940 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcfe1f-be65-4dd2-b6b9-0dafdce1a1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:21.265475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcfe1f-be65-4dd2-b6b9-0dafdce1a1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:21.294396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-67dcfe1f-be65-4dd2-b6b9-0dafdce1a1b4 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:21.295880 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-67dcfe1f-be65-4dd2-b6b9-0dafdce1a1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:21.302522 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1088/2184] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:21.317057 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b2467-22be-4b52-97e6-fdb1f88b837b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:21.319766 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b62b2467-22be-4b52-97e6-fdb1f88b837b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:21.425723 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1097/2185] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:21.429720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f79015-d687-4758-9810-3e52162a72d4 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:21.430248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f79015-d687-4758-9810-3e52162a72d4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:21.430715 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f79015-d687-4758-9810-3e52162a72d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:21.432801 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b2467-22be-4b52-97e6-fdb1f88b837b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:21.469847 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-20f79015-d687-4758-9810-3e52162a72d4 None None] MFA Rules not processed for user `41e5fc59cdc14008b05fd15ca180542a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:21.471701 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-20f79015-d687-4758-9810-3e52162a72d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:21.480508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:21.509689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4d3d7-e923-4a29-b85f-34a0c5b0f75a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:21.510313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4d3d7-e923-4a29-b85f-34a0c5b0f75a service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:21.510584 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4d3d7-e923-4a29-b85f-34a0c5b0f75a service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:21.510850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4d3d7-e923-4a29-b85f-34a0c5b0f75a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:21.606776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4d3d7-e923-4a29-b85f-34a0c5b0f75a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:21.608966 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4d3d7-e923-4a29-b85f-34a0c5b0f75a service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:21.610918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1098/2186] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:21.611840 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f79015-d687-4758-9810-3e52162a72d4 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:21.617700 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-20f79015-d687-4758-9810-3e52162a72d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:21.624159 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1089/2187] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:10:21.643318 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4d3d7-e923-4a29-b85f-34a0c5b0f75a service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:21.644982 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f8d4d3d7-e923-4a29-b85f-34a0c5b0f75a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:21.658247 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4d3d7-e923-4a29-b85f-34a0c5b0f75a service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:21.664254 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e573246-9670-488e-8159-5e1b8018c025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:21.664797 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e573246-9670-488e-8159-5e1b8018c025 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:21.665072 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e573246-9670-488e-8159-5e1b8018c025 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:21.665378 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e573246-9670-488e-8159-5e1b8018c025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:21.676846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e573246-9670-488e-8159-5e1b8018c025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:21.678532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e573246-9670-488e-8159-5e1b8018c025 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:21.690848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1090/2188] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:10:21.711265 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e573246-9670-488e-8159-5e1b8018c025 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:21.731671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e573246-9670-488e-8159-5e1b8018c025 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:21.734972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f79015-d687-4758-9810-3e52162a72d4 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:21.741300 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08828e1e-510d-4b4a-9296-c0575c3e49e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:21.741932 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08828e1e-510d-4b4a-9296-c0575c3e49e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:21.742210 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08828e1e-510d-4b4a-9296-c0575c3e49e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:21.742482 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08828e1e-510d-4b4a-9296-c0575c3e49e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:21.744182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b67077-e3ec-4fdc-95e6-bf472eeffd1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:21.748142 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b67077-e3ec-4fdc-95e6-bf472eeffd1b service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:21.750054 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-08828e1e-510d-4b4a-9296-c0575c3e49e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:21.750182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b67077-e3ec-4fdc-95e6-bf472eeffd1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:21.750182 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b67077-e3ec-4fdc-95e6-bf472eeffd1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:21.763750 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b67077-e3ec-4fdc-95e6-bf472eeffd1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:21.766141 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b67077-e3ec-4fdc-95e6-bf472eeffd1b service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:21.787233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1099/2189] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:21.832382 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:21.918208 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08828e1e-510d-4b4a-9296-c0575c3e49e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:21.923611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08828e1e-510d-4b4a-9296-c0575c3e49e7 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:21.942327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1091/2190] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:10:22.163012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da593ed-d9f8-48fa-85e6-95c4601d50e0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:22.163343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da593ed-d9f8-48fa-85e6-95c4601d50e0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:22.163609 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da593ed-d9f8-48fa-85e6-95c4601d50e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:22.212670 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4da593ed-d9f8-48fa-85e6-95c4601d50e0 None None] MFA Rules not processed for user `7e0a49cccc7c49f385fdfe774fec90fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:22.214025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4da593ed-d9f8-48fa-85e6-95c4601d50e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:22.245354 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08828e1e-510d-4b4a-9296-c0575c3e49e7 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:22.249499 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-08828e1e-510d-4b4a-9296-c0575c3e49e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:22.276466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08828e1e-510d-4b4a-9296-c0575c3e49e7 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:22.295329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225aa38-66ce-4862-a9dc-fbb4ba47b02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:22.296645 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225aa38-66ce-4862-a9dc-fbb4ba47b02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:22.297152 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225aa38-66ce-4862-a9dc-fbb4ba47b02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:22.297441 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225aa38-66ce-4862-a9dc-fbb4ba47b02c admin admin] PATH_INFO: `/v3/projects/d541cba6614a48f3be8500c4aa80d365` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:22.299770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225aa38-66ce-4862-a9dc-fbb4ba47b02c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d541cba6614a48f3be8500c4aa80d365)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:22.304993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225aa38-66ce-4862-a9dc-fbb4ba47b02c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:22.331861 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1100/2191] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:22.381750 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f225aa38-66ce-4862-a9dc-fbb4ba47b02c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd541cba6614a48f3be8500c4aa80d365', 'request_id': 'req-f225aa38-66ce-4862-a9dc-fbb4ba47b02c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:22.388822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f225aa38-66ce-4862-a9dc-fbb4ba47b02c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd541cba6614a48f3be8500c4aa80d365', 'request_id': 'req-f225aa38-66ce-4862-a9dc-fbb4ba47b02c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:22.397942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f225aa38-66ce-4862-a9dc-fbb4ba47b02c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd541cba6614a48f3be8500c4aa80d365', 'request_id': 'req-f225aa38-66ce-4862-a9dc-fbb4ba47b02c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:22.426803 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f225aa38-66ce-4862-a9dc-fbb4ba47b02c admin admin] The token cache is being invalidate because project d541cba6614a48f3be8500c4aa80d365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:22.427872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f225aa38-66ce-4862-a9dc-fbb4ba47b02c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:22.428397 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f225aa38-66ce-4862-a9dc-fbb4ba47b02c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:22.430152 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1092/2192] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:22 2022] DELETE /identity/v3/projects/d541cba6614a48f3be8500c4aa80d365 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:22.434155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da593ed-d9f8-48fa-85e6-95c4601d50e0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:22.446863 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da593ed-d9f8-48fa-85e6-95c4601d50e0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:22.508836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:22.518314 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc1d47-ce45-45e0-a4b8-c214a056e92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:22.519071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc1d47-ce45-45e0-a4b8-c214a056e92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:22.519456 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc1d47-ce45-45e0-a4b8-c214a056e92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:22.519788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc1d47-ce45-45e0-a4b8-c214a056e92e admin admin] PATH_INFO: `/v3/users/656eef2304e944f7ba594b81c6de04e4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:22.521397 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc1d47-ce45-45e0-a4b8-c214a056e92e admin admin] RBAC: Authorizing `identity:delete_user(user_id=656eef2304e944f7ba594b81c6de04e4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:22.523833 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc1d47-ce45-45e0-a4b8-c214a056e92e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:22.595205 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dfbc1d47-ce45-45e0-a4b8-c214a056e92e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656eef2304e944f7ba594b81c6de04e4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:22.606034 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dfbc1d47-ce45-45e0-a4b8-c214a056e92e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656eef2304e944f7ba594b81c6de04e4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:22.606977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dfbc1d47-ce45-45e0-a4b8-c214a056e92e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656eef2304e944f7ba594b81c6de04e4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:22.631026 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dfbc1d47-ce45-45e0-a4b8-c214a056e92e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656eef2304e944f7ba594b81c6de04e4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:22.640846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dfbc1d47-ce45-45e0-a4b8-c214a056e92e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656eef2304e944f7ba594b81c6de04e4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:22.648536 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1101/2193] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:22 2022] DELETE /identity/v3/users/656eef2304e944f7ba594b81c6de04e4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:23.226444 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225aa38-66ce-4862-a9dc-fbb4ba47b02c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:23.228187 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f225aa38-66ce-4862-a9dc-fbb4ba47b02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:23.248765 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225aa38-66ce-4862-a9dc-fbb4ba47b02c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:23.349288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e87b72-71ef-479f-8675-578b44b0a44f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:23.350255 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e87b72-71ef-479f-8675-578b44b0a44f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:23.351449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e87b72-71ef-479f-8675-578b44b0a44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:23.354068 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ff4e0-6c36-475b-85d7-a11e0ea3febe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:23.355337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ff4e0-6c36-475b-85d7-a11e0ea3febe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:23.355817 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ff4e0-6c36-475b-85d7-a11e0ea3febe admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:23.356475 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ff4e0-6c36-475b-85d7-a11e0ea3febe admin admin] PATH_INFO: `/v3/projects/14f889ab0a2c4d289d21aaa799c83726` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:23.359147 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ff4e0-6c36-475b-85d7-a11e0ea3febe admin admin] RBAC: Authorizing `identity:delete_project(project_id=14f889ab0a2c4d289d21aaa799c83726)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:23.361503 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ff4e0-6c36-475b-85d7-a11e0ea3febe admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:23.393149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-86e87b72-71ef-479f-8675-578b44b0a44f None None] MFA Rules not processed for user `41e5fc59cdc14008b05fd15ca180542a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:23.394776 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-86e87b72-71ef-479f-8675-578b44b0a44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:23.424795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9c7ff4e0-6c36-475b-85d7-a11e0ea3febe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f889ab0a2c4d289d21aaa799c83726', 'request_id': 'req-9c7ff4e0-6c36-475b-85d7-a11e0ea3febe'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:23.428204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:23.433070 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9c7ff4e0-6c36-475b-85d7-a11e0ea3febe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f889ab0a2c4d289d21aaa799c83726', 'request_id': 'req-9c7ff4e0-6c36-475b-85d7-a11e0ea3febe'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:23.441535 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9c7ff4e0-6c36-475b-85d7-a11e0ea3febe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f889ab0a2c4d289d21aaa799c83726', 'request_id': 'req-9c7ff4e0-6c36-475b-85d7-a11e0ea3febe'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:23.456352 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9c7ff4e0-6c36-475b-85d7-a11e0ea3febe admin admin] The token cache is being invalidate because project 14f889ab0a2c4d289d21aaa799c83726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:23.456898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9c7ff4e0-6c36-475b-85d7-a11e0ea3febe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:23.457707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9c7ff4e0-6c36-475b-85d7-a11e0ea3febe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:23.460253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1093/2194] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:23 2022] DELETE /identity/v3/projects/14f889ab0a2c4d289d21aaa799c83726 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:23.465399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1102/2195] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:23.465975 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78a556-fc0b-4cd4-9658-95eceeba08f7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:23.466324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78a556-fc0b-4cd4-9658-95eceeba08f7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:23.466605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78a556-fc0b-4cd4-9658-95eceeba08f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:23.511979 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-af78a556-fc0b-4cd4-9658-95eceeba08f7 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:23.513416 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-af78a556-fc0b-4cd4-9658-95eceeba08f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:23.599008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1094/2196] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:23.610403 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4efd1-8549-4104-9460-a52f7b91e8f8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:23.610403 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4efd1-8549-4104-9460-a52f7b91e8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:23.610403 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4efd1-8549-4104-9460-a52f7b91e8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:23.644167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c9b4efd1-8549-4104-9460-a52f7b91e8f8 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:23.645372 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c9b4efd1-8549-4104-9460-a52f7b91e8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:23.667477 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1103/2197] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:23.670415 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78a556-fc0b-4cd4-9658-95eceeba08f7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:23.689153 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78a556-fc0b-4cd4-9658-95eceeba08f7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:23.701834 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867461cc-6f6c-4988-baf2-f2333814e58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:23.702725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867461cc-6f6c-4988-baf2-f2333814e58a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:23.703261 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867461cc-6f6c-4988-baf2-f2333814e58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:23.703773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867461cc-6f6c-4988-baf2-f2333814e58a admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:23.704658 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867461cc-6f6c-4988-baf2-f2333814e58a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:10:23.705250 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867461cc-6f6c-4988-baf2-f2333814e58a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:23.707387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867461cc-6f6c-4988-baf2-f2333814e58a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:23.731623 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1095/2198] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:10:23.736414 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4efd1-8549-4104-9460-a52f7b91e8f8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:23.759420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4efd1-8549-4104-9460-a52f7b91e8f8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:23.765636 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f4e83-38bd-4f8e-81b8-1921f961574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:23.766252 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f4e83-38bd-4f8e-81b8-1921f961574d admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:23.766530 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f4e83-38bd-4f8e-81b8-1921f961574d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:23.766823 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f4e83-38bd-4f8e-81b8-1921f961574d admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:23.767461 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f4e83-38bd-4f8e-81b8-1921f961574d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:23.769340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f4e83-38bd-4f8e-81b8-1921f961574d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:23.806944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1104/2199] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:23 2022] POST /identity/v3/projects => generated 409 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:23.813352 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867461cc-6f6c-4988-baf2-f2333814e58a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:23.828057 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867461cc-6f6c-4988-baf2-f2333814e58a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:23.950490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11066d-6e91-42d5-ac26-633d11ccae9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:23.951959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11066d-6e91-42d5-ac26-633d11ccae9e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:23.952280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11066d-6e91-42d5-ac26-633d11ccae9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:23.952684 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11066d-6e91-42d5-ac26-633d11ccae9e admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:23.953435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11066d-6e91-42d5-ac26-633d11ccae9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:23.959233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11066d-6e91-42d5-ac26-633d11ccae9e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:23.994251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1096/2200] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:23 2022] POST /identity/v3/users => generated 305 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:23.995724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f4e83-38bd-4f8e-81b8-1921f961574d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:24.022557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f4e83-38bd-4f8e-81b8-1921f961574d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:24.028104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89e834-d5b1-4fc4-b534-925480381d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:24.029034 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89e834-d5b1-4fc4-b534-925480381d6b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:24.029482 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89e834-d5b1-4fc4-b534-925480381d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:24.029819 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89e834-d5b1-4fc4-b534-925480381d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:24.030593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89e834-d5b1-4fc4-b534-925480381d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:24.032788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89e834-d5b1-4fc4-b534-925480381d6b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:24.047116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1105/2201] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:24.052164 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11066d-6e91-42d5-ac26-633d11ccae9e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:24.064658 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11066d-6e91-42d5-ac26-633d11ccae9e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:24.076852 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c138028-f203-4120-8258-bcb36ca85baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:24.077564 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c138028-f203-4120-8258-bcb36ca85baf admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:24.077919 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c138028-f203-4120-8258-bcb36ca85baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:24.078264 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c138028-f203-4120-8258-bcb36ca85baf admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:24.079212 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c138028-f203-4120-8258-bcb36ca85baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:24.082067 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c138028-f203-4120-8258-bcb36ca85baf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:24.113071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1097/2202] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:24.115860 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89e834-d5b1-4fc4-b534-925480381d6b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:24.131236 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89e834-d5b1-4fc4-b534-925480381d6b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:24.144909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13d330-c001-4c98-8d26-f865a0ce1dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:24.146288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13d330-c001-4c98-8d26-f865a0ce1dec admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:24.147386 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13d330-c001-4c98-8d26-f865a0ce1dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:24.147770 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13d330-c001-4c98-8d26-f865a0ce1dec admin admin] PATH_INFO: `/v3/projects/28c9202177504a789bd7a3f2cb20193a/users/dbef7566610f49b6b15f40012bc0e528/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:24.183989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13d330-c001-4c98-8d26-f865a0ce1dec admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c9202177504a789bd7a3f2cb20193a, user_id=dbef7566610f49b6b15f40012bc0e528, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:24.187599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13d330-c001-4c98-8d26-f865a0ce1dec admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:24.207536 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1106/2203] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:24 2022] PUT /identity/v3/projects/28c9202177504a789bd7a3f2cb20193a/users/dbef7566610f49b6b15f40012bc0e528/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:24.218753 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf55b2-cbc1-4ec3-aede-1516a44ad88f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:24.219296 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf55b2-cbc1-4ec3-aede-1516a44ad88f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:24.219590 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf55b2-cbc1-4ec3-aede-1516a44ad88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:24.257934 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-13bf55b2-cbc1-4ec3-aede-1516a44ad88f None None] MFA Rules not processed for user `dbef7566610f49b6b15f40012bc0e528`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:24.259245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-13bf55b2-cbc1-4ec3-aede-1516a44ad88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:24.303320 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:24.347931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1098/2204] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:24 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:24.353176 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13d330-c001-4c98-8d26-f865a0ce1dec admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:24.393141 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:24.462193 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13d330-c001-4c98-8d26-f865a0ce1dec admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:24.470249 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6099ed-d854-4497-9048-33bfb525f9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:24.477136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6099ed-d854-4497-9048-33bfb525f9cb admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:24.477690 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6099ed-d854-4497-9048-33bfb525f9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:24.478138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6099ed-d854-4497-9048-33bfb525f9cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:24.478958 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6099ed-d854-4497-9048-33bfb525f9cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:24.481077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6099ed-d854-4497-9048-33bfb525f9cb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:24.536394 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1107/2205] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:24 2022] POST /identity/v3/projects => generated 409 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:24.541845 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf55b2-cbc1-4ec3-aede-1516a44ad88f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:24.566941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf55b2-cbc1-4ec3-aede-1516a44ad88f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:24.641821 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8774f-7aa5-42d5-9157-4f7392f2633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:24.642512 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8774f-7aa5-42d5-9157-4f7392f2633a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:24.656265 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8774f-7aa5-42d5-9157-4f7392f2633a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:24.656265 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8774f-7aa5-42d5-9157-4f7392f2633a admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:24.656265 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8774f-7aa5-42d5-9157-4f7392f2633a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:24.656265 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8774f-7aa5-42d5-9157-4f7392f2633a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:24.671103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1099/2206] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:24 2022] POST /identity/v3/users => generated 311 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:24.675484 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6099ed-d854-4497-9048-33bfb525f9cb admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:24.687719 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6099ed-d854-4497-9048-33bfb525f9cb admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:24.692793 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2914d-e3e2-4aef-bc74-c5f206695af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:24.693519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2914d-e3e2-4aef-bc74-c5f206695af1 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:24.693913 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2914d-e3e2-4aef-bc74-c5f206695af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:24.694250 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2914d-e3e2-4aef-bc74-c5f206695af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:24.694969 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2914d-e3e2-4aef-bc74-c5f206695af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:24.696726 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2914d-e3e2-4aef-bc74-c5f206695af1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:24.708088 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1108/2207] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:24.712870 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8774f-7aa5-42d5-9157-4f7392f2633a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:24.723781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8774f-7aa5-42d5-9157-4f7392f2633a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:24.733262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ea091-f031-4312-ad36-19061b61d1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:24.734043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ea091-f031-4312-ad36-19061b61d1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:24.734393 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ea091-f031-4312-ad36-19061b61d1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:24.734743 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ea091-f031-4312-ad36-19061b61d1a0 admin admin] PATH_INFO: `/v3/projects/618b4c1f467849858f0a04fffcb7fd68/users/1b9224380b3940909eb558ab0660392a/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:24.759962 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ea091-f031-4312-ad36-19061b61d1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=618b4c1f467849858f0a04fffcb7fd68, user_id=1b9224380b3940909eb558ab0660392a, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:24.763035 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ea091-f031-4312-ad36-19061b61d1a0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:24.800363 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1100/2208] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:24 2022] PUT /identity/v3/projects/618b4c1f467849858f0a04fffcb7fd68/users/1b9224380b3940909eb558ab0660392a/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:24.804507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2914d-e3e2-4aef-bc74-c5f206695af1 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:24.815403 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2914d-e3e2-4aef-bc74-c5f206695af1 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:24.893658 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c62c6-bf9d-4d2c-906a-8805e98a36f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:24.894300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c62c6-bf9d-4d2c-906a-8805e98a36f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:24.895184 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c62c6-bf9d-4d2c-906a-8805e98a36f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:24.895471 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c62c6-bf9d-4d2c-906a-8805e98a36f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:24.897013 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c62c6-bf9d-4d2c-906a-8805e98a36f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:24.898530 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c62c6-bf9d-4d2c-906a-8805e98a36f3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:24.924729 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1109/2209] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:24.926799 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ea091-f031-4312-ad36-19061b61d1a0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:24.938986 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ea091-f031-4312-ad36-19061b61d1a0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:24.945235 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40b2d3-8738-4662-bde3-b6b0a7e33816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:24.946301 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40b2d3-8738-4662-bde3-b6b0a7e33816 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:24.946993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40b2d3-8738-4662-bde3-b6b0a7e33816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:24.947492 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40b2d3-8738-4662-bde3-b6b0a7e33816 admin admin] PATH_INFO: `/v3/projects/618b4c1f467849858f0a04fffcb7fd68/users/1b9224380b3940909eb558ab0660392a/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:24.950296 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40b2d3-8738-4662-bde3-b6b0a7e33816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=618b4c1f467849858f0a04fffcb7fd68, user_id=1b9224380b3940909eb558ab0660392a, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:24.953136 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40b2d3-8738-4662-bde3-b6b0a7e33816 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:24.970063 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1101/2210] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:24 2022] PUT /identity/v3/projects/618b4c1f467849858f0a04fffcb7fd68/users/1b9224380b3940909eb558ab0660392a/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:24.982983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46055f6e-1d6a-4f0e-98a7-524d45450979 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:24.983307 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46055f6e-1d6a-4f0e-98a7-524d45450979 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:24.983604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46055f6e-1d6a-4f0e-98a7-524d45450979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:25.022836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-46055f6e-1d6a-4f0e-98a7-524d45450979 None None] MFA Rules not processed for user `1b9224380b3940909eb558ab0660392a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:25.024060 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-46055f6e-1d6a-4f0e-98a7-524d45450979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:25.150740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1110/2211] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:24 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:25.162933 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40b2d3-8738-4662-bde3-b6b0a7e33816 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:25.164760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5b40b2d3-8738-4662-bde3-b6b0a7e33816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:25.227918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40b2d3-8738-4662-bde3-b6b0a7e33816 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:25.231877 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0844abb-aaf3-44d9-bd54-1382e64cc02c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:25.232473 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0844abb-aaf3-44d9-bd54-1382e64cc02c service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:25.232746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0844abb-aaf3-44d9-bd54-1382e64cc02c service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:25.233013 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0844abb-aaf3-44d9-bd54-1382e64cc02c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:25.243814 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0844abb-aaf3-44d9-bd54-1382e64cc02c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:25.245252 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0844abb-aaf3-44d9-bd54-1382e64cc02c service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:25.256533 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1102/2212] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:25 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:25.488413 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46055f6e-1d6a-4f0e-98a7-524d45450979 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:25.489928 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-46055f6e-1d6a-4f0e-98a7-524d45450979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:25.509480 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46055f6e-1d6a-4f0e-98a7-524d45450979 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:25.513918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb55290-f112-464e-b1a3-cc4ed655b78a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:25.514519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb55290-f112-464e-b1a3-cc4ed655b78a service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:25.514794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb55290-f112-464e-b1a3-cc4ed655b78a service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:25.515104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb55290-f112-464e-b1a3-cc4ed655b78a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:25.527444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:25.591284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb55290-f112-464e-b1a3-cc4ed655b78a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:25.592753 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb55290-f112-464e-b1a3-cc4ed655b78a service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:25.608637 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1111/2213] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:25 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:10:25.939205 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0844abb-aaf3-44d9-bd54-1382e64cc02c service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:25.940756 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a0844abb-aaf3-44d9-bd54-1382e64cc02c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:26.003828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:26.052655 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0844abb-aaf3-44d9-bd54-1382e64cc02c service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:26.058486 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23275447-5952-4600-87ce-7a4e19354af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:26.059284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23275447-5952-4600-87ce-7a4e19354af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:26.059659 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23275447-5952-4600-87ce-7a4e19354af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:26.060156 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23275447-5952-4600-87ce-7a4e19354af7 admin admin] PATH_INFO: `/v3/users/93db9a3e253846f8bc38971049a46697` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:26.061972 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23275447-5952-4600-87ce-7a4e19354af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93db9a3e253846f8bc38971049a46697)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:26.063392 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23275447-5952-4600-87ce-7a4e19354af7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:26.140978 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-23275447-5952-4600-87ce-7a4e19354af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93db9a3e253846f8bc38971049a46697'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:26.141705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-23275447-5952-4600-87ce-7a4e19354af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93db9a3e253846f8bc38971049a46697'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:26.142632 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-23275447-5952-4600-87ce-7a4e19354af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93db9a3e253846f8bc38971049a46697'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:26.158061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-23275447-5952-4600-87ce-7a4e19354af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93db9a3e253846f8bc38971049a46697'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:26.175339 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-23275447-5952-4600-87ce-7a4e19354af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93db9a3e253846f8bc38971049a46697'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:26.195697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1103/2214] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:25 2022] DELETE /identity/v3/users/93db9a3e253846f8bc38971049a46697 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:26.200294 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49b0fb-4ad9-43bb-ba1f-2f956fd5af55 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:26.200575 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49b0fb-4ad9-43bb-ba1f-2f956fd5af55 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:26.200846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49b0fb-4ad9-43bb-ba1f-2f956fd5af55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:26.221262 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2c49b0fb-4ad9-43bb-ba1f-2f956fd5af55 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:26.222461 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2c49b0fb-4ad9-43bb-ba1f-2f956fd5af55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:26.282985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1112/2215] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:26.293764 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23275447-5952-4600-87ce-7a4e19354af7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:26.295299 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-23275447-5952-4600-87ce-7a4e19354af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:26.356266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23275447-5952-4600-87ce-7a4e19354af7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:26.360169 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4b44f-80c0-4b33-a446-e8391aca668b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:26.360775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4b44f-80c0-4b33-a446-e8391aca668b service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:26.361049 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4b44f-80c0-4b33-a446-e8391aca668b service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:26.361319 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4b44f-80c0-4b33-a446-e8391aca668b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:26.370723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4b44f-80c0-4b33-a446-e8391aca668b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:26.372172 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4b44f-80c0-4b33-a446-e8391aca668b service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:26.382627 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1104/2216] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:26.878376 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49b0fb-4ad9-43bb-ba1f-2f956fd5af55 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:26.881777 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2c49b0fb-4ad9-43bb-ba1f-2f956fd5af55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:26.918396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49b0fb-4ad9-43bb-ba1f-2f956fd5af55 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:26.924952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5e68d-f99d-408b-b8b5-8d6f5b371b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:26.925638 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5e68d-f99d-408b-b8b5-8d6f5b371b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:26.925922 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5e68d-f99d-408b-b8b5-8d6f5b371b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:26.926192 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5e68d-f99d-408b-b8b5-8d6f5b371b84 admin admin] PATH_INFO: `/v3/projects/3dc4dfdc28074694a18a676f65ba4c46` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:26.928637 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5e68d-f99d-408b-b8b5-8d6f5b371b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc4dfdc28074694a18a676f65ba4c46)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:26.931050 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5e68d-f99d-408b-b8b5-8d6f5b371b84 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:27.011925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4b5e68d-f99d-408b-b8b5-8d6f5b371b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc4dfdc28074694a18a676f65ba4c46', 'request_id': 'req-d4b5e68d-f99d-408b-b8b5-8d6f5b371b84'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:27.023406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4b5e68d-f99d-408b-b8b5-8d6f5b371b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc4dfdc28074694a18a676f65ba4c46', 'request_id': 'req-d4b5e68d-f99d-408b-b8b5-8d6f5b371b84'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:27.036185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4b5e68d-f99d-408b-b8b5-8d6f5b371b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc4dfdc28074694a18a676f65ba4c46', 'request_id': 'req-d4b5e68d-f99d-408b-b8b5-8d6f5b371b84'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:27.062745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4b5e68d-f99d-408b-b8b5-8d6f5b371b84 admin admin] The token cache is being invalidate because project 3dc4dfdc28074694a18a676f65ba4c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:27.063110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4b5e68d-f99d-408b-b8b5-8d6f5b371b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:27.063805 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4b5e68d-f99d-408b-b8b5-8d6f5b371b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:27.067626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1113/2217] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:26 2022] DELETE /identity/v3/projects/3dc4dfdc28074694a18a676f65ba4c46 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:27.072257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4b44f-80c0-4b33-a446-e8391aca668b service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:27.082804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4b44f-80c0-4b33-a446-e8391aca668b service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:27.149472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:27.173300 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf32c8-ffe8-4c76-833c-22aa50ecd5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:27.174126 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf32c8-ffe8-4c76-833c-22aa50ecd5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:27.174551 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf32c8-ffe8-4c76-833c-22aa50ecd5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:27.174957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf32c8-ffe8-4c76-833c-22aa50ecd5de admin admin] PATH_INFO: `/v3/users/970cf8fd751744d195209d7bde40e099` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:27.176587 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf32c8-ffe8-4c76-833c-22aa50ecd5de admin admin] RBAC: Authorizing `identity:delete_user(user_id=970cf8fd751744d195209d7bde40e099)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:27.179258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf32c8-ffe8-4c76-833c-22aa50ecd5de admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:27.268614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5fdf32c8-ffe8-4c76-833c-22aa50ecd5de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '970cf8fd751744d195209d7bde40e099'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:27.271445 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5fdf32c8-ffe8-4c76-833c-22aa50ecd5de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '970cf8fd751744d195209d7bde40e099'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:27.271445 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5fdf32c8-ffe8-4c76-833c-22aa50ecd5de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '970cf8fd751744d195209d7bde40e099'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:27.281644 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5fdf32c8-ffe8-4c76-833c-22aa50ecd5de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '970cf8fd751744d195209d7bde40e099'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:27.291894 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5fdf32c8-ffe8-4c76-833c-22aa50ecd5de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '970cf8fd751744d195209d7bde40e099'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:27.319743 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1105/2218] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:27 2022] DELETE /identity/v3/users/970cf8fd751744d195209d7bde40e099 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:27.673381 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5e68d-f99d-408b-b8b5-8d6f5b371b84 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:27.674798 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d4b5e68d-f99d-408b-b8b5-8d6f5b371b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:27.704356 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5e68d-f99d-408b-b8b5-8d6f5b371b84 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:27.752858 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:27.785550 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757d2b1-d968-4011-a7c3-2705509b84ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:27.786258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757d2b1-d968-4011-a7c3-2705509b84ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:27.786580 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757d2b1-d968-4011-a7c3-2705509b84ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:27.786848 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757d2b1-d968-4011-a7c3-2705509b84ab admin admin] PATH_INFO: `/v3/projects/aefe010bc49442e886fb96e9ad3a03ca` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:27.788012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757d2b1-d968-4011-a7c3-2705509b84ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=aefe010bc49442e886fb96e9ad3a03ca)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:27.789926 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757d2b1-d968-4011-a7c3-2705509b84ab admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:27.843963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f757d2b1-d968-4011-a7c3-2705509b84ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aefe010bc49442e886fb96e9ad3a03ca', 'request_id': 'req-f757d2b1-d968-4011-a7c3-2705509b84ab'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:27.849820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f757d2b1-d968-4011-a7c3-2705509b84ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aefe010bc49442e886fb96e9ad3a03ca', 'request_id': 'req-f757d2b1-d968-4011-a7c3-2705509b84ab'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:27.856076 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f757d2b1-d968-4011-a7c3-2705509b84ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aefe010bc49442e886fb96e9ad3a03ca', 'request_id': 'req-f757d2b1-d968-4011-a7c3-2705509b84ab'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:27.871495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f757d2b1-d968-4011-a7c3-2705509b84ab admin admin] The token cache is being invalidate because project aefe010bc49442e886fb96e9ad3a03ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:27.871944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f757d2b1-d968-4011-a7c3-2705509b84ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:27.872747 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f757d2b1-d968-4011-a7c3-2705509b84ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:27.874376 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1114/2219] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:27 2022] DELETE /identity/v3/projects/aefe010bc49442e886fb96e9ad3a03ca => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:27.879355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537d7ca-49e3-4e5f-a263-56c70ab0261a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:27.879659 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537d7ca-49e3-4e5f-a263-56c70ab0261a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:27.879935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537d7ca-49e3-4e5f-a263-56c70ab0261a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:27.902088 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6537d7ca-49e3-4e5f-a263-56c70ab0261a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:27.903446 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6537d7ca-49e3-4e5f-a263-56c70ab0261a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:27.975991 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1106/2220] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:27.983678 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14318a63-a505-4a3e-b5c1-7d5a07654750 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:27.984172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14318a63-a505-4a3e-b5c1-7d5a07654750 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:27.984291 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14318a63-a505-4a3e-b5c1-7d5a07654750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:28.004451 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-14318a63-a505-4a3e-b5c1-7d5a07654750 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:28.008091 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-14318a63-a505-4a3e-b5c1-7d5a07654750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:28.016995 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1115/2221] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:28.021632 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537d7ca-49e3-4e5f-a263-56c70ab0261a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:28.031918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537d7ca-49e3-4e5f-a263-56c70ab0261a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:28.038232 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14318a63-a505-4a3e-b5c1-7d5a07654750 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:28.039951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-14318a63-a505-4a3e-b5c1-7d5a07654750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:28.040197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cbee5-a194-49e9-b3c1-1f8071f381a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:28.040826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cbee5-a194-49e9-b3c1-1f8071f381a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:28.041102 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cbee5-a194-49e9-b3c1-1f8071f381a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:28.041370 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cbee5-a194-49e9-b3c1-1f8071f381a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:28.042015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cbee5-a194-49e9-b3c1-1f8071f381a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:10:28.042317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cbee5-a194-49e9-b3c1-1f8071f381a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:28.043957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cbee5-a194-49e9-b3c1-1f8071f381a7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:28.051999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14318a63-a505-4a3e-b5c1-7d5a07654750 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:28.057134 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1107/2222] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:10:28.057297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786231b-d442-49b4-a52c-65275855a611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:28.059781 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786231b-d442-49b4-a52c-65275855a611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:28.060062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786231b-d442-49b4-a52c-65275855a611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:28.060338 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786231b-d442-49b4-a52c-65275855a611 admin admin] PATH_INFO: `/v3/users/c2bffe144c8c448c8c978cc3d7df2628` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:28.061433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cbee5-a194-49e9-b3c1-1f8071f381a7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:28.061591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786231b-d442-49b4-a52c-65275855a611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2bffe144c8c448c8c978cc3d7df2628)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:28.063574 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786231b-d442-49b4-a52c-65275855a611 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:28.080196 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cbee5-a194-49e9-b3c1-1f8071f381a7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:28.085624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898c161-4156-4de7-b594-e70b295b521d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:28.086284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898c161-4156-4de7-b594-e70b295b521d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:28.086567 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898c161-4156-4de7-b594-e70b295b521d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:28.086837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898c161-4156-4de7-b594-e70b295b521d admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:28.087489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898c161-4156-4de7-b594-e70b295b521d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:28.089564 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898c161-4156-4de7-b594-e70b295b521d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:28.119122 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1108/2223] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:28 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:28.122106 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898c161-4156-4de7-b594-e70b295b521d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:28.124724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1786231b-d442-49b4-a52c-65275855a611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2bffe144c8c448c8c978cc3d7df2628'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:28.134886 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1786231b-d442-49b4-a52c-65275855a611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2bffe144c8c448c8c978cc3d7df2628'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:28.135559 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1786231b-d442-49b4-a52c-65275855a611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2bffe144c8c448c8c978cc3d7df2628'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:28.149369 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1786231b-d442-49b4-a52c-65275855a611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2bffe144c8c448c8c978cc3d7df2628'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:28.157184 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1786231b-d442-49b4-a52c-65275855a611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2bffe144c8c448c8c978cc3d7df2628'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:28.164819 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1116/2224] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:28 2022] DELETE /identity/v3/users/c2bffe144c8c448c8c978cc3d7df2628 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:28.169100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ff5f8-41ba-43f3-afaa-3e175487aec7 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:28.169363 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:28.169507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ff5f8-41ba-43f3-afaa-3e175487aec7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:28.169775 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ff5f8-41ba-43f3-afaa-3e175487aec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:28.189151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0f2ff5f8-41ba-43f3-afaa-3e175487aec7 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:28.190337 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0f2ff5f8-41ba-43f3-afaa-3e175487aec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:28.194499 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898c161-4156-4de7-b594-e70b295b521d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:28.220836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:28.261506 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1117/2225] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:28.263365 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b671e3d-179a-4148-987f-b7a00e9c39df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:28.264149 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b671e3d-179a-4148-987f-b7a00e9c39df admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:28.264484 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b671e3d-179a-4148-987f-b7a00e9c39df admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:28.265087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b671e3d-179a-4148-987f-b7a00e9c39df admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:28.265929 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b671e3d-179a-4148-987f-b7a00e9c39df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:28.268039 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b671e3d-179a-4148-987f-b7a00e9c39df admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:28.271868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ff5f8-41ba-43f3-afaa-3e175487aec7 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:28.273560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0f2ff5f8-41ba-43f3-afaa-3e175487aec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:28.303380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1109/2226] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:28 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:10:28.304878 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b671e3d-179a-4148-987f-b7a00e9c39df admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:28.307253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0b671e3d-179a-4148-987f-b7a00e9c39df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:28.323021 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b671e3d-179a-4148-987f-b7a00e9c39df admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:28.329059 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0413c3-1965-4627-a2f8-9e5b98a731d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:28.329907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0413c3-1965-4627-a2f8-9e5b98a731d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:28.330606 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0413c3-1965-4627-a2f8-9e5b98a731d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:28.331125 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0413c3-1965-4627-a2f8-9e5b98a731d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:28.332275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0413c3-1965-4627-a2f8-9e5b98a731d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:28.334978 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0413c3-1965-4627-a2f8-9e5b98a731d4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:28.345949 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ff5f8-41ba-43f3-afaa-3e175487aec7 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:28.347336 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1110/2227] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:28.351505 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0ff53-22a4-4eab-a6ce-0cc1bb1cadae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:28.352574 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0413c3-1965-4627-a2f8-9e5b98a731d4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:28.354010 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0ff53-22a4-4eab-a6ce-0cc1bb1cadae service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:28.354010 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0ff53-22a4-4eab-a6ce-0cc1bb1cadae service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:28.354272 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0ff53-22a4-4eab-a6ce-0cc1bb1cadae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:28.374244 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0413c3-1965-4627-a2f8-9e5b98a731d4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:28.380533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0ff53-22a4-4eab-a6ce-0cc1bb1cadae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:28.382325 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ab609-9e83-4a19-9511-815246093ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:28.382673 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0ff53-22a4-4eab-a6ce-0cc1bb1cadae service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:28.382974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ab609-9e83-4a19-9511-815246093ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:28.383262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ab609-9e83-4a19-9511-815246093ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:28.383534 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ab609-9e83-4a19-9511-815246093ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:28.384177 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ab609-9e83-4a19-9511-815246093ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:28.385919 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ab609-9e83-4a19-9511-815246093ba3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:28.394197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1118/2228] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:28.397769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1111/2229] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:28.401911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0ff53-22a4-4eab-a6ce-0cc1bb1cadae service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:28.411436 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0ff53-22a4-4eab-a6ce-0cc1bb1cadae service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:28.417292 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15920815-dd69-4f29-9e04-e3f8fc350654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:28.417943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15920815-dd69-4f29-9e04-e3f8fc350654 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:28.418255 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15920815-dd69-4f29-9e04-e3f8fc350654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:28.418507 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15920815-dd69-4f29-9e04-e3f8fc350654 admin admin] PATH_INFO: `/v3/projects/fc39227dc1fc4e18b7ee9ffe980da310/users/fe64df5e1d28400f85aeeba8ce3ed9e3/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:28.440445 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15920815-dd69-4f29-9e04-e3f8fc350654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc39227dc1fc4e18b7ee9ffe980da310, user_id=fe64df5e1d28400f85aeeba8ce3ed9e3, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:28.443619 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15920815-dd69-4f29-9e04-e3f8fc350654 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:28.467252 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1119/2230] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:28 2022] PUT /identity/v3/projects/fc39227dc1fc4e18b7ee9ffe980da310/users/fe64df5e1d28400f85aeeba8ce3ed9e3/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:28.475763 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300c4eb-8f6e-4c34-96be-a85f5b2d1c04 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:28.476048 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300c4eb-8f6e-4c34-96be-a85f5b2d1c04 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:28.476371 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300c4eb-8f6e-4c34-96be-a85f5b2d1c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:28.513836 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d300c4eb-8f6e-4c34-96be-a85f5b2d1c04 None None] MFA Rules not processed for user `fe64df5e1d28400f85aeeba8ce3ed9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:28.515427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d300c4eb-8f6e-4c34-96be-a85f5b2d1c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:28.600996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1112/2231] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:28.605792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15920815-dd69-4f29-9e04-e3f8fc350654 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:28.713812 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15920815-dd69-4f29-9e04-e3f8fc350654 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:28.720200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd024d-0d81-492c-bbd9-9f897003dd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:28.721406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd024d-0d81-492c-bbd9-9f897003dd56 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:28.721901 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd024d-0d81-492c-bbd9-9f897003dd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:28.723294 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd024d-0d81-492c-bbd9-9f897003dd56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:28.724851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd024d-0d81-492c-bbd9-9f897003dd56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:28.727408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd024d-0d81-492c-bbd9-9f897003dd56 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:28.763918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1120/2232] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:28 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:28.765547 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300c4eb-8f6e-4c34-96be-a85f5b2d1c04 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:28.767491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d300c4eb-8f6e-4c34-96be-a85f5b2d1c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:28.768023 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd024d-0d81-492c-bbd9-9f897003dd56 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:28.790698 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300c4eb-8f6e-4c34-96be-a85f5b2d1c04 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:28.830002 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:28.853669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:28.865959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd024d-0d81-492c-bbd9-9f897003dd56 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:28.871393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d9234-4246-4ba3-bff3-bf636dca65a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:28.872465 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d9234-4246-4ba3-bff3-bf636dca65a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:28.872749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d9234-4246-4ba3-bff3-bf636dca65a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:28.873037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d9234-4246-4ba3-bff3-bf636dca65a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:28.873762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d9234-4246-4ba3-bff3-bf636dca65a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:28.876519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d9234-4246-4ba3-bff3-bf636dca65a8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:28.878086 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7c48c-2e1e-453f-a99d-492b6ebfcbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:28.878723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7c48c-2e1e-453f-a99d-492b6ebfcbf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:28.879011 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7c48c-2e1e-453f-a99d-492b6ebfcbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:28.879307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7c48c-2e1e-453f-a99d-492b6ebfcbf2 admin admin] PATH_INFO: `/v3/projects/4d42de6592714edba7439d5a31639dd9` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:28.880500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7c48c-2e1e-453f-a99d-492b6ebfcbf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d42de6592714edba7439d5a31639dd9)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:28.882622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7c48c-2e1e-453f-a99d-492b6ebfcbf2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:28.901573 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1121/2233] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:28 2022] POST /identity/v3/users => generated 300 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:28.909564 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d9234-4246-4ba3-bff3-bf636dca65a8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:28.919031 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d9234-4246-4ba3-bff3-bf636dca65a8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:28.925155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd129385-c78c-4252-a18f-f08b2d39a61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:28.925798 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd129385-c78c-4252-a18f-f08b2d39a61b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:28.926082 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd129385-c78c-4252-a18f-f08b2d39a61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:28.926358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd129385-c78c-4252-a18f-f08b2d39a61b admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:28.927643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd129385-c78c-4252-a18f-f08b2d39a61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:28.929272 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd129385-c78c-4252-a18f-f08b2d39a61b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:28.949599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1122/2234] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:28.950561 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd129385-c78c-4252-a18f-f08b2d39a61b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:28.952235 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e0e7c48c-2e1e-453f-a99d-492b6ebfcbf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d42de6592714edba7439d5a31639dd9', 'request_id': 'req-e0e7c48c-2e1e-453f-a99d-492b6ebfcbf2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:28.962045 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e0e7c48c-2e1e-453f-a99d-492b6ebfcbf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d42de6592714edba7439d5a31639dd9', 'request_id': 'req-e0e7c48c-2e1e-453f-a99d-492b6ebfcbf2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:28.964786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd129385-c78c-4252-a18f-f08b2d39a61b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:28.970505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e0e7c48c-2e1e-453f-a99d-492b6ebfcbf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d42de6592714edba7439d5a31639dd9', 'request_id': 'req-e0e7c48c-2e1e-453f-a99d-492b6ebfcbf2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:28.994597 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e0e7c48c-2e1e-453f-a99d-492b6ebfcbf2 admin admin] The token cache is being invalidate because project 4d42de6592714edba7439d5a31639dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:28.994967 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e0e7c48c-2e1e-453f-a99d-492b6ebfcbf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:28.995704 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e0e7c48c-2e1e-453f-a99d-492b6ebfcbf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:29.002418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1113/2235] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:28 2022] DELETE /identity/v3/projects/4d42de6592714edba7439d5a31639dd9 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:29.004269 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794333c8-b827-4e50-a5fa-930c0fd07944 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:29.004586 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794333c8-b827-4e50-a5fa-930c0fd07944 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:29.004907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794333c8-b827-4e50-a5fa-930c0fd07944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:29.027472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-794333c8-b827-4e50-a5fa-930c0fd07944 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:29.028804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-794333c8-b827-4e50-a5fa-930c0fd07944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:29.043749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbcdec-3294-4c78-b775-779b3f01e484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:29.044554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbcdec-3294-4c78-b775-779b3f01e484 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:29.045069 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbcdec-3294-4c78-b775-779b3f01e484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:29.045445 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbcdec-3294-4c78-b775-779b3f01e484 admin admin] PATH_INFO: `/v3/projects/965c5451de304794a715b9c33f563813/users/e40bd2dabb0441299419623772e47806/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:29.064820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbcdec-3294-4c78-b775-779b3f01e484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965c5451de304794a715b9c33f563813, user_id=e40bd2dabb0441299419623772e47806, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:29.068990 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbcdec-3294-4c78-b775-779b3f01e484 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:29.085360 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1123/2236] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:28 2022] PUT /identity/v3/projects/965c5451de304794a715b9c33f563813/users/e40bd2dabb0441299419623772e47806/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:29.089672 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbcdec-3294-4c78-b775-779b3f01e484 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:29.091462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c1cbcdec-3294-4c78-b775-779b3f01e484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:29.099697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1114/2237] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:29.108074 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614f4db-8136-4654-82f3-77ae74f40dad None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:29.108895 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614f4db-8136-4654-82f3-77ae74f40dad None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:29.109276 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614f4db-8136-4654-82f3-77ae74f40dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:29.135141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6614f4db-8136-4654-82f3-77ae74f40dad None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:29.136767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6614f4db-8136-4654-82f3-77ae74f40dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:29.171381 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbcdec-3294-4c78-b775-779b3f01e484 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:29.179500 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb39daa-cd9b-4245-a1ac-a25f0a2511c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:29.180125 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb39daa-cd9b-4245-a1ac-a25f0a2511c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:29.180396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb39daa-cd9b-4245-a1ac-a25f0a2511c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:29.180660 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb39daa-cd9b-4245-a1ac-a25f0a2511c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:29.181300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb39daa-cd9b-4245-a1ac-a25f0a2511c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:29.182878 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb39daa-cd9b-4245-a1ac-a25f0a2511c8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:29.193771 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1124/2238] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:29.198071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb39daa-cd9b-4245-a1ac-a25f0a2511c8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:29.207045 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1115/2239] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:29.208053 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb39daa-cd9b-4245-a1ac-a25f0a2511c8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:29.211204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614f4db-8136-4654-82f3-77ae74f40dad None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:29.214152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d0e71-3fcc-46ff-b03f-7d35b7e9a7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:29.214820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d0e71-3fcc-46ff-b03f-7d35b7e9a7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:29.215150 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d0e71-3fcc-46ff-b03f-7d35b7e9a7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:29.215436 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d0e71-3fcc-46ff-b03f-7d35b7e9a7cc admin admin] PATH_INFO: `/v3/projects/965c5451de304794a715b9c33f563813/users/e40bd2dabb0441299419623772e47806/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:29.217330 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d0e71-3fcc-46ff-b03f-7d35b7e9a7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=965c5451de304794a715b9c33f563813, user_id=e40bd2dabb0441299419623772e47806, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:29.220085 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d0e71-3fcc-46ff-b03f-7d35b7e9a7cc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:29.220880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614f4db-8136-4654-82f3-77ae74f40dad None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:29.226733 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57cd8c-e9b6-4e47-a684-7202b76ff6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:29.227400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57cd8c-e9b6-4e47-a684-7202b76ff6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:29.227672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57cd8c-e9b6-4e47-a684-7202b76ff6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:29.227938 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57cd8c-e9b6-4e47-a684-7202b76ff6c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:29.228577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57cd8c-e9b6-4e47-a684-7202b76ff6c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:10:29.228876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57cd8c-e9b6-4e47-a684-7202b76ff6c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:29.230497 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57cd8c-e9b6-4e47-a684-7202b76ff6c9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:29.231733 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1125/2240] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:29 2022] PUT /identity/v3/projects/965c5451de304794a715b9c33f563813/users/e40bd2dabb0441299419623772e47806/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:29.240404 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:29.243828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1116/2241] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 07:10:29.244371 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067d920-b6fc-442f-b0ef-09816f1ca0a3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:29.244715 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067d920-b6fc-442f-b0ef-09816f1ca0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:29.245057 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067d920-b6fc-442f-b0ef-09816f1ca0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:29.248277 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57cd8c-e9b6-4e47-a684-7202b76ff6c9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:29.259847 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57cd8c-e9b6-4e47-a684-7202b76ff6c9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:29.275641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1067d920-b6fc-442f-b0ef-09816f1ca0a3 None None] MFA Rules not processed for user `e40bd2dabb0441299419623772e47806`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:29.276876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1067d920-b6fc-442f-b0ef-09816f1ca0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:29.285595 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:29.321886 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7635e05-5e51-4d21-a5a1-dfd7945240c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:29.322771 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7635e05-5e51-4d21-a5a1-dfd7945240c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:29.323243 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7635e05-5e51-4d21-a5a1-dfd7945240c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:29.324125 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7635e05-5e51-4d21-a5a1-dfd7945240c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:29.324749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7635e05-5e51-4d21-a5a1-dfd7945240c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:29.327036 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7635e05-5e51-4d21-a5a1-dfd7945240c9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:29.356011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1126/2242] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:29.357851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1117/2243] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:29 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:10:29.361642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067d920-b6fc-442f-b0ef-09816f1ca0a3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:29.368107 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7635e05-5e51-4d21-a5a1-dfd7945240c9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:29.371407 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f7635e05-5e51-4d21-a5a1-dfd7945240c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:29.373119 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067d920-b6fc-442f-b0ef-09816f1ca0a3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:29.438162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f79be1-290b-4626-b019-96881bf53923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:29.438821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f79be1-290b-4626-b019-96881bf53923 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:29.439119 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f79be1-290b-4626-b019-96881bf53923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:29.439393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f79be1-290b-4626-b019-96881bf53923 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:29.440115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f79be1-290b-4626-b019-96881bf53923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:29.442035 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f79be1-290b-4626-b019-96881bf53923 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:29.456631 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7635e05-5e51-4d21-a5a1-dfd7945240c9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:29.461822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64d71e-19a5-4323-adab-3576dc832477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:29.462635 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64d71e-19a5-4323-adab-3576dc832477 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:29.462918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64d71e-19a5-4323-adab-3576dc832477 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:29.463239 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64d71e-19a5-4323-adab-3576dc832477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:29.464375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1127/2244] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:29 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:29.468233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f79be1-290b-4626-b019-96881bf53923 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:29.478826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f79be1-290b-4626-b019-96881bf53923 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:29.483639 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453a651-d8a1-4abf-94ce-a5f1d8b54ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:29.484313 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453a651-d8a1-4abf-94ce-a5f1d8b54ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:29.484597 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453a651-d8a1-4abf-94ce-a5f1d8b54ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:29.484870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453a651-d8a1-4abf-94ce-a5f1d8b54ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:29.485513 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453a651-d8a1-4abf-94ce-a5f1d8b54ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:29.487078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453a651-d8a1-4abf-94ce-a5f1d8b54ff2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:29.498239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1128/2245] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:29.503903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453a651-d8a1-4abf-94ce-a5f1d8b54ff2 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:29.517101 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453a651-d8a1-4abf-94ce-a5f1d8b54ff2 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:29.522342 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc6964-43d4-4d9b-a36e-4ae370277355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:29.522944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc6964-43d4-4d9b-a36e-4ae370277355 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:29.523274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc6964-43d4-4d9b-a36e-4ae370277355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:29.523544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc6964-43d4-4d9b-a36e-4ae370277355 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:29.524181 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc6964-43d4-4d9b-a36e-4ae370277355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:29.525958 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc6964-43d4-4d9b-a36e-4ae370277355 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:29.539594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1129/2246] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:29.544547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc6964-43d4-4d9b-a36e-4ae370277355 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:29.546306 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64d71e-19a5-4323-adab-3576dc832477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:29.547906 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64d71e-19a5-4323-adab-3576dc832477 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:29.555815 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc6964-43d4-4d9b-a36e-4ae370277355 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:29.559698 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1118/2247] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:10:29.560467 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516d31a-65da-4e86-be97-5d999e52a1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:29.561116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516d31a-65da-4e86-be97-5d999e52a1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:29.561687 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516d31a-65da-4e86-be97-5d999e52a1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:29.561946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516d31a-65da-4e86-be97-5d999e52a1d8 admin admin] PATH_INFO: `/v3/projects/c6b89be3899d47f8a2113070c19785ee/users/689bb85821fd4564896a1e32edc78a19/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:29.577411 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a516d31a-65da-4e86-be97-5d999e52a1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b89be3899d47f8a2113070c19785ee, user_id=689bb85821fd4564896a1e32edc78a19, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:29.580064 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a516d31a-65da-4e86-be97-5d999e52a1d8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:29.598079 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1130/2248] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:29 2022] PUT /identity/v3/projects/c6b89be3899d47f8a2113070c19785ee/users/689bb85821fd4564896a1e32edc78a19/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:29.610491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcdd37-0674-4923-8753-9be32370be67 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:29.611755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcdd37-0674-4923-8753-9be32370be67 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:29.611755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcdd37-0674-4923-8753-9be32370be67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:29.657012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-57fcdd37-0674-4923-8753-9be32370be67 None None] MFA Rules not processed for user `689bb85821fd4564896a1e32edc78a19`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:29.658391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-57fcdd37-0674-4923-8753-9be32370be67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:29.668481 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516d31a-65da-4e86-be97-5d999e52a1d8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:29.686937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:29.729203 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:29.739122 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1119/2249] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:29.746481 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516d31a-65da-4e86-be97-5d999e52a1d8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:29.750393 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcdd37-0674-4923-8753-9be32370be67 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:29.751271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1dadf7-fa8c-45ca-9543-6da2920bb8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:29.751835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-57fcdd37-0674-4923-8753-9be32370be67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:29.751950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dadf7-fa8c-45ca-9543-6da2920bb8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:29.752261 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dadf7-fa8c-45ca-9543-6da2920bb8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:29.752536 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dadf7-fa8c-45ca-9543-6da2920bb8af admin admin] PATH_INFO: `/v3/users/fe64df5e1d28400f85aeeba8ce3ed9e3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:29.753662 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1dadf7-fa8c-45ca-9543-6da2920bb8af admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe64df5e1d28400f85aeeba8ce3ed9e3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:29.756616 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1dadf7-fa8c-45ca-9543-6da2920bb8af admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:29.817212 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcdd37-0674-4923-8753-9be32370be67 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:29.818948 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-cd1dadf7-fa8c-45ca-9543-6da2920bb8af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe64df5e1d28400f85aeeba8ce3ed9e3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:29.821116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1c743-b246-4a0a-ae27-1462751ba37a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44c764958784616b8bdbf59e5692ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:29.821805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1c743-b246-4a0a-ae27-1462751ba37a service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:29.822080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1c743-b246-4a0a-ae27-1462751ba37a service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:29.822347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1c743-b246-4a0a-ae27-1462751ba37a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:29.827115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-cd1dadf7-fa8c-45ca-9543-6da2920bb8af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe64df5e1d28400f85aeeba8ce3ed9e3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:29.827983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-cd1dadf7-fa8c-45ca-9543-6da2920bb8af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe64df5e1d28400f85aeeba8ce3ed9e3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:29.835112 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1c743-b246-4a0a-ae27-1462751ba37a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:29.836685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1c743-b246-4a0a-ae27-1462751ba37a service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:29.843849 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-cd1dadf7-fa8c-45ca-9543-6da2920bb8af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe64df5e1d28400f85aeeba8ce3ed9e3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:29.846348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1120/2250] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:10:29.851865 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-cd1dadf7-fa8c-45ca-9543-6da2920bb8af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe64df5e1d28400f85aeeba8ce3ed9e3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:29.862168 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1131/2251] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:29 2022] DELETE /identity/v3/users/fe64df5e1d28400f85aeeba8ce3ed9e3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:29.867634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda10da8-d1a9-45da-b4da-53cc802f6674 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:29.868068 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda10da8-d1a9-45da-b4da-53cc802f6674 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:29.868465 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda10da8-d1a9-45da-b4da-53cc802f6674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:29.892707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bda10da8-d1a9-45da-b4da-53cc802f6674 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:29.894159 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bda10da8-d1a9-45da-b4da-53cc802f6674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:29.967332 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1121/2252] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:29.974715 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1dadf7-fa8c-45ca-9543-6da2920bb8af admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:29.976241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cd1dadf7-fa8c-45ca-9543-6da2920bb8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:30.044109 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1dadf7-fa8c-45ca-9543-6da2920bb8af admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:30.050433 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d995f12-184d-46a6-85da-6773074c65dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:30.051112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d995f12-184d-46a6-85da-6773074c65dc service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:30.051399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d995f12-184d-46a6-85da-6773074c65dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:30.051668 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d995f12-184d-46a6-85da-6773074c65dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:30.064565 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d995f12-184d-46a6-85da-6773074c65dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:30.066616 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d995f12-184d-46a6-85da-6773074c65dc service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:30.079038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1132/2253] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:30.473162 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda10da8-d1a9-45da-b4da-53cc802f6674 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:30.474651 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bda10da8-d1a9-45da-b4da-53cc802f6674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:30.487429 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda10da8-d1a9-45da-b4da-53cc802f6674 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:30.497174 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947b2b2-59f0-4d54-b408-b0d3bf0903ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:30.498035 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947b2b2-59f0-4d54-b408-b0d3bf0903ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:30.498512 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947b2b2-59f0-4d54-b408-b0d3bf0903ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:30.498958 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947b2b2-59f0-4d54-b408-b0d3bf0903ff admin admin] PATH_INFO: `/v3/projects/fc39227dc1fc4e18b7ee9ffe980da310` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:30.500323 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947b2b2-59f0-4d54-b408-b0d3bf0903ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc39227dc1fc4e18b7ee9ffe980da310)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:30.502409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947b2b2-59f0-4d54-b408-b0d3bf0903ff admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:30.553706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0947b2b2-59f0-4d54-b408-b0d3bf0903ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc39227dc1fc4e18b7ee9ffe980da310', 'request_id': 'req-0947b2b2-59f0-4d54-b408-b0d3bf0903ff'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:30.559767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0947b2b2-59f0-4d54-b408-b0d3bf0903ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc39227dc1fc4e18b7ee9ffe980da310', 'request_id': 'req-0947b2b2-59f0-4d54-b408-b0d3bf0903ff'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:30.565168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0947b2b2-59f0-4d54-b408-b0d3bf0903ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc39227dc1fc4e18b7ee9ffe980da310', 'request_id': 'req-0947b2b2-59f0-4d54-b408-b0d3bf0903ff'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:30.566760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:30.579543 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0947b2b2-59f0-4d54-b408-b0d3bf0903ff admin admin] The token cache is being invalidate because project fc39227dc1fc4e18b7ee9ffe980da310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:30.579856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0947b2b2-59f0-4d54-b408-b0d3bf0903ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:30.580475 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0947b2b2-59f0-4d54-b408-b0d3bf0903ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:30.581948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1122/2254] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:30 2022] DELETE /identity/v3/projects/fc39227dc1fc4e18b7ee9ffe980da310 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:30.586509 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d995f12-184d-46a6-85da-6773074c65dc service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:30.595832 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d995f12-184d-46a6-85da-6773074c65dc service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:30.656272 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06864ad-83d1-4bcc-b067-e3803eeccb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:30.657014 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06864ad-83d1-4bcc-b067-e3803eeccb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:30.657297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06864ad-83d1-4bcc-b067-e3803eeccb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:30.657572 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06864ad-83d1-4bcc-b067-e3803eeccb2e admin admin] PATH_INFO: `/v3/users/e40bd2dabb0441299419623772e47806` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:30.658795 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06864ad-83d1-4bcc-b067-e3803eeccb2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e40bd2dabb0441299419623772e47806)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:30.660767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06864ad-83d1-4bcc-b067-e3803eeccb2e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:30.674263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:30.715828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d06864ad-83d1-4bcc-b067-e3803eeccb2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e40bd2dabb0441299419623772e47806'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:30.726336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d06864ad-83d1-4bcc-b067-e3803eeccb2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e40bd2dabb0441299419623772e47806'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:30.727008 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d06864ad-83d1-4bcc-b067-e3803eeccb2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e40bd2dabb0441299419623772e47806'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:30.741306 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d06864ad-83d1-4bcc-b067-e3803eeccb2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e40bd2dabb0441299419623772e47806'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:30.748678 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d06864ad-83d1-4bcc-b067-e3803eeccb2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e40bd2dabb0441299419623772e47806'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:30.754683 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1133/2255] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:30 2022] DELETE /identity/v3/users/e40bd2dabb0441299419623772e47806 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:31.165588 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947b2b2-59f0-4d54-b408-b0d3bf0903ff admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:31.167116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0947b2b2-59f0-4d54-b408-b0d3bf0903ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:31.181442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947b2b2-59f0-4d54-b408-b0d3bf0903ff admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:31.297116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405d78e-db64-4a49-b798-deac1501f14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:31.297899 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405d78e-db64-4a49-b798-deac1501f14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:31.298247 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405d78e-db64-4a49-b798-deac1501f14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:31.298528 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405d78e-db64-4a49-b798-deac1501f14e admin admin] PATH_INFO: `/v3/projects/965c5451de304794a715b9c33f563813` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:31.299758 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405d78e-db64-4a49-b798-deac1501f14e admin admin] RBAC: Authorizing `identity:delete_project(project_id=965c5451de304794a715b9c33f563813)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:31.301730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405d78e-db64-4a49-b798-deac1501f14e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:31.367659 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9405d78e-db64-4a49-b798-deac1501f14e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '965c5451de304794a715b9c33f563813', 'request_id': 'req-9405d78e-db64-4a49-b798-deac1501f14e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:31.376454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9405d78e-db64-4a49-b798-deac1501f14e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '965c5451de304794a715b9c33f563813', 'request_id': 'req-9405d78e-db64-4a49-b798-deac1501f14e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:31.394825 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9405d78e-db64-4a49-b798-deac1501f14e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '965c5451de304794a715b9c33f563813', 'request_id': 'req-9405d78e-db64-4a49-b798-deac1501f14e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:31.415802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06864ad-83d1-4bcc-b067-e3803eeccb2e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:31.417470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9405d78e-db64-4a49-b798-deac1501f14e admin admin] The token cache is being invalidate because project 965c5451de304794a715b9c33f563813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:31.417667 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d06864ad-83d1-4bcc-b067-e3803eeccb2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:31.417798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9405d78e-db64-4a49-b798-deac1501f14e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:31.418589 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9405d78e-db64-4a49-b798-deac1501f14e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:31.421489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1123/2256] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:31 2022] DELETE /identity/v3/projects/965c5451de304794a715b9c33f563813 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:31.426172 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026442c-3a56-491b-887c-abc53febc01c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:31.426455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026442c-3a56-491b-887c-abc53febc01c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:31.426726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026442c-3a56-491b-887c-abc53febc01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:31.436927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06864ad-83d1-4bcc-b067-e3803eeccb2e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:31.452868 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9026442c-3a56-491b-887c-abc53febc01c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:31.455256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9026442c-3a56-491b-887c-abc53febc01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:31.536667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1124/2257] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:31.543744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9764a59-f6c1-410b-997e-3a90b015d926 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:31.544222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9764a59-f6c1-410b-997e-3a90b015d926 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:31.544532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9764a59-f6c1-410b-997e-3a90b015d926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:31.555012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9dee3-444a-4b6f-8882-2cb1554e7671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:31.555800 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9dee3-444a-4b6f-8882-2cb1554e7671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:31.556152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9dee3-444a-4b6f-8882-2cb1554e7671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:31.556501 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9dee3-444a-4b6f-8882-2cb1554e7671 admin admin] PATH_INFO: `/v3/users/dbef7566610f49b6b15f40012bc0e528` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:31.557704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9dee3-444a-4b6f-8882-2cb1554e7671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbef7566610f49b6b15f40012bc0e528)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:31.559732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9dee3-444a-4b6f-8882-2cb1554e7671 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:31.581366 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e9764a59-f6c1-410b-997e-3a90b015d926 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:31.582619 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e9764a59-f6c1-410b-997e-3a90b015d926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:31.592274 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1125/2258] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:31.596885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9764a59-f6c1-410b-997e-3a90b015d926 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:31.607870 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9764a59-f6c1-410b-997e-3a90b015d926 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:31.613335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f98dc-4cf1-4f37-b282-bebb99ca2d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:31.613944 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f98dc-4cf1-4f37-b282-bebb99ca2d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:31.614222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f98dc-4cf1-4f37-b282-bebb99ca2d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:31.614523 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f98dc-4cf1-4f37-b282-bebb99ca2d34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:31.615194 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f98dc-4cf1-4f37-b282-bebb99ca2d34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:10:31.615499 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f98dc-4cf1-4f37-b282-bebb99ca2d34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:31.617090 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f98dc-4cf1-4f37-b282-bebb99ca2d34 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:31.632492 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-91d9dee3-444a-4b6f-8882-2cb1554e7671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbef7566610f49b6b15f40012bc0e528'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:31.633921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1126/2259] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 07:10:31.638956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f98dc-4cf1-4f37-b282-bebb99ca2d34 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:31.649493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-91d9dee3-444a-4b6f-8882-2cb1554e7671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbef7566610f49b6b15f40012bc0e528'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:31.650049 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:31.650169 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-91d9dee3-444a-4b6f-8882-2cb1554e7671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbef7566610f49b6b15f40012bc0e528'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:31.658117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f98dc-4cf1-4f37-b282-bebb99ca2d34 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:31.666457 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-91d9dee3-444a-4b6f-8882-2cb1554e7671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbef7566610f49b6b15f40012bc0e528'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:31.666873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193b96d-4026-45e9-8274-e497e84b0892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:31.667880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193b96d-4026-45e9-8274-e497e84b0892 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:31.668765 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193b96d-4026-45e9-8274-e497e84b0892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:31.669033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193b96d-4026-45e9-8274-e497e84b0892 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:31.669785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193b96d-4026-45e9-8274-e497e84b0892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:31.671924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193b96d-4026-45e9-8274-e497e84b0892 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:31.674878 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-91d9dee3-444a-4b6f-8882-2cb1554e7671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbef7566610f49b6b15f40012bc0e528'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:31.683136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1134/2260] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:31 2022] DELETE /identity/v3/users/dbef7566610f49b6b15f40012bc0e528 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:31.686293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105449f6-21b3-4273-9332-b84af8389a07 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:31.686651 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105449f6-21b3-4273-9332-b84af8389a07 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:31.686856 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105449f6-21b3-4273-9332-b84af8389a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:31.707394 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1127/2261] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:31 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:31.711409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-105449f6-21b3-4273-9332-b84af8389a07 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:31.712443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193b96d-4026-45e9-8274-e497e84b0892 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:31.712644 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-105449f6-21b3-4273-9332-b84af8389a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:31.714217 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f193b96d-4026-45e9-8274-e497e84b0892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:31.717093 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:31.802943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1135/2262] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:31.806601 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193b96d-4026-45e9-8274-e497e84b0892 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:31.811879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eada65b-d85b-4548-820c-cb93b0dbbe47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:31.812515 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eada65b-d85b-4548-820c-cb93b0dbbe47 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:31.813148 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eada65b-d85b-4548-820c-cb93b0dbbe47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:31.813148 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eada65b-d85b-4548-820c-cb93b0dbbe47 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:31.813791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eada65b-d85b-4548-820c-cb93b0dbbe47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:31.815877 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105449f6-21b3-4273-9332-b84af8389a07 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:31.816067 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eada65b-d85b-4548-820c-cb93b0dbbe47 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:31.820019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-105449f6-21b3-4273-9332-b84af8389a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:31.845900 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1128/2263] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:31 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:31.847202 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eada65b-d85b-4548-820c-cb93b0dbbe47 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:31.857308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eada65b-d85b-4548-820c-cb93b0dbbe47 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:31.862184 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c49dbf-2689-45e7-aa66-15f2c91a675d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:31.862776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c49dbf-2689-45e7-aa66-15f2c91a675d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:31.863053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c49dbf-2689-45e7-aa66-15f2c91a675d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:31.863355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c49dbf-2689-45e7-aa66-15f2c91a675d admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:31.864003 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c49dbf-2689-45e7-aa66-15f2c91a675d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:31.866690 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c49dbf-2689-45e7-aa66-15f2c91a675d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:31.876819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1129/2264] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:31.881527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c49dbf-2689-45e7-aa66-15f2c91a675d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:31.883422 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105449f6-21b3-4273-9332-b84af8389a07 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:31.887071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559d604-177a-4624-b9e1-94a42f6c107e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:31.887698 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559d604-177a-4624-b9e1-94a42f6c107e service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:31.887979 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559d604-177a-4624-b9e1-94a42f6c107e service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:31.888248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559d604-177a-4624-b9e1-94a42f6c107e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:31.891712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c49dbf-2689-45e7-aa66-15f2c91a675d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:31.898506 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559d604-177a-4624-b9e1-94a42f6c107e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:31.899235 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30f410-bbee-43ef-9322-78a426235f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:31.899975 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30f410-bbee-43ef-9322-78a426235f5c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:31.900110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559d604-177a-4624-b9e1-94a42f6c107e service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:31.900267 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30f410-bbee-43ef-9322-78a426235f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:31.900539 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30f410-bbee-43ef-9322-78a426235f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:31.901217 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30f410-bbee-43ef-9322-78a426235f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:31.902824 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30f410-bbee-43ef-9322-78a426235f5c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:31.909921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1136/2265] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:31.914267 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1130/2266] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:31.918374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559d604-177a-4624-b9e1-94a42f6c107e service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:31.928146 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559d604-177a-4624-b9e1-94a42f6c107e service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:31.933227 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd9ad5-b713-423b-b162-99f55bebb351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:31.934001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd9ad5-b713-423b-b162-99f55bebb351 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:31.934276 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd9ad5-b713-423b-b162-99f55bebb351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:31.934542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd9ad5-b713-423b-b162-99f55bebb351 admin admin] PATH_INFO: `/v3/projects/535182b9f1d847e9bb35b0b52c13550a/users/49f37d89472b46018a2fe455f4a6dcc3/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:31.953794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd9ad5-b713-423b-b162-99f55bebb351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535182b9f1d847e9bb35b0b52c13550a, user_id=49f37d89472b46018a2fe455f4a6dcc3, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:31.953794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd9ad5-b713-423b-b162-99f55bebb351 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:31.972276 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1137/2267] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:31 2022] PUT /identity/v3/projects/535182b9f1d847e9bb35b0b52c13550a/users/49f37d89472b46018a2fe455f4a6dcc3/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:31.983634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e003cd-b6bd-41b7-ab12-16c1ec9d3f64 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:31.983948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e003cd-b6bd-41b7-ab12-16c1ec9d3f64 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:31.984194 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e003cd-b6bd-41b7-ab12-16c1ec9d3f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:32.015991 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f3e003cd-b6bd-41b7-ab12-16c1ec9d3f64 None None] MFA Rules not processed for user `49f37d89472b46018a2fe455f4a6dcc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:32.017400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f3e003cd-b6bd-41b7-ab12-16c1ec9d3f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:32.102818 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1131/2268] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:32.107841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd9ad5-b713-423b-b162-99f55bebb351 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:32.215529 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd9ad5-b713-423b-b162-99f55bebb351 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:32.223480 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420688c-2e16-44d0-81cc-4b5cc6da009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:32.224937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420688c-2e16-44d0-81cc-4b5cc6da009a admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:32.225401 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420688c-2e16-44d0-81cc-4b5cc6da009a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:32.225823 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420688c-2e16-44d0-81cc-4b5cc6da009a admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:32.226617 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420688c-2e16-44d0-81cc-4b5cc6da009a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:32.229006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420688c-2e16-44d0-81cc-4b5cc6da009a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:32.251593 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e003cd-b6bd-41b7-ab12-16c1ec9d3f64 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:32.253405 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f3e003cd-b6bd-41b7-ab12-16c1ec9d3f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:32.276416 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1138/2269] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:32 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:10:32.277907 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420688c-2e16-44d0-81cc-4b5cc6da009a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:32.283315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e003cd-b6bd-41b7-ab12-16c1ec9d3f64 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:32.293595 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:32.331038 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:32.360399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3572469-7e7a-461c-92ae-baf5a75ff9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:32.361033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3572469-7e7a-461c-92ae-baf5a75ff9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:32.361333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3572469-7e7a-461c-92ae-baf5a75ff9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:32.361581 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3572469-7e7a-461c-92ae-baf5a75ff9a5 admin admin] PATH_INFO: `/v3/projects/28c9202177504a789bd7a3f2cb20193a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:32.362727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3572469-7e7a-461c-92ae-baf5a75ff9a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28c9202177504a789bd7a3f2cb20193a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:32.364714 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3572469-7e7a-461c-92ae-baf5a75ff9a5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:32.372662 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420688c-2e16-44d0-81cc-4b5cc6da009a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:32.385084 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff98d93-f6b7-42cc-a9c6-62ff96716a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:32.385899 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff98d93-f6b7-42cc-a9c6-62ff96716a2e admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:32.386200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff98d93-f6b7-42cc-a9c6-62ff96716a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:32.386477 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff98d93-f6b7-42cc-a9c6-62ff96716a2e admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:32.387120 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff98d93-f6b7-42cc-a9c6-62ff96716a2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:32.389045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff98d93-f6b7-42cc-a9c6-62ff96716a2e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:32.418887 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1139/2270] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:32 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:32.420475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff98d93-f6b7-42cc-a9c6-62ff96716a2e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:32.431251 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff98d93-f6b7-42cc-a9c6-62ff96716a2e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:32.436443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f3572469-7e7a-461c-92ae-baf5a75ff9a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28c9202177504a789bd7a3f2cb20193a', 'request_id': 'req-f3572469-7e7a-461c-92ae-baf5a75ff9a5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:32.447665 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f3572469-7e7a-461c-92ae-baf5a75ff9a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28c9202177504a789bd7a3f2cb20193a', 'request_id': 'req-f3572469-7e7a-461c-92ae-baf5a75ff9a5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:32.454425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f3572469-7e7a-461c-92ae-baf5a75ff9a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28c9202177504a789bd7a3f2cb20193a', 'request_id': 'req-f3572469-7e7a-461c-92ae-baf5a75ff9a5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:32.472141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f3572469-7e7a-461c-92ae-baf5a75ff9a5 admin admin] The token cache is being invalidate because project 28c9202177504a789bd7a3f2cb20193a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:32.472414 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f3572469-7e7a-461c-92ae-baf5a75ff9a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:32.473009 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f3572469-7e7a-461c-92ae-baf5a75ff9a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:32.475126 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1132/2271] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:32 2022] DELETE /identity/v3/projects/28c9202177504a789bd7a3f2cb20193a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:32.479134 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3572469-7e7a-461c-92ae-baf5a75ff9a5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:32.480599 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f3572469-7e7a-461c-92ae-baf5a75ff9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:32.525656 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570b214-9eb5-4a2f-8131-2bffdcbadac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:32.527689 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570b214-9eb5-4a2f-8131-2bffdcbadac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:32.528072 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570b214-9eb5-4a2f-8131-2bffdcbadac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:32.528774 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570b214-9eb5-4a2f-8131-2bffdcbadac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:32.529491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570b214-9eb5-4a2f-8131-2bffdcbadac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:32.531771 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570b214-9eb5-4a2f-8131-2bffdcbadac4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:32.547962 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1140/2272] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:32.553607 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570b214-9eb5-4a2f-8131-2bffdcbadac4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:32.555697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2570b214-9eb5-4a2f-8131-2bffdcbadac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:32.576731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570b214-9eb5-4a2f-8131-2bffdcbadac4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:32.578485 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3572469-7e7a-461c-92ae-baf5a75ff9a5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:32.583976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b799be-b912-4bec-86a6-53056e08c7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:32.584803 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab9b08-5c9b-45da-90db-635ace4c481f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:32.585522 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab9b08-5c9b-45da-90db-635ace4c481f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:32.585860 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab9b08-5c9b-45da-90db-635ace4c481f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:32.586197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab9b08-5c9b-45da-90db-635ace4c481f admin admin] PATH_INFO: `/v3/users/1b9224380b3940909eb558ab0660392a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:32.587590 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab9b08-5c9b-45da-90db-635ace4c481f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9224380b3940909eb558ab0660392a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:32.589556 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab9b08-5c9b-45da-90db-635ace4c481f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:32.591483 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b799be-b912-4bec-86a6-53056e08c7b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:32.591856 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b799be-b912-4bec-86a6-53056e08c7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:32.592139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b799be-b912-4bec-86a6-53056e08c7b7 admin admin] PATH_INFO: `/v3/projects/f924c5f54e8b4e33b8bf1b7e3e5a0a10/users/b4c9b1a2ede4450ea3e544fdba820b9b/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:32.619375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b799be-b912-4bec-86a6-53056e08c7b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f924c5f54e8b4e33b8bf1b7e3e5a0a10, user_id=b4c9b1a2ede4450ea3e544fdba820b9b, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:32.619375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b799be-b912-4bec-86a6-53056e08c7b7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:32.645894 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1141/2273] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:32 2022] PUT /identity/v3/projects/f924c5f54e8b4e33b8bf1b7e3e5a0a10/users/b4c9b1a2ede4450ea3e544fdba820b9b/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:32.650021 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b799be-b912-4bec-86a6-53056e08c7b7 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:32.667905 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-10ab9b08-5c9b-45da-90db-635ace4c481f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9224380b3940909eb558ab0660392a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:32.668706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-10ab9b08-5c9b-45da-90db-635ace4c481f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9224380b3940909eb558ab0660392a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:32.669557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-10ab9b08-5c9b-45da-90db-635ace4c481f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9224380b3940909eb558ab0660392a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:32.679692 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-10ab9b08-5c9b-45da-90db-635ace4c481f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9224380b3940909eb558ab0660392a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:32.688476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-10ab9b08-5c9b-45da-90db-635ace4c481f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9224380b3940909eb558ab0660392a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:32.694702 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:32.710212 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1133/2274] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:32 2022] DELETE /identity/v3/users/1b9224380b3940909eb558ab0660392a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:32.721563 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b799be-b912-4bec-86a6-53056e08c7b7 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:32.746112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:32.794435 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cc892-2783-474f-8fc8-98738ef00a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:32.795374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cc892-2783-474f-8fc8-98738ef00a95 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:32.795655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cc892-2783-474f-8fc8-98738ef00a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:32.796085 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cc892-2783-474f-8fc8-98738ef00a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:32.796807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cc892-2783-474f-8fc8-98738ef00a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:32.798953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cc892-2783-474f-8fc8-98738ef00a95 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:32.811514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1142/2275] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:32.815878 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab9b08-5c9b-45da-90db-635ace4c481f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:32.818073 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-10ab9b08-5c9b-45da-90db-635ace4c481f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:32.835188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab9b08-5c9b-45da-90db-635ace4c481f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:32.841504 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a318a6-5000-4092-938f-ce64cb1f129b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:32.842363 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a318a6-5000-4092-938f-ce64cb1f129b admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:32.842792 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a318a6-5000-4092-938f-ce64cb1f129b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:32.843426 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a318a6-5000-4092-938f-ce64cb1f129b admin admin] PATH_INFO: `/v3/projects/f924c5f54e8b4e33b8bf1b7e3e5a0a10/users/b4c9b1a2ede4450ea3e544fdba820b9b/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:32.845534 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a318a6-5000-4092-938f-ce64cb1f129b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f924c5f54e8b4e33b8bf1b7e3e5a0a10, user_id=b4c9b1a2ede4450ea3e544fdba820b9b, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:32.848555 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a318a6-5000-4092-938f-ce64cb1f129b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:32.862857 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1134/2276] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:32 2022] PUT /identity/v3/projects/f924c5f54e8b4e33b8bf1b7e3e5a0a10/users/b4c9b1a2ede4450ea3e544fdba820b9b/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:32.875306 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8c64b-d25b-495d-bdf1-76702e6ae337 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:32.875593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8c64b-d25b-495d-bdf1-76702e6ae337 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:32.875867 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8c64b-d25b-495d-bdf1-76702e6ae337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:32.903925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c6d8c64b-d25b-495d-bdf1-76702e6ae337 None None] MFA Rules not processed for user `b4c9b1a2ede4450ea3e544fdba820b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:32.905503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c6d8c64b-d25b-495d-bdf1-76702e6ae337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:33.013125 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1143/2277] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:33.020661 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a318a6-5000-4092-938f-ce64cb1f129b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:33.023273 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-91a318a6-5000-4092-938f-ce64cb1f129b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:33.057110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8c64b-d25b-495d-bdf1-76702e6ae337 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:33.059331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c6d8c64b-d25b-495d-bdf1-76702e6ae337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:33.104592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a318a6-5000-4092-938f-ce64cb1f129b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:33.108264 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0080cf-67e4-4af6-b52d-470aac9cedf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:33.108947 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0080cf-67e4-4af6-b52d-470aac9cedf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:33.109225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0080cf-67e4-4af6-b52d-470aac9cedf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:33.109490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0080cf-67e4-4af6-b52d-470aac9cedf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:33.128070 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0080cf-67e4-4af6-b52d-470aac9cedf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:33.129545 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0080cf-67e4-4af6-b52d-470aac9cedf4 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:33.148387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1135/2278] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:33.165967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8c64b-d25b-495d-bdf1-76702e6ae337 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:33.171585 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae030f-a1a3-4fdf-876e-3d7e4bc3de45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:33.172630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae030f-a1a3-4fdf-876e-3d7e4bc3de45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:33.172844 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae030f-a1a3-4fdf-876e-3d7e4bc3de45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:33.173110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae030f-a1a3-4fdf-876e-3d7e4bc3de45 admin admin] PATH_INFO: `/v3/projects/618b4c1f467849858f0a04fffcb7fd68` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:33.174392 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae030f-a1a3-4fdf-876e-3d7e4bc3de45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=618b4c1f467849858f0a04fffcb7fd68)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:33.176313 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae030f-a1a3-4fdf-876e-3d7e4bc3de45 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:33.243442 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:33.247945 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4dae030f-a1a3-4fdf-876e-3d7e4bc3de45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '618b4c1f467849858f0a04fffcb7fd68', 'request_id': 'req-4dae030f-a1a3-4fdf-876e-3d7e4bc3de45'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:33.255899 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4dae030f-a1a3-4fdf-876e-3d7e4bc3de45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '618b4c1f467849858f0a04fffcb7fd68', 'request_id': 'req-4dae030f-a1a3-4fdf-876e-3d7e4bc3de45'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:33.262969 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4dae030f-a1a3-4fdf-876e-3d7e4bc3de45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '618b4c1f467849858f0a04fffcb7fd68', 'request_id': 'req-4dae030f-a1a3-4fdf-876e-3d7e4bc3de45'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:33.283405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4dae030f-a1a3-4fdf-876e-3d7e4bc3de45 admin admin] The token cache is being invalidate because project 618b4c1f467849858f0a04fffcb7fd68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:33.283755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4dae030f-a1a3-4fdf-876e-3d7e4bc3de45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:33.284504 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4dae030f-a1a3-4fdf-876e-3d7e4bc3de45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:33.286794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1144/2279] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:33 2022] DELETE /identity/v3/projects/618b4c1f467849858f0a04fffcb7fd68 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:33.291716 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fedbf2-30cc-4a66-940f-a8f0add9473e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:33.292063 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fedbf2-30cc-4a66-940f-a8f0add9473e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:33.292410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fedbf2-30cc-4a66-940f-a8f0add9473e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:33.324514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e7fedbf2-30cc-4a66-940f-a8f0add9473e None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:33.324514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e7fedbf2-30cc-4a66-940f-a8f0add9473e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:33.422281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1136/2280] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:33.430221 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687ad69-7d08-4c7e-86ef-71b4ea957bb0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:33.430692 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687ad69-7d08-4c7e-86ef-71b4ea957bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:33.430795 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687ad69-7d08-4c7e-86ef-71b4ea957bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:33.451048 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0687ad69-7d08-4c7e-86ef-71b4ea957bb0 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:33.452339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0687ad69-7d08-4c7e-86ef-71b4ea957bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:33.461285 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1145/2281] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:33.465421 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fedbf2-30cc-4a66-940f-a8f0add9473e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:33.475774 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fedbf2-30cc-4a66-940f-a8f0add9473e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:33.480523 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc609c04-ac83-4ecc-9141-f94733794d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:33.480980 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc609c04-ac83-4ecc-9141-f94733794d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:33.481257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc609c04-ac83-4ecc-9141-f94733794d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:33.481526 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc609c04-ac83-4ecc-9141-f94733794d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:33.482167 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc609c04-ac83-4ecc-9141-f94733794d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:10:33.482470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc609c04-ac83-4ecc-9141-f94733794d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:33.484074 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc609c04-ac83-4ecc-9141-f94733794d86 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:33.496448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1137/2282] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:10:33.502135 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687ad69-7d08-4c7e-86ef-71b4ea957bb0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:33.512614 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687ad69-7d08-4c7e-86ef-71b4ea957bb0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:33.518370 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f290f-0a64-4f5a-a9a0-7c31709a799f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:33.519076 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f290f-0a64-4f5a-a9a0-7c31709a799f admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:33.519480 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f290f-0a64-4f5a-a9a0-7c31709a799f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:33.519949 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f290f-0a64-4f5a-a9a0-7c31709a799f admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:33.521230 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f290f-0a64-4f5a-a9a0-7c31709a799f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:33.523274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f290f-0a64-4f5a-a9a0-7c31709a799f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:33.553427 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1146/2283] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:33 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:10:33.557712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc609c04-ac83-4ecc-9141-f94733794d86 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:33.568551 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc609c04-ac83-4ecc-9141-f94733794d86 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:33.611964 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f290f-0a64-4f5a-a9a0-7c31709a799f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:33.614230 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-335f290f-0a64-4f5a-a9a0-7c31709a799f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:33.648626 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a5f8d-b74f-4858-a021-64eb4ef9e189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:33.649297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a5f8d-b74f-4858-a021-64eb4ef9e189 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:33.649572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a5f8d-b74f-4858-a021-64eb4ef9e189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:33.649844 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a5f8d-b74f-4858-a021-64eb4ef9e189 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:33.650521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a5f8d-b74f-4858-a021-64eb4ef9e189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:33.652467 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a5f8d-b74f-4858-a021-64eb4ef9e189 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:33.664246 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:33.680584 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1138/2284] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:33 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:33.685185 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a5f8d-b74f-4858-a021-64eb4ef9e189 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:33.696746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a5f8d-b74f-4858-a021-64eb4ef9e189 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:33.709128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c30530-24f7-4c81-b6de-9b3b80677ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:33.709748 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c30530-24f7-4c81-b6de-9b3b80677ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:33.710032 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c30530-24f7-4c81-b6de-9b3b80677ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:33.710306 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c30530-24f7-4c81-b6de-9b3b80677ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:33.710951 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c30530-24f7-4c81-b6de-9b3b80677ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:33.712559 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c30530-24f7-4c81-b6de-9b3b80677ec9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:33.718188 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f290f-0a64-4f5a-a9a0-7c31709a799f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:33.722879 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542814e7-60c6-4d14-b6c7-fc7a681d15de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:33.723535 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542814e7-60c6-4d14-b6c7-fc7a681d15de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:33.723636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1139/2285] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:33.724479 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542814e7-60c6-4d14-b6c7-fc7a681d15de admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:33.724674 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542814e7-60c6-4d14-b6c7-fc7a681d15de admin admin] PATH_INFO: `/v3/users/49f37d89472b46018a2fe455f4a6dcc3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:33.725889 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542814e7-60c6-4d14-b6c7-fc7a681d15de admin admin] RBAC: Authorizing `identity:delete_user(user_id=49f37d89472b46018a2fe455f4a6dcc3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:33.731301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542814e7-60c6-4d14-b6c7-fc7a681d15de admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:33.731483 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c30530-24f7-4c81-b6de-9b3b80677ec9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:33.743236 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c30530-24f7-4c81-b6de-9b3b80677ec9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:33.748171 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33340d-d942-4249-b6f8-e8f1fa1159db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:33.748794 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33340d-d942-4249-b6f8-e8f1fa1159db admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:33.749070 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33340d-d942-4249-b6f8-e8f1fa1159db admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:33.749354 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33340d-d942-4249-b6f8-e8f1fa1159db admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:33.750041 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33340d-d942-4249-b6f8-e8f1fa1159db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:33.751679 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33340d-d942-4249-b6f8-e8f1fa1159db admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:33.767244 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1140/2286] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:33.768464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33340d-d942-4249-b6f8-e8f1fa1159db admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:33.778230 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33340d-d942-4249-b6f8-e8f1fa1159db admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:33.783457 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffad11-dc7d-4561-97dc-61d936b238dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:33.784187 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffad11-dc7d-4561-97dc-61d936b238dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:33.784466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffad11-dc7d-4561-97dc-61d936b238dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:33.784736 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffad11-dc7d-4561-97dc-61d936b238dd admin admin] PATH_INFO: `/v3/projects/e2b8d446145946b2866628dece2fa3eb/users/3eb6562995704cba8e9a0e710ce4969d/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:33.788563 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-542814e7-60c6-4d14-b6c7-fc7a681d15de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49f37d89472b46018a2fe455f4a6dcc3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:33.800539 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-542814e7-60c6-4d14-b6c7-fc7a681d15de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49f37d89472b46018a2fe455f4a6dcc3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:33.801587 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-542814e7-60c6-4d14-b6c7-fc7a681d15de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49f37d89472b46018a2fe455f4a6dcc3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:33.803434 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffad11-dc7d-4561-97dc-61d936b238dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b8d446145946b2866628dece2fa3eb, user_id=3eb6562995704cba8e9a0e710ce4969d, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:33.806280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffad11-dc7d-4561-97dc-61d936b238dd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:33.817664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-542814e7-60c6-4d14-b6c7-fc7a681d15de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49f37d89472b46018a2fe455f4a6dcc3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:33.822340 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1141/2287] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:33 2022] PUT /identity/v3/projects/e2b8d446145946b2866628dece2fa3eb/users/3eb6562995704cba8e9a0e710ce4969d/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:33.825527 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-542814e7-60c6-4d14-b6c7-fc7a681d15de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49f37d89472b46018a2fe455f4a6dcc3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:33.831799 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1147/2288] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:33 2022] DELETE /identity/v3/users/49f37d89472b46018a2fe455f4a6dcc3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:33.833010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9cb18-54f1-4e35-b93b-799e8c73b976 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:33.833336 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9cb18-54f1-4e35-b93b-799e8c73b976 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:33.833605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9cb18-54f1-4e35-b93b-799e8c73b976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:33.836680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37d89-3bfe-4b60-97ba-07333ac13d72 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:33.837045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37d89-3bfe-4b60-97ba-07333ac13d72 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:33.837326 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37d89-3bfe-4b60-97ba-07333ac13d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:33.857333 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f9a37d89-3bfe-4b60-97ba-07333ac13d72 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:33.858566 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f9a37d89-3bfe-4b60-97ba-07333ac13d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:33.863447 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-44d9cb18-54f1-4e35-b93b-799e8c73b976 None None] MFA Rules not processed for user `3eb6562995704cba8e9a0e710ce4969d`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:33.865227 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-44d9cb18-54f1-4e35-b93b-799e8c73b976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:33.879960 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:33.925974 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1148/2289] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:33.935595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1142/2290] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:33.939494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a37d89-3bfe-4b60-97ba-07333ac13d72 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:33.939717 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9cb18-54f1-4e35-b93b-799e8c73b976 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:33.940874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-44d9cb18-54f1-4e35-b93b-799e8c73b976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:33.941434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f9a37d89-3bfe-4b60-97ba-07333ac13d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:33.955471 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a37d89-3bfe-4b60-97ba-07333ac13d72 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:33.960843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7a8c7-1de9-4425-bbc0-cdfc8a1be99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:33.961443 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7a8c7-1de9-4425-bbc0-cdfc8a1be99b admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:33.961716 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7a8c7-1de9-4425-bbc0-cdfc8a1be99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:33.961986 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7a8c7-1de9-4425-bbc0-cdfc8a1be99b admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:33.962611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7a8c7-1de9-4425-bbc0-cdfc8a1be99b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:33.964530 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7a8c7-1de9-4425-bbc0-cdfc8a1be99b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:33.992763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1149/2291] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:33 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:33.997046 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7a8c7-1de9-4425-bbc0-cdfc8a1be99b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:34.006443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9cb18-54f1-4e35-b93b-799e8c73b976 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:34.065013 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf3c64-9b6b-4128-bc55-08a84f6b5340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:34.065237 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7a8c7-1de9-4425-bbc0-cdfc8a1be99b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:34.065692 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf3c64-9b6b-4128-bc55-08a84f6b5340 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:34.065902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf3c64-9b6b-4128-bc55-08a84f6b5340 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:34.066169 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf3c64-9b6b-4128-bc55-08a84f6b5340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:34.070315 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a2e48-d42c-42c4-b83f-4cc0990abb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:34.070924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a2e48-d42c-42c4-b83f-4cc0990abb47 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:34.071227 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a2e48-d42c-42c4-b83f-4cc0990abb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:34.071493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a2e48-d42c-42c4-b83f-4cc0990abb47 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:34.072158 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a2e48-d42c-42c4-b83f-4cc0990abb47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:34.074710 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a2e48-d42c-42c4-b83f-4cc0990abb47 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:34.075757 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:34.078477 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf3c64-9b6b-4128-bc55-08a84f6b5340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:34.081279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf3c64-9b6b-4128-bc55-08a84f6b5340 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:34.093875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1143/2292] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:10:34.105020 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1150/2293] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:33 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:10:34.108984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf3c64-9b6b-4128-bc55-08a84f6b5340 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:34.119553 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf3c64-9b6b-4128-bc55-08a84f6b5340 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:34.125053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef1a09-7f75-4d01-a56b-4b613db30929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:34.125772 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef1a09-7f75-4d01-a56b-4b613db30929 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:34.126087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef1a09-7f75-4d01-a56b-4b613db30929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:34.126349 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef1a09-7f75-4d01-a56b-4b613db30929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:34.127163 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef1a09-7f75-4d01-a56b-4b613db30929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:34.129127 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef1a09-7f75-4d01-a56b-4b613db30929 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:34.144695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1144/2294] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:34.149093 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a2e48-d42c-42c4-b83f-4cc0990abb47 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:34.159521 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a2e48-d42c-42c4-b83f-4cc0990abb47 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:34.165263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9d72a-a313-4d67-a917-38a1279a16e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:34.166086 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9d72a-a313-4d67-a917-38a1279a16e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:34.166237 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9d72a-a313-4d67-a917-38a1279a16e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:34.166456 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9d72a-a313-4d67-a917-38a1279a16e6 admin admin] PATH_INFO: `/v3/projects/cd888a6f14564fb4910820a6fcc1c4b1/users/218068f5c461423689f778c3db40fa10/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:34.185528 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9d72a-a313-4d67-a917-38a1279a16e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd888a6f14564fb4910820a6fcc1c4b1, user_id=218068f5c461423689f778c3db40fa10, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:34.190641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9d72a-a313-4d67-a917-38a1279a16e6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:34.204109 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1151/2295] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:34 2022] PUT /identity/v3/projects/cd888a6f14564fb4910820a6fcc1c4b1/users/218068f5c461423689f778c3db40fa10/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:34.208254 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef1a09-7f75-4d01-a56b-4b613db30929 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:34.219644 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef1a09-7f75-4d01-a56b-4b613db30929 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:34.281773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9dd69-38bb-447f-ae16-837ea236868b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:34.282519 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9dd69-38bb-447f-ae16-837ea236868b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:34.282803 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9dd69-38bb-447f-ae16-837ea236868b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:34.283075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9dd69-38bb-447f-ae16-837ea236868b admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:34.283745 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9dd69-38bb-447f-ae16-837ea236868b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:34.285409 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9dd69-38bb-447f-ae16-837ea236868b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:34.295664 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1145/2296] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:34.300006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9d72a-a313-4d67-a917-38a1279a16e6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:34.311209 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9d72a-a313-4d67-a917-38a1279a16e6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:34.318464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee481f3-189e-4b3f-92c2-717693b52699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:34.319173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee481f3-189e-4b3f-92c2-717693b52699 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:34.319457 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee481f3-189e-4b3f-92c2-717693b52699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:34.319732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee481f3-189e-4b3f-92c2-717693b52699 admin admin] PATH_INFO: `/v3/projects/cd888a6f14564fb4910820a6fcc1c4b1/users/218068f5c461423689f778c3db40fa10/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:34.321697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee481f3-189e-4b3f-92c2-717693b52699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd888a6f14564fb4910820a6fcc1c4b1, user_id=218068f5c461423689f778c3db40fa10, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:34.324727 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee481f3-189e-4b3f-92c2-717693b52699 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:34.336405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1152/2297] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:34 2022] PUT /identity/v3/projects/cd888a6f14564fb4910820a6fcc1c4b1/users/218068f5c461423689f778c3db40fa10/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:34.348629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5781c7-694c-4b3f-a06f-b011199dc6e9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:34.349060 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5781c7-694c-4b3f-a06f-b011199dc6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:34.349391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5781c7-694c-4b3f-a06f-b011199dc6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:34.391152 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4f5781c7-694c-4b3f-a06f-b011199dc6e9 None None] MFA Rules not processed for user `218068f5c461423689f778c3db40fa10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:34.392378 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4f5781c7-694c-4b3f-a06f-b011199dc6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:34.435890 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee481f3-189e-4b3f-92c2-717693b52699 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:34.438015 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1ee481f3-189e-4b3f-92c2-717693b52699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:34.510252 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1146/2298] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:34.523040 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5781c7-694c-4b3f-a06f-b011199dc6e9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:34.524473 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4f5781c7-694c-4b3f-a06f-b011199dc6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:34.532468 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:34.540027 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee481f3-189e-4b3f-92c2-717693b52699 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:34.549258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd972c0-937a-4613-88f8-94f4e6e7a7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:34.550257 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd972c0-937a-4613-88f8-94f4e6e7a7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:34.550676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd972c0-937a-4613-88f8-94f4e6e7a7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:34.550978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd972c0-937a-4613-88f8-94f4e6e7a7f3 admin admin] PATH_INFO: `/v3/projects/535182b9f1d847e9bb35b0b52c13550a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:34.553210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd972c0-937a-4613-88f8-94f4e6e7a7f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=535182b9f1d847e9bb35b0b52c13550a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:34.555695 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd972c0-937a-4613-88f8-94f4e6e7a7f3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:34.610653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5781c7-694c-4b3f-a06f-b011199dc6e9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:34.645192 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3cd972c0-937a-4613-88f8-94f4e6e7a7f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535182b9f1d847e9bb35b0b52c13550a', 'request_id': 'req-3cd972c0-937a-4613-88f8-94f4e6e7a7f3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:34.651780 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:34.653292 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3cd972c0-937a-4613-88f8-94f4e6e7a7f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535182b9f1d847e9bb35b0b52c13550a', 'request_id': 'req-3cd972c0-937a-4613-88f8-94f4e6e7a7f3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:34.660743 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3cd972c0-937a-4613-88f8-94f4e6e7a7f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535182b9f1d847e9bb35b0b52c13550a', 'request_id': 'req-3cd972c0-937a-4613-88f8-94f4e6e7a7f3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:34.679059 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3cd972c0-937a-4613-88f8-94f4e6e7a7f3 admin admin] The token cache is being invalidate because project 535182b9f1d847e9bb35b0b52c13550a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:34.683033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3cd972c0-937a-4613-88f8-94f4e6e7a7f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:34.683033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3cd972c0-937a-4613-88f8-94f4e6e7a7f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:34.684115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1153/2299] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:34 2022] DELETE /identity/v3/projects/535182b9f1d847e9bb35b0b52c13550a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:34.688124 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd972c0-937a-4613-88f8-94f4e6e7a7f3 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:34.694062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3cd972c0-937a-4613-88f8-94f4e6e7a7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:34.719147 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185f0ae-364a-4aeb-ada6-6854dbe31d97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:34.720402 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185f0ae-364a-4aeb-ada6-6854dbe31d97 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:34.720684 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185f0ae-364a-4aeb-ada6-6854dbe31d97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:34.720957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185f0ae-364a-4aeb-ada6-6854dbe31d97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:34.722958 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8185f0ae-364a-4aeb-ada6-6854dbe31d97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:34.821645 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185f0ae-364a-4aeb-ada6-6854dbe31d97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:34.823110 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185f0ae-364a-4aeb-ada6-6854dbe31d97 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:34.833578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1147/2300] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:34.834677 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd972c0-937a-4613-88f8-94f4e6e7a7f3 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:34.839606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefc3a8-8eab-4e02-8c77-e440f4317bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:34.840499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc3a8-8eab-4e02-8c77-e440f4317bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:34.840763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc3a8-8eab-4e02-8c77-e440f4317bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:34.841118 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc3a8-8eab-4e02-8c77-e440f4317bbd admin admin] PATH_INFO: `/v3/users/b4c9b1a2ede4450ea3e544fdba820b9b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:34.842278 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefc3a8-8eab-4e02-8c77-e440f4317bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4c9b1a2ede4450ea3e544fdba820b9b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:34.844475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefc3a8-8eab-4e02-8c77-e440f4317bbd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:34.903883 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7fefc3a8-8eab-4e02-8c77-e440f4317bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4c9b1a2ede4450ea3e544fdba820b9b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:34.912583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7fefc3a8-8eab-4e02-8c77-e440f4317bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4c9b1a2ede4450ea3e544fdba820b9b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:34.913458 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7fefc3a8-8eab-4e02-8c77-e440f4317bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4c9b1a2ede4450ea3e544fdba820b9b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:34.928630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7fefc3a8-8eab-4e02-8c77-e440f4317bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4c9b1a2ede4450ea3e544fdba820b9b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:34.935795 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7fefc3a8-8eab-4e02-8c77-e440f4317bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4c9b1a2ede4450ea3e544fdba820b9b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:34.943608 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1154/2301] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:34 2022] DELETE /identity/v3/users/b4c9b1a2ede4450ea3e544fdba820b9b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:35.263889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185f0ae-364a-4aeb-ada6-6854dbe31d97 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:35.285350 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185f0ae-364a-4aeb-ada6-6854dbe31d97 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:35.353215 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850832bb-bfd5-4711-bdb8-7b7634622772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:35.354022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850832bb-bfd5-4711-bdb8-7b7634622772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:35.354282 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850832bb-bfd5-4711-bdb8-7b7634622772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:35.354559 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850832bb-bfd5-4711-bdb8-7b7634622772 admin admin] PATH_INFO: `/v3/projects/f924c5f54e8b4e33b8bf1b7e3e5a0a10` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:35.355910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850832bb-bfd5-4711-bdb8-7b7634622772 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f924c5f54e8b4e33b8bf1b7e3e5a0a10)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:35.357859 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850832bb-bfd5-4711-bdb8-7b7634622772 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:35.405828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-850832bb-bfd5-4711-bdb8-7b7634622772 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f924c5f54e8b4e33b8bf1b7e3e5a0a10', 'request_id': 'req-850832bb-bfd5-4711-bdb8-7b7634622772'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:35.412876 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-850832bb-bfd5-4711-bdb8-7b7634622772 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f924c5f54e8b4e33b8bf1b7e3e5a0a10', 'request_id': 'req-850832bb-bfd5-4711-bdb8-7b7634622772'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:35.418615 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-850832bb-bfd5-4711-bdb8-7b7634622772 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f924c5f54e8b4e33b8bf1b7e3e5a0a10', 'request_id': 'req-850832bb-bfd5-4711-bdb8-7b7634622772'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:35.431106 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-850832bb-bfd5-4711-bdb8-7b7634622772 admin admin] The token cache is being invalidate because project f924c5f54e8b4e33b8bf1b7e3e5a0a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:35.431429 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-850832bb-bfd5-4711-bdb8-7b7634622772 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:35.432033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-850832bb-bfd5-4711-bdb8-7b7634622772 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:35.433691 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1148/2302] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:35 2022] DELETE /identity/v3/projects/f924c5f54e8b4e33b8bf1b7e3e5a0a10 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:35.438514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52509067-a053-441b-a9b1-36496a4a2e12 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:35.439018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52509067-a053-441b-a9b1-36496a4a2e12 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:35.439144 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52509067-a053-441b-a9b1-36496a4a2e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:35.452563 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:35.465578 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-52509067-a053-441b-a9b1-36496a4a2e12 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:35.467115 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-52509067-a053-441b-a9b1-36496a4a2e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:35.526508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1155/2303] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:35.534388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b32b81-3d0e-4c9f-8327-76d547f21169 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:35.534674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b32b81-3d0e-4c9f-8327-76d547f21169 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:35.534950 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b32b81-3d0e-4c9f-8327-76d547f21169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:35.549639 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:35.555213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a2b32b81-3d0e-4c9f-8327-76d547f21169 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:35.557145 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a2b32b81-3d0e-4c9f-8327-76d547f21169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:35.565561 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1149/2304] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:35.570378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52509067-a053-441b-a9b1-36496a4a2e12 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:35.580158 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52509067-a053-441b-a9b1-36496a4a2e12 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:35.585649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df288093-9027-4e45-b6dc-c41a4c5281ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:35.586339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df288093-9027-4e45-b6dc-c41a4c5281ac admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:35.586707 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df288093-9027-4e45-b6dc-c41a4c5281ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:35.587047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df288093-9027-4e45-b6dc-c41a4c5281ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:35.587805 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df288093-9027-4e45-b6dc-c41a4c5281ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:10:35.588114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df288093-9027-4e45-b6dc-c41a4c5281ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:35.589856 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df288093-9027-4e45-b6dc-c41a4c5281ac admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:35.602822 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1156/2305] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:10:35.607327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b32b81-3d0e-4c9f-8327-76d547f21169 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:35.617480 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b32b81-3d0e-4c9f-8327-76d547f21169 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:35.622168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc92a7-5676-44cb-ac1a-331d37dfdaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:35.622765 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc92a7-5676-44cb-ac1a-331d37dfdaad admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:35.623203 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc92a7-5676-44cb-ac1a-331d37dfdaad admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:35.623487 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc92a7-5676-44cb-ac1a-331d37dfdaad admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:35.624102 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc92a7-5676-44cb-ac1a-331d37dfdaad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:35.626002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc92a7-5676-44cb-ac1a-331d37dfdaad admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:35.655733 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1150/2306] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:35 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:35.660005 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df288093-9027-4e45-b6dc-c41a4c5281ac admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:35.670605 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df288093-9027-4e45-b6dc-c41a4c5281ac admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:35.747107 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49083078-663a-458f-b174-726b0505dea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:35.747930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49083078-663a-458f-b174-726b0505dea5 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:35.748335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49083078-663a-458f-b174-726b0505dea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:35.748617 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49083078-663a-458f-b174-726b0505dea5 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:35.749262 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49083078-663a-458f-b174-726b0505dea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:35.752755 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49083078-663a-458f-b174-726b0505dea5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:35.779120 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1157/2307] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:35 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:35.783455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc92a7-5676-44cb-ac1a-331d37dfdaad admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:35.801550 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc92a7-5676-44cb-ac1a-331d37dfdaad admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:35.808012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645ed17-b6eb-4808-a573-1b064380fb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:35.808630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645ed17-b6eb-4808-a573-1b064380fb70 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:35.808902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645ed17-b6eb-4808-a573-1b064380fb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:35.809175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645ed17-b6eb-4808-a573-1b064380fb70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:35.809841 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645ed17-b6eb-4808-a573-1b064380fb70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:35.811463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645ed17-b6eb-4808-a573-1b064380fb70 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:35.825935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1151/2308] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:35.827175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49083078-663a-458f-b174-726b0505dea5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:35.842828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49083078-663a-458f-b174-726b0505dea5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:35.850780 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759ed53-2683-4aa6-bb2d-cd0ef97f1bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:35.851510 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759ed53-2683-4aa6-bb2d-cd0ef97f1bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:35.851789 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759ed53-2683-4aa6-bb2d-cd0ef97f1bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:35.852060 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759ed53-2683-4aa6-bb2d-cd0ef97f1bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:35.852718 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759ed53-2683-4aa6-bb2d-cd0ef97f1bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:35.854383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759ed53-2683-4aa6-bb2d-cd0ef97f1bf7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:35.871599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1158/2309] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:35.875686 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645ed17-b6eb-4808-a573-1b064380fb70 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:35.887030 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645ed17-b6eb-4808-a573-1b064380fb70 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:35.891559 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd1ee0-f4c5-4a21-b938-8b22cc4929d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:35.892197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd1ee0-f4c5-4a21-b938-8b22cc4929d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:35.892472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd1ee0-f4c5-4a21-b938-8b22cc4929d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:35.892740 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd1ee0-f4c5-4a21-b938-8b22cc4929d7 admin admin] PATH_INFO: `/v3/projects/933c39264ba94cec8f47506967ba3936/users/ac3e71ac7f8f4bb0b0cbbfaf25553dc1/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:35.907125 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd1ee0-f4c5-4a21-b938-8b22cc4929d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=933c39264ba94cec8f47506967ba3936, user_id=ac3e71ac7f8f4bb0b0cbbfaf25553dc1, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:35.910004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd1ee0-f4c5-4a21-b938-8b22cc4929d7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:35.922825 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1152/2310] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:35 2022] PUT /identity/v3/projects/933c39264ba94cec8f47506967ba3936/users/ac3e71ac7f8f4bb0b0cbbfaf25553dc1/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:35.935732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e3bd7-0e00-4bc9-a816-478cf948c2e2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:35.936190 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e3bd7-0e00-4bc9-a816-478cf948c2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:35.936548 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e3bd7-0e00-4bc9-a816-478cf948c2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:35.965666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-941e3bd7-0e00-4bc9-a816-478cf948c2e2 None None] MFA Rules not processed for user `ac3e71ac7f8f4bb0b0cbbfaf25553dc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:35.966851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-941e3bd7-0e00-4bc9-a816-478cf948c2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:36.034416 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:36.039964 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1159/2311] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:36.044293 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd1ee0-f4c5-4a21-b938-8b22cc4929d7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:36.109682 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd1ee0-f4c5-4a21-b938-8b22cc4929d7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:36.116060 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655979c7-f8cd-4c56-a3c2-b8759c070b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:36.116671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655979c7-f8cd-4c56-a3c2-b8759c070b54 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:36.116949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655979c7-f8cd-4c56-a3c2-b8759c070b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:36.117219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655979c7-f8cd-4c56-a3c2-b8759c070b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:36.117840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655979c7-f8cd-4c56-a3c2-b8759c070b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:36.119850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655979c7-f8cd-4c56-a3c2-b8759c070b54 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:36.146765 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1153/2312] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:36 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:36.151777 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e3bd7-0e00-4bc9-a816-478cf948c2e2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:36.163122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e3bd7-0e00-4bc9-a816-478cf948c2e2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:36.220883 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba9cc2-5b85-43c1-a7a7-87d4c60943d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:36.221486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba9cc2-5b85-43c1-a7a7-87d4c60943d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:36.221767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba9cc2-5b85-43c1-a7a7-87d4c60943d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:36.222037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba9cc2-5b85-43c1-a7a7-87d4c60943d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:36.222667 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba9cc2-5b85-43c1-a7a7-87d4c60943d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:36.225604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba9cc2-5b85-43c1-a7a7-87d4c60943d0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:36.251442 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1160/2313] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:36 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:36.252881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655979c7-f8cd-4c56-a3c2-b8759c070b54 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:36.264131 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655979c7-f8cd-4c56-a3c2-b8759c070b54 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:36.268804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99987e5d-7d02-4aea-9735-58dfe19bd014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:36.269399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99987e5d-7d02-4aea-9735-58dfe19bd014 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:36.269671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99987e5d-7d02-4aea-9735-58dfe19bd014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:36.269937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99987e5d-7d02-4aea-9735-58dfe19bd014 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:36.271317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99987e5d-7d02-4aea-9735-58dfe19bd014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:36.272958 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99987e5d-7d02-4aea-9735-58dfe19bd014 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:36.289391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1154/2314] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:36.290560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba9cc2-5b85-43c1-a7a7-87d4c60943d0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:36.300502 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba9cc2-5b85-43c1-a7a7-87d4c60943d0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:36.305605 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e80f70-0b04-4795-a9e5-e730a9ebf422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:36.306248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e80f70-0b04-4795-a9e5-e730a9ebf422 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:36.306528 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e80f70-0b04-4795-a9e5-e730a9ebf422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:36.306801 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e80f70-0b04-4795-a9e5-e730a9ebf422 admin admin] PATH_INFO: `/v3/projects/e25c5389b5244ef09733b37c4e28faa1/users/3e68e994f1144b939659b16af55b8308/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:36.326208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e80f70-0b04-4795-a9e5-e730a9ebf422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25c5389b5244ef09733b37c4e28faa1, user_id=3e68e994f1144b939659b16af55b8308, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:36.328911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e80f70-0b04-4795-a9e5-e730a9ebf422 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:36.344346 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1161/2315] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:36 2022] PUT /identity/v3/projects/e25c5389b5244ef09733b37c4e28faa1/users/3e68e994f1144b939659b16af55b8308/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:36.348797 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99987e5d-7d02-4aea-9735-58dfe19bd014 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:36.359927 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99987e5d-7d02-4aea-9735-58dfe19bd014 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:36.427758 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217d84d-1040-4e0b-bb71-22ac02c57518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:36.427758 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d84d-1040-4e0b-bb71-22ac02c57518 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:36.427758 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d84d-1040-4e0b-bb71-22ac02c57518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:36.427758 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d84d-1040-4e0b-bb71-22ac02c57518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:36.428162 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217d84d-1040-4e0b-bb71-22ac02c57518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:36.429704 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217d84d-1040-4e0b-bb71-22ac02c57518 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:36.440814 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1155/2316] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:36.448174 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e80f70-0b04-4795-a9e5-e730a9ebf422 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:36.463775 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e80f70-0b04-4795-a9e5-e730a9ebf422 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:36.468704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145cf8a-1e76-4454-8cf1-3fd09a604b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:36.469490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145cf8a-1e76-4454-8cf1-3fd09a604b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:36.469775 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145cf8a-1e76-4454-8cf1-3fd09a604b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:36.470102 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145cf8a-1e76-4454-8cf1-3fd09a604b21 admin admin] PATH_INFO: `/v3/projects/e25c5389b5244ef09733b37c4e28faa1/users/3e68e994f1144b939659b16af55b8308/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:36.472128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145cf8a-1e76-4454-8cf1-3fd09a604b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25c5389b5244ef09733b37c4e28faa1, user_id=3e68e994f1144b939659b16af55b8308, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:36.474954 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145cf8a-1e76-4454-8cf1-3fd09a604b21 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:36.486032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1162/2317] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:36 2022] PUT /identity/v3/projects/e25c5389b5244ef09733b37c4e28faa1/users/3e68e994f1144b939659b16af55b8308/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:36.497223 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561b275-9698-45ef-af92-26863ef30f66 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:36.497511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561b275-9698-45ef-af92-26863ef30f66 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:36.497779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561b275-9698-45ef-af92-26863ef30f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:36.523793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:36.527078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d561b275-9698-45ef-af92-26863ef30f66 None None] MFA Rules not processed for user `3e68e994f1144b939659b16af55b8308`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:36.529640 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d561b275-9698-45ef-af92-26863ef30f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:36.602513 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1156/2318] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:36.619221 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145cf8a-1e76-4454-8cf1-3fd09a604b21 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:36.619221 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0145cf8a-1e76-4454-8cf1-3fd09a604b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:36.680139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145cf8a-1e76-4454-8cf1-3fd09a604b21 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:36.684262 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f89dd-f5a4-4926-9615-e666c827499f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:36.685104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f89dd-f5a4-4926-9615-e666c827499f service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:36.685380 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f89dd-f5a4-4926-9615-e666c827499f service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:36.685647 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f89dd-f5a4-4926-9615-e666c827499f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:36.695522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f89dd-f5a4-4926-9615-e666c827499f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:36.696951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f89dd-f5a4-4926-9615-e666c827499f service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:36.706508 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1163/2319] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:36.785205 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561b275-9698-45ef-af92-26863ef30f66 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:36.795446 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561b275-9698-45ef-af92-26863ef30f66 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:36.799050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c96f77-f53e-474e-a0b4-ff0745abc3a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:36.799674 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c96f77-f53e-474e-a0b4-ff0745abc3a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:36.799953 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c96f77-f53e-474e-a0b4-ff0745abc3a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:36.800224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c96f77-f53e-474e-a0b4-ff0745abc3a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:36.868021 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c96f77-f53e-474e-a0b4-ff0745abc3a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:36.869505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c96f77-f53e-474e-a0b4-ff0745abc3a9 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:36.878114 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1157/2320] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:37.174798 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f89dd-f5a4-4926-9615-e666c827499f service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:37.232720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:37.240667 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f89dd-f5a4-4926-9615-e666c827499f service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:37.245658 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe91d6-ca0e-4c62-9f80-875c7cb0eedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:37.246415 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe91d6-ca0e-4c62-9f80-875c7cb0eedc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:37.246773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe91d6-ca0e-4c62-9f80-875c7cb0eedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:37.247043 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe91d6-ca0e-4c62-9f80-875c7cb0eedc admin admin] PATH_INFO: `/v3/users/ac3e71ac7f8f4bb0b0cbbfaf25553dc1` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:37.248234 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe91d6-ca0e-4c62-9f80-875c7cb0eedc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3e71ac7f8f4bb0b0cbbfaf25553dc1)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:37.250191 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe91d6-ca0e-4c62-9f80-875c7cb0eedc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:37.297283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7dfe91d6-ca0e-4c62-9f80-875c7cb0eedc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3e71ac7f8f4bb0b0cbbfaf25553dc1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:37.304880 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7dfe91d6-ca0e-4c62-9f80-875c7cb0eedc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3e71ac7f8f4bb0b0cbbfaf25553dc1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:37.305506 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7dfe91d6-ca0e-4c62-9f80-875c7cb0eedc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3e71ac7f8f4bb0b0cbbfaf25553dc1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:37.317959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7dfe91d6-ca0e-4c62-9f80-875c7cb0eedc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3e71ac7f8f4bb0b0cbbfaf25553dc1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:37.325215 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7dfe91d6-ca0e-4c62-9f80-875c7cb0eedc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3e71ac7f8f4bb0b0cbbfaf25553dc1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:37.334210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1164/2321] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:37 2022] DELETE /identity/v3/users/ac3e71ac7f8f4bb0b0cbbfaf25553dc1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:37.335953 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560dfc7-a353-46c5-a019-5852aebd4215 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:37.336241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560dfc7-a353-46c5-a019-5852aebd4215 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:37.336511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560dfc7-a353-46c5-a019-5852aebd4215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:37.356942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c560dfc7-a353-46c5-a019-5852aebd4215 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:37.358272 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c560dfc7-a353-46c5-a019-5852aebd4215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:37.423483 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1158/2322] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:37.433282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe91d6-ca0e-4c62-9f80-875c7cb0eedc admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:37.434663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7dfe91d6-ca0e-4c62-9f80-875c7cb0eedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:37.459877 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560dfc7-a353-46c5-a019-5852aebd4215 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:37.461273 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c560dfc7-a353-46c5-a019-5852aebd4215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:37.473142 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560dfc7-a353-46c5-a019-5852aebd4215 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:37.480388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298a0c9-4300-4f89-9aee-f881cddf0b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:37.481029 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298a0c9-4300-4f89-9aee-f881cddf0b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:37.481300 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298a0c9-4300-4f89-9aee-f881cddf0b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:37.481572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298a0c9-4300-4f89-9aee-f881cddf0b53 admin admin] PATH_INFO: `/v3/users/3eb6562995704cba8e9a0e710ce4969d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:37.482722 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298a0c9-4300-4f89-9aee-f881cddf0b53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb6562995704cba8e9a0e710ce4969d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:37.484669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298a0c9-4300-4f89-9aee-f881cddf0b53 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:37.497073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe91d6-ca0e-4c62-9f80-875c7cb0eedc admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:37.501666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055635b-c9b2-4a02-8cbd-2ff427fea8b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:37.503279 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055635b-c9b2-4a02-8cbd-2ff427fea8b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:37.503279 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055635b-c9b2-4a02-8cbd-2ff427fea8b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:37.503279 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055635b-c9b2-4a02-8cbd-2ff427fea8b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:37.513221 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055635b-c9b2-4a02-8cbd-2ff427fea8b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:37.514714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055635b-c9b2-4a02-8cbd-2ff427fea8b2 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:37.527666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:37.537325 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1165/2323] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:37.548327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b298a0c9-4300-4f89-9aee-f881cddf0b53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb6562995704cba8e9a0e710ce4969d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:37.549044 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b298a0c9-4300-4f89-9aee-f881cddf0b53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb6562995704cba8e9a0e710ce4969d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:37.549725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b298a0c9-4300-4f89-9aee-f881cddf0b53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb6562995704cba8e9a0e710ce4969d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:37.557631 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b298a0c9-4300-4f89-9aee-f881cddf0b53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb6562995704cba8e9a0e710ce4969d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:37.581155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b298a0c9-4300-4f89-9aee-f881cddf0b53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb6562995704cba8e9a0e710ce4969d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:37.603698 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1159/2324] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:37 2022] DELETE /identity/v3/users/3eb6562995704cba8e9a0e710ce4969d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:37.608967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4586cd1-3b96-4905-adf9-2e233cacf419 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:37.609253 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4586cd1-3b96-4905-adf9-2e233cacf419 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:37.609526 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4586cd1-3b96-4905-adf9-2e233cacf419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:37.630174 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b4586cd1-3b96-4905-adf9-2e233cacf419 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:37.631562 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b4586cd1-3b96-4905-adf9-2e233cacf419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:37.706393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1166/2325] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:37.713215 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298a0c9-4300-4f89-9aee-f881cddf0b53 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:37.714622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b298a0c9-4300-4f89-9aee-f881cddf0b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:37.789388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298a0c9-4300-4f89-9aee-f881cddf0b53 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:37.793994 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d1518-fdd0-4805-8b68-1a6e8717dd9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:37.794601 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d1518-fdd0-4805-8b68-1a6e8717dd9a service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:37.794875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d1518-fdd0-4805-8b68-1a6e8717dd9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:37.795192 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d1518-fdd0-4805-8b68-1a6e8717dd9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:37.805554 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d1518-fdd0-4805-8b68-1a6e8717dd9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:37.807187 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d1518-fdd0-4805-8b68-1a6e8717dd9a service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:37.822394 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1160/2326] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:37.932295 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4586cd1-3b96-4905-adf9-2e233cacf419 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:37.933998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b4586cd1-3b96-4905-adf9-2e233cacf419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:37.951159 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4586cd1-3b96-4905-adf9-2e233cacf419 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:37.961735 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b7a46-5bab-4a27-8d84-5775f798ad31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:37.962379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b7a46-5bab-4a27-8d84-5775f798ad31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:37.962668 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b7a46-5bab-4a27-8d84-5775f798ad31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:37.962927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b7a46-5bab-4a27-8d84-5775f798ad31 admin admin] PATH_INFO: `/v3/projects/933c39264ba94cec8f47506967ba3936` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:37.964705 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b7a46-5bab-4a27-8d84-5775f798ad31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=933c39264ba94cec8f47506967ba3936)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:37.966597 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b7a46-5bab-4a27-8d84-5775f798ad31 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:37.981742 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:38.035261 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-644b7a46-5bab-4a27-8d84-5775f798ad31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '933c39264ba94cec8f47506967ba3936', 'request_id': 'req-644b7a46-5bab-4a27-8d84-5775f798ad31'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.052342 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-644b7a46-5bab-4a27-8d84-5775f798ad31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '933c39264ba94cec8f47506967ba3936', 'request_id': 'req-644b7a46-5bab-4a27-8d84-5775f798ad31'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.059691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-644b7a46-5bab-4a27-8d84-5775f798ad31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '933c39264ba94cec8f47506967ba3936', 'request_id': 'req-644b7a46-5bab-4a27-8d84-5775f798ad31'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.072213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-644b7a46-5bab-4a27-8d84-5775f798ad31 admin admin] The token cache is being invalidate because project 933c39264ba94cec8f47506967ba3936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:38.072503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-644b7a46-5bab-4a27-8d84-5775f798ad31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.073141 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-644b7a46-5bab-4a27-8d84-5775f798ad31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.074941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1167/2327] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:37 2022] DELETE /identity/v3/projects/933c39264ba94cec8f47506967ba3936 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:38.078938 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d1518-fdd0-4805-8b68-1a6e8717dd9a service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:38.089845 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d1518-fdd0-4805-8b68-1a6e8717dd9a service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:38.176191 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a651be-c525-455c-bd66-691d7cf794a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:38.176849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a651be-c525-455c-bd66-691d7cf794a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:38.177136 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a651be-c525-455c-bd66-691d7cf794a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:38.177376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a651be-c525-455c-bd66-691d7cf794a1 admin admin] PATH_INFO: `/v3/users/3e68e994f1144b939659b16af55b8308` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:38.178555 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a651be-c525-455c-bd66-691d7cf794a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e68e994f1144b939659b16af55b8308)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:38.180658 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a651be-c525-455c-bd66-691d7cf794a1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:38.192577 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b7a46-5bab-4a27-8d84-5775f798ad31 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:38.194062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-644b7a46-5bab-4a27-8d84-5775f798ad31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:38.211683 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b7a46-5bab-4a27-8d84-5775f798ad31 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:38.216580 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc3b8c-e315-40f1-ac09-a96050ffdc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:38.217549 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc3b8c-e315-40f1-ac09-a96050ffdc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:38.217888 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc3b8c-e315-40f1-ac09-a96050ffdc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:38.218220 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc3b8c-e315-40f1-ac09-a96050ffdc8c admin admin] PATH_INFO: `/v3/projects/e2b8d446145946b2866628dece2fa3eb` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:38.219476 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc3b8c-e315-40f1-ac09-a96050ffdc8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b8d446145946b2866628dece2fa3eb)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:38.221519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc3b8c-e315-40f1-ac09-a96050ffdc8c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:38.289280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c3a651be-c525-455c-bd66-691d7cf794a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e68e994f1144b939659b16af55b8308'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.290184 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c3a651be-c525-455c-bd66-691d7cf794a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e68e994f1144b939659b16af55b8308'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.290964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c3a651be-c525-455c-bd66-691d7cf794a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e68e994f1144b939659b16af55b8308'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.293970 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-12cc3b8c-e315-40f1-ac09-a96050ffdc8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b8d446145946b2866628dece2fa3eb', 'request_id': 'req-12cc3b8c-e315-40f1-ac09-a96050ffdc8c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.299707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:38.302201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c3a651be-c525-455c-bd66-691d7cf794a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e68e994f1144b939659b16af55b8308'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.304727 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-12cc3b8c-e315-40f1-ac09-a96050ffdc8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b8d446145946b2866628dece2fa3eb', 'request_id': 'req-12cc3b8c-e315-40f1-ac09-a96050ffdc8c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.311766 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c3a651be-c525-455c-bd66-691d7cf794a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e68e994f1144b939659b16af55b8308'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.313559 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-12cc3b8c-e315-40f1-ac09-a96050ffdc8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b8d446145946b2866628dece2fa3eb', 'request_id': 'req-12cc3b8c-e315-40f1-ac09-a96050ffdc8c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.328688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-12cc3b8c-e315-40f1-ac09-a96050ffdc8c admin admin] The token cache is being invalidate because project e2b8d446145946b2866628dece2fa3eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:38.329220 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-12cc3b8c-e315-40f1-ac09-a96050ffdc8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.330244 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-12cc3b8c-e315-40f1-ac09-a96050ffdc8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.332286 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1168/2328] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:38 2022] DELETE /identity/v3/projects/e2b8d446145946b2866628dece2fa3eb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:38.336223 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1161/2329] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:38 2022] DELETE /identity/v3/users/3e68e994f1144b939659b16af55b8308 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:38.339277 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc3b8c-e315-40f1-ac09-a96050ffdc8c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:38.339277 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-12cc3b8c-e315-40f1-ac09-a96050ffdc8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:38.419356 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc3b8c-e315-40f1-ac09-a96050ffdc8c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:38.452146 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:38.484116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbbe39-6956-49d5-b665-ee2cf0ed66d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:38.484741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbbe39-6956-49d5-b665-ee2cf0ed66d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:38.485020 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbbe39-6956-49d5-b665-ee2cf0ed66d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:38.485287 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbbe39-6956-49d5-b665-ee2cf0ed66d0 admin admin] PATH_INFO: `/v3/users/218068f5c461423689f778c3db40fa10` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:38.486427 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbbe39-6956-49d5-b665-ee2cf0ed66d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=218068f5c461423689f778c3db40fa10)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:38.488361 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbbe39-6956-49d5-b665-ee2cf0ed66d0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:38.557515 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3ecbbe39-6956-49d5-b665-ee2cf0ed66d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '218068f5c461423689f778c3db40fa10'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.565680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3ecbbe39-6956-49d5-b665-ee2cf0ed66d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '218068f5c461423689f778c3db40fa10'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.566357 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3ecbbe39-6956-49d5-b665-ee2cf0ed66d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '218068f5c461423689f778c3db40fa10'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.584091 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3ecbbe39-6956-49d5-b665-ee2cf0ed66d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '218068f5c461423689f778c3db40fa10'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.591200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3ecbbe39-6956-49d5-b665-ee2cf0ed66d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '218068f5c461423689f778c3db40fa10'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:38.597721 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1169/2330] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:38 2022] DELETE /identity/v3/users/218068f5c461423689f778c3db40fa10 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:38.921245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a651be-c525-455c-bd66-691d7cf794a1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:38.923253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c3a651be-c525-455c-bd66-691d7cf794a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:38.940241 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a651be-c525-455c-bd66-691d7cf794a1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:39.015711 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbbe39-6956-49d5-b665-ee2cf0ed66d0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:39.017829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3ecbbe39-6956-49d5-b665-ee2cf0ed66d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:39.078394 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba816c4f-8118-4452-91fa-c483411f8d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:39.079355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba816c4f-8118-4452-91fa-c483411f8d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.081115 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba816c4f-8118-4452-91fa-c483411f8d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.081445 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba816c4f-8118-4452-91fa-c483411f8d25 admin admin] PATH_INFO: `/v3/projects/e25c5389b5244ef09733b37c4e28faa1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.084125 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba816c4f-8118-4452-91fa-c483411f8d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25c5389b5244ef09733b37c4e28faa1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:39.089951 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba816c4f-8118-4452-91fa-c483411f8d25 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:39.114132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbbe39-6956-49d5-b665-ee2cf0ed66d0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:39.122271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e53ea-ba2a-4401-ae4e-2ac52cc59bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:39.123423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e53ea-ba2a-4401-ae4e-2ac52cc59bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.123784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e53ea-ba2a-4401-ae4e-2ac52cc59bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.124133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e53ea-ba2a-4401-ae4e-2ac52cc59bb2 admin admin] PATH_INFO: `/v3/projects/cd888a6f14564fb4910820a6fcc1c4b1` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.126161 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e53ea-ba2a-4401-ae4e-2ac52cc59bb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd888a6f14564fb4910820a6fcc1c4b1)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:39.128125 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e53ea-ba2a-4401-ae4e-2ac52cc59bb2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:39.153020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ba816c4f-8118-4452-91fa-c483411f8d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25c5389b5244ef09733b37c4e28faa1', 'request_id': 'req-ba816c4f-8118-4452-91fa-c483411f8d25'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:39.159875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ba816c4f-8118-4452-91fa-c483411f8d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25c5389b5244ef09733b37c4e28faa1', 'request_id': 'req-ba816c4f-8118-4452-91fa-c483411f8d25'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:39.183594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ba816c4f-8118-4452-91fa-c483411f8d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25c5389b5244ef09733b37c4e28faa1', 'request_id': 'req-ba816c4f-8118-4452-91fa-c483411f8d25'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:39.188839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8e1e53ea-ba2a-4401-ae4e-2ac52cc59bb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd888a6f14564fb4910820a6fcc1c4b1', 'request_id': 'req-8e1e53ea-ba2a-4401-ae4e-2ac52cc59bb2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:39.194779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:39.199570 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8e1e53ea-ba2a-4401-ae4e-2ac52cc59bb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd888a6f14564fb4910820a6fcc1c4b1', 'request_id': 'req-8e1e53ea-ba2a-4401-ae4e-2ac52cc59bb2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:39.205000 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ba816c4f-8118-4452-91fa-c483411f8d25 admin admin] The token cache is being invalidate because project e25c5389b5244ef09733b37c4e28faa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:39.205295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ba816c4f-8118-4452-91fa-c483411f8d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:39.206057 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ba816c4f-8118-4452-91fa-c483411f8d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:39.207769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1162/2331] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:38 2022] DELETE /identity/v3/projects/e25c5389b5244ef09733b37c4e28faa1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:39.211418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8e1e53ea-ba2a-4401-ae4e-2ac52cc59bb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd888a6f14564fb4910820a6fcc1c4b1', 'request_id': 'req-8e1e53ea-ba2a-4401-ae4e-2ac52cc59bb2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:39.216139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df4462-5086-488b-aa9a-bf366ac90600 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.216754 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df4462-5086-488b-aa9a-bf366ac90600 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.217056 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df4462-5086-488b-aa9a-bf366ac90600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.233171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8e1e53ea-ba2a-4401-ae4e-2ac52cc59bb2 admin admin] The token cache is being invalidate because project cd888a6f14564fb4910820a6fcc1c4b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:39.233476 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8e1e53ea-ba2a-4401-ae4e-2ac52cc59bb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:39.234252 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8e1e53ea-ba2a-4401-ae4e-2ac52cc59bb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:39.236096 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1170/2332] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:39 2022] DELETE /identity/v3/projects/cd888a6f14564fb4910820a6fcc1c4b1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:39.245069 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5249ff-ce46-41db-85c2-216d7e0c0afa None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.245359 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5249ff-ce46-41db-85c2-216d7e0c0afa None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.245476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-63df4462-5086-488b-aa9a-bf366ac90600 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:39.245634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5249ff-ce46-41db-85c2-216d7e0c0afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.246806 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-63df4462-5086-488b-aa9a-bf366ac90600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:39.266613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-be5249ff-ce46-41db-85c2-216d7e0c0afa None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:39.267926 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-be5249ff-ce46-41db-85c2-216d7e0c0afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:39.312427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1163/2333] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:39.320456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cabc8-c39b-43e5-beb6-13ce2f94ba90 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.320732 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cabc8-c39b-43e5-beb6-13ce2f94ba90 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.321002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cabc8-c39b-43e5-beb6-13ce2f94ba90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.329880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:39.344429 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1171/2334] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:39.344948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-598cabc8-c39b-43e5-beb6-13ce2f94ba90 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:39.346383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fcc81-0505-46d7-90a6-b342771ecee8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.346658 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fcc81-0505-46d7-90a6-b342771ecee8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.347028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fcc81-0505-46d7-90a6-b342771ecee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.347418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-598cabc8-c39b-43e5-beb6-13ce2f94ba90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:39.357582 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1164/2335] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:39.361640 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cabc8-c39b-43e5-beb6-13ce2f94ba90 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:39.371552 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f08fcc81-0505-46d7-90a6-b342771ecee8 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:39.372861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cabc8-c39b-43e5-beb6-13ce2f94ba90 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:39.372978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f08fcc81-0505-46d7-90a6-b342771ecee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:39.377529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccb5bd-8555-4f77-ada7-4b3f3c0ba04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:39.378124 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccb5bd-8555-4f77-ada7-4b3f3c0ba04c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.378396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccb5bd-8555-4f77-ada7-4b3f3c0ba04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.378662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccb5bd-8555-4f77-ada7-4b3f3c0ba04c admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.379360 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccb5bd-8555-4f77-ada7-4b3f3c0ba04c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:10:39.379643 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccb5bd-8555-4f77-ada7-4b3f3c0ba04c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:39.381921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccb5bd-8555-4f77-ada7-4b3f3c0ba04c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:39.383329 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1172/2336] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:39.386207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fcc81-0505-46d7-90a6-b342771ecee8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:39.395347 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fcc81-0505-46d7-90a6-b342771ecee8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:39.401524 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1165/2337] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 07:10:39.401691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6da58-b28d-4e33-a361-14bfc9ce7533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:39.401691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6da58-b28d-4e33-a361-14bfc9ce7533 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.401999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6da58-b28d-4e33-a361-14bfc9ce7533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.402158 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6da58-b28d-4e33-a361-14bfc9ce7533 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.402514 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccb5bd-8555-4f77-ada7-4b3f3c0ba04c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:39.402813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6da58-b28d-4e33-a361-14bfc9ce7533 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:10:39.403146 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6da58-b28d-4e33-a361-14bfc9ce7533 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:39.404867 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6da58-b28d-4e33-a361-14bfc9ce7533 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:39.412653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccb5bd-8555-4f77-ada7-4b3f3c0ba04c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:39.418848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14589c4c-1ba0-45fc-842b-70b0acfa5ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:39.418988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1173/2338] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:10:39.419071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14589c4c-1ba0-45fc-842b-70b0acfa5ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.419318 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14589c4c-1ba0-45fc-842b-70b0acfa5ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.419565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14589c4c-1ba0-45fc-842b-70b0acfa5ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.420262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14589c4c-1ba0-45fc-842b-70b0acfa5ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:39.422596 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14589c4c-1ba0-45fc-842b-70b0acfa5ca6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:39.423147 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6da58-b28d-4e33-a361-14bfc9ce7533 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:39.433995 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6da58-b28d-4e33-a361-14bfc9ce7533 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:39.439481 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8e059-d638-4aa6-8bfd-a6730f26179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:39.440089 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8e059-d638-4aa6-8bfd-a6730f26179c admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.440371 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8e059-d638-4aa6-8bfd-a6730f26179c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.440681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8e059-d638-4aa6-8bfd-a6730f26179c admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.441307 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8e059-d638-4aa6-8bfd-a6730f26179c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:39.443912 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8e059-d638-4aa6-8bfd-a6730f26179c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:39.456412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1166/2339] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:39 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:39.460812 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14589c4c-1ba0-45fc-842b-70b0acfa5ca6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:39.474660 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1174/2340] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:39 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:10:39.478595 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8e059-d638-4aa6-8bfd-a6730f26179c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:39.542138 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14589c4c-1ba0-45fc-842b-70b0acfa5ca6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:39.542637 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8e059-d638-4aa6-8bfd-a6730f26179c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:39.547192 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbeff5a-bce9-4aba-b881-2af573932397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:39.547596 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdc040-1948-4b51-bf4f-6ffdf728ad57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:39.547792 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbeff5a-bce9-4aba-b881-2af573932397 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.548066 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbeff5a-bce9-4aba-b881-2af573932397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.548196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdc040-1948-4b51-bf4f-6ffdf728ad57 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.548333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbeff5a-bce9-4aba-b881-2af573932397 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.548476 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdc040-1948-4b51-bf4f-6ffdf728ad57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.548749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdc040-1948-4b51-bf4f-6ffdf728ad57 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.548941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbeff5a-bce9-4aba-b881-2af573932397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:39.549398 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdc040-1948-4b51-bf4f-6ffdf728ad57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:39.550831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbeff5a-bce9-4aba-b881-2af573932397 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:39.551376 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdc040-1948-4b51-bf4f-6ffdf728ad57 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:39.574144 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1175/2341] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:39 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:10:39.575848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1167/2342] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:39 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:39.579773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdc040-1948-4b51-bf4f-6ffdf728ad57 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:39.581023 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbeff5a-bce9-4aba-b881-2af573932397 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:39.589518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdc040-1948-4b51-bf4f-6ffdf728ad57 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:39.590963 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbeff5a-bce9-4aba-b881-2af573932397 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:39.594285 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8638f2c-c6b2-4a68-bc11-28800d914783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:39.594896 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8638f2c-c6b2-4a68-bc11-28800d914783 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.595324 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8638f2c-c6b2-4a68-bc11-28800d914783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.595602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8638f2c-c6b2-4a68-bc11-28800d914783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.595741 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9590b4-50c8-4f44-9dbf-20e130d1daf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:39.596243 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8638f2c-c6b2-4a68-bc11-28800d914783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:39.596347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9590b4-50c8-4f44-9dbf-20e130d1daf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.596537 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9590b4-50c8-4f44-9dbf-20e130d1daf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.596809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9590b4-50c8-4f44-9dbf-20e130d1daf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.597453 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9590b4-50c8-4f44-9dbf-20e130d1daf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:39.597819 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8638f2c-c6b2-4a68-bc11-28800d914783 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:39.599380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9590b4-50c8-4f44-9dbf-20e130d1daf2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:39.614741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1176/2343] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:39.615369 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1168/2344] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:39.615451 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8638f2c-c6b2-4a68-bc11-28800d914783 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:39.616685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9590b4-50c8-4f44-9dbf-20e130d1daf2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:39.625151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8638f2c-c6b2-4a68-bc11-28800d914783 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:39.634342 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9590b4-50c8-4f44-9dbf-20e130d1daf2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:39.636025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9d099-0def-42cb-a534-33ec5edfe8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:39.636878 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9d099-0def-42cb-a534-33ec5edfe8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.637292 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9d099-0def-42cb-a534-33ec5edfe8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.638080 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9d099-0def-42cb-a534-33ec5edfe8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.638724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9d099-0def-42cb-a534-33ec5edfe8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:39.640419 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9d099-0def-42cb-a534-33ec5edfe8e1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:39.640994 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0383c-987a-48f8-a121-e99b31f32ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:39.641833 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0383c-987a-48f8-a121-e99b31f32ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.642121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0383c-987a-48f8-a121-e99b31f32ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.642421 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0383c-987a-48f8-a121-e99b31f32ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.643528 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0383c-987a-48f8-a121-e99b31f32ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:39.645158 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0383c-987a-48f8-a121-e99b31f32ec5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:39.653584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1177/2345] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:39.659774 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1169/2346] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:39.659927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9d099-0def-42cb-a534-33ec5edfe8e1 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:39.660726 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0383c-987a-48f8-a121-e99b31f32ec5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:39.667642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9d099-0def-42cb-a534-33ec5edfe8e1 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:39.670532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0383c-987a-48f8-a121-e99b31f32ec5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:39.672225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46820b38-fedd-41f4-9743-7e138f454adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:39.672853 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46820b38-fedd-41f4-9743-7e138f454adc admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.673127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46820b38-fedd-41f4-9743-7e138f454adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.673394 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46820b38-fedd-41f4-9743-7e138f454adc admin admin] PATH_INFO: `/v3/projects/410233677757416187676bd0389350f1/users/d6bd0e34ef614213a6b539ac7c17743a/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.675372 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bb717-5426-45d6-8836-beceab6dcac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:39.675554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:39.676000 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bb717-5426-45d6-8836-beceab6dcac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.676273 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bb717-5426-45d6-8836-beceab6dcac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.677166 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bb717-5426-45d6-8836-beceab6dcac8 admin admin] PATH_INFO: `/v3/projects/420c55b68ba1427bb1e5efb2cad6ee1a/users/f3cf331c2c1a4233971700a2485ae81a/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.691742 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46820b38-fedd-41f4-9743-7e138f454adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=410233677757416187676bd0389350f1, user_id=d6bd0e34ef614213a6b539ac7c17743a, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:39.692872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bb717-5426-45d6-8836-beceab6dcac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=420c55b68ba1427bb1e5efb2cad6ee1a, user_id=f3cf331c2c1a4233971700a2485ae81a, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:39.694475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46820b38-fedd-41f4-9743-7e138f454adc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:39.695838 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bb717-5426-45d6-8836-beceab6dcac8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:39.708334 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1178/2347] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:39 2022] PUT /identity/v3/projects/410233677757416187676bd0389350f1/users/d6bd0e34ef614213a6b539ac7c17743a/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:39.710426 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1170/2348] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:39 2022] PUT /identity/v3/projects/420c55b68ba1427bb1e5efb2cad6ee1a/users/f3cf331c2c1a4233971700a2485ae81a/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:39.719533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ec22d-a126-47ec-bdac-e7a887660189 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.719899 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ec22d-a126-47ec-bdac-e7a887660189 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.720173 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ec22d-a126-47ec-bdac-e7a887660189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.721407 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a5b5d-0d00-45a8-b177-40f805034452 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.721693 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a5b5d-0d00-45a8-b177-40f805034452 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.721967 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a5b5d-0d00-45a8-b177-40f805034452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.748147 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-509ec22d-a126-47ec-bdac-e7a887660189 None None] MFA Rules not processed for user `d6bd0e34ef614213a6b539ac7c17743a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:39.749244 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-dd5a5b5d-0d00-45a8-b177-40f805034452 None None] MFA Rules not processed for user `f3cf331c2c1a4233971700a2485ae81a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:39.749439 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-509ec22d-a126-47ec-bdac-e7a887660189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:39.750441 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dd5a5b5d-0d00-45a8-b177-40f805034452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:39.805052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:39.814179 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1179/2349] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:39.817921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1171/2350] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:39.819564 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ec22d-a126-47ec-bdac-e7a887660189 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:39.829080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a5b5d-0d00-45a8-b177-40f805034452 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:39.830425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dd5a5b5d-0d00-45a8-b177-40f805034452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:39.880704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ec22d-a126-47ec-bdac-e7a887660189 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:39.885440 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c605e-8777-4db4-86aa-41e826751d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:39.886044 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c605e-8777-4db4-86aa-41e826751d92 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.886315 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c605e-8777-4db4-86aa-41e826751d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.886581 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c605e-8777-4db4-86aa-41e826751d92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.887458 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c605e-8777-4db4-86aa-41e826751d92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:39.887577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a5b5d-0d00-45a8-b177-40f805034452 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:39.889109 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c605e-8777-4db4-86aa-41e826751d92 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:39.891162 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cca69-d39d-4552-95b1-547b043e78a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:39.891765 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cca69-d39d-4552-95b1-547b043e78a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:39.892044 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cca69-d39d-4552-95b1-547b043e78a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:39.892315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cca69-d39d-4552-95b1-547b043e78a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:39.903698 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cca69-d39d-4552-95b1-547b043e78a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:39.905601 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cca69-d39d-4552-95b1-547b043e78a2 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:39.916257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1172/2351] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:10:39.921710 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1180/2352] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:39 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:10:39.925541 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cca69-d39d-4552-95b1-547b043e78a2 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:39.938709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cca69-d39d-4552-95b1-547b043e78a2 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:40.010411 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041f4b8-91a6-470a-aeeb-2d470c175bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:40.011269 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041f4b8-91a6-470a-aeeb-2d470c175bbf admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:40.011350 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041f4b8-91a6-470a-aeeb-2d470c175bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:40.011610 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041f4b8-91a6-470a-aeeb-2d470c175bbf admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:40.012249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041f4b8-91a6-470a-aeeb-2d470c175bbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:40.014206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041f4b8-91a6-470a-aeeb-2d470c175bbf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:40.043260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1173/2353] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:39 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:10:40.044461 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c605e-8777-4db4-86aa-41e826751d92 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:40.056784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c605e-8777-4db4-86aa-41e826751d92 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:40.067659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65682d15-01bb-481e-b2c5-6f580092e474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:40.068462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65682d15-01bb-481e-b2c5-6f580092e474 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:40.068983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65682d15-01bb-481e-b2c5-6f580092e474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:40.069489 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65682d15-01bb-481e-b2c5-6f580092e474 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:40.070312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65682d15-01bb-481e-b2c5-6f580092e474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:40.072270 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65682d15-01bb-481e-b2c5-6f580092e474 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:40.083892 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1181/2354] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:40.088574 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041f4b8-91a6-470a-aeeb-2d470c175bbf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:40.103070 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041f4b8-91a6-470a-aeeb-2d470c175bbf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:40.108941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecb632-ec8c-41a9-a91f-8af8131b0280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:40.109524 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecb632-ec8c-41a9-a91f-8af8131b0280 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:40.109810 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecb632-ec8c-41a9-a91f-8af8131b0280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:40.110113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecb632-ec8c-41a9-a91f-8af8131b0280 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:40.110769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ecb632-ec8c-41a9-a91f-8af8131b0280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:40.112442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ecb632-ec8c-41a9-a91f-8af8131b0280 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:40.124010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1174/2355] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:40.128062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65682d15-01bb-481e-b2c5-6f580092e474 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:40.139124 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65682d15-01bb-481e-b2c5-6f580092e474 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:40.143964 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12a888-22c0-4e08-9a3a-ff71e9922933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:40.144732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12a888-22c0-4e08-9a3a-ff71e9922933 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:40.145016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12a888-22c0-4e08-9a3a-ff71e9922933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:40.145793 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12a888-22c0-4e08-9a3a-ff71e9922933 admin admin] PATH_INFO: `/v3/projects/20dcce603a4741dea04a4a6de5a32574/users/59608699d6fb4341826b5edafb28667d/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:40.164610 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12a888-22c0-4e08-9a3a-ff71e9922933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20dcce603a4741dea04a4a6de5a32574, user_id=59608699d6fb4341826b5edafb28667d, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:40.167768 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12a888-22c0-4e08-9a3a-ff71e9922933 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:40.180708 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1182/2356] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:40 2022] PUT /identity/v3/projects/20dcce603a4741dea04a4a6de5a32574/users/59608699d6fb4341826b5edafb28667d/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:40.191974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14084638-3604-4ab5-b78f-2d996505e649 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:40.192224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14084638-3604-4ab5-b78f-2d996505e649 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:40.192690 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14084638-3604-4ab5-b78f-2d996505e649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:40.240288 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-14084638-3604-4ab5-b78f-2d996505e649 None None] MFA Rules not processed for user `59608699d6fb4341826b5edafb28667d`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:40.241834 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-14084638-3604-4ab5-b78f-2d996505e649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:40.326266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1175/2357] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:40.330891 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12a888-22c0-4e08-9a3a-ff71e9922933 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:40.358605 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:40.396543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12a888-22c0-4e08-9a3a-ff71e9922933 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:40.401978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee08e8-0542-4ff9-bd91-c3fc582f9f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:40.402588 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee08e8-0542-4ff9-bd91-c3fc582f9f43 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:40.402871 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee08e8-0542-4ff9-bd91-c3fc582f9f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:40.403218 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee08e8-0542-4ff9-bd91-c3fc582f9f43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:40.403844 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee08e8-0542-4ff9-bd91-c3fc582f9f43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:40.405739 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee08e8-0542-4ff9-bd91-c3fc582f9f43 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:40.433185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1183/2358] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:40 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:40.437583 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14084638-3604-4ab5-b78f-2d996505e649 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:40.444791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:40.449473 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14084638-3604-4ab5-b78f-2d996505e649 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:40.510566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93132a7f-a6d7-4fe4-a251-a915be705413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:40.511105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93132a7f-a6d7-4fe4-a251-a915be705413 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:40.511400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93132a7f-a6d7-4fe4-a251-a915be705413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:40.511701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93132a7f-a6d7-4fe4-a251-a915be705413 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:40.512327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93132a7f-a6d7-4fe4-a251-a915be705413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:40.514213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93132a7f-a6d7-4fe4-a251-a915be705413 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:40.538425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1176/2359] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:40 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:40.543116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee08e8-0542-4ff9-bd91-c3fc582f9f43 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:40.554217 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee08e8-0542-4ff9-bd91-c3fc582f9f43 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:40.559110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e33b7-c546-4bbc-b690-9455cbbc83c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:40.559832 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e33b7-c546-4bbc-b690-9455cbbc83c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:40.560117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e33b7-c546-4bbc-b690-9455cbbc83c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:40.560390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e33b7-c546-4bbc-b690-9455cbbc83c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:40.561065 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e33b7-c546-4bbc-b690-9455cbbc83c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:40.562632 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e33b7-c546-4bbc-b690-9455cbbc83c4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:40.574138 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1184/2360] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:10:40.578469 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93132a7f-a6d7-4fe4-a251-a915be705413 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:40.588731 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93132a7f-a6d7-4fe4-a251-a915be705413 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:40.593375 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3de08f-d372-472d-9ccb-29789000fac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:40.594022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3de08f-d372-472d-9ccb-29789000fac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:40.594297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3de08f-d372-472d-9ccb-29789000fac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:40.594566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3de08f-d372-472d-9ccb-29789000fac7 admin admin] PATH_INFO: `/v3/projects/c0d333e758084914a307ccd00cd5d2b0/users/74c85a4872834c8197cb7ec95802a449/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:40.609983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3de08f-d372-472d-9ccb-29789000fac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d333e758084914a307ccd00cd5d2b0, user_id=74c85a4872834c8197cb7ec95802a449, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:40.612696 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3de08f-d372-472d-9ccb-29789000fac7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:40.635684 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1177/2361] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:40 2022] PUT /identity/v3/projects/c0d333e758084914a307ccd00cd5d2b0/users/74c85a4872834c8197cb7ec95802a449/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:40.639975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e33b7-c546-4bbc-b690-9455cbbc83c4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:40.651011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e33b7-c546-4bbc-b690-9455cbbc83c4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:40.728405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154454a0-27b7-4881-ac89-464e4c1e5927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:40.729002 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154454a0-27b7-4881-ac89-464e4c1e5927 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:40.729292 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154454a0-27b7-4881-ac89-464e4c1e5927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:40.729546 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154454a0-27b7-4881-ac89-464e4c1e5927 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:40.730175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154454a0-27b7-4881-ac89-464e4c1e5927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:40.732058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154454a0-27b7-4881-ac89-464e4c1e5927 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:40.745779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1185/2362] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:40.747728 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3de08f-d372-472d-9ccb-29789000fac7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:40.758645 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3de08f-d372-472d-9ccb-29789000fac7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:40.763381 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2fd74-4b76-4169-821d-71ed0240481e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:40.763966 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2fd74-4b76-4169-821d-71ed0240481e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:40.764245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2fd74-4b76-4169-821d-71ed0240481e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:40.764513 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2fd74-4b76-4169-821d-71ed0240481e admin admin] PATH_INFO: `/v3/projects/c0d333e758084914a307ccd00cd5d2b0/users/74c85a4872834c8197cb7ec95802a449/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:40.766410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2fd74-4b76-4169-821d-71ed0240481e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d333e758084914a307ccd00cd5d2b0, user_id=74c85a4872834c8197cb7ec95802a449, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:40.769101 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2fd74-4b76-4169-821d-71ed0240481e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:40.779390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1178/2363] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:40 2022] PUT /identity/v3/projects/c0d333e758084914a307ccd00cd5d2b0/users/74c85a4872834c8197cb7ec95802a449/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:40.790498 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e599c5b-b6e1-43ef-8284-93481dc8f7ba None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:40.790786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e599c5b-b6e1-43ef-8284-93481dc8f7ba None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:40.791056 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e599c5b-b6e1-43ef-8284-93481dc8f7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:40.820028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2e599c5b-b6e1-43ef-8284-93481dc8f7ba None None] MFA Rules not processed for user `74c85a4872834c8197cb7ec95802a449`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:40.821482 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2e599c5b-b6e1-43ef-8284-93481dc8f7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:40.889099 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1186/2364] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:40.900702 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2fd74-4b76-4169-821d-71ed0240481e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:40.902427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c7a2fd74-4b76-4169-821d-71ed0240481e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:40.966082 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2fd74-4b76-4169-821d-71ed0240481e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:40.970908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0369ef8-f1d0-4ad1-8f67-ecdaad9141cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:40.971565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0369ef8-f1d0-4ad1-8f67-ecdaad9141cf service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:40.971838 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0369ef8-f1d0-4ad1-8f67-ecdaad9141cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:40.972103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0369ef8-f1d0-4ad1-8f67-ecdaad9141cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:41.032308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0369ef8-f1d0-4ad1-8f67-ecdaad9141cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:41.033781 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0369ef8-f1d0-4ad1-8f67-ecdaad9141cf service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:41.044164 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1179/2365] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:42.608351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e599c5b-b6e1-43ef-8284-93481dc8f7ba None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:42.618233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e599c5b-b6e1-43ef-8284-93481dc8f7ba None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:42.621834 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdde94-60ad-4b2e-914d-ed5a5f50afe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:42.622433 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdde94-60ad-4b2e-914d-ed5a5f50afe9 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:42.622709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdde94-60ad-4b2e-914d-ed5a5f50afe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:42.623002 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdde94-60ad-4b2e-914d-ed5a5f50afe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:42.638566 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:42.686132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdde94-60ad-4b2e-914d-ed5a5f50afe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:42.687581 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdde94-60ad-4b2e-914d-ed5a5f50afe9 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:42.696872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1187/2366] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:43.124294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0369ef8-f1d0-4ad1-8f67-ecdaad9141cf service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:43.142059 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:43.215324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0369ef8-f1d0-4ad1-8f67-ecdaad9141cf service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:43.235620 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44230c-a4b0-4f74-bb1b-a8b18729aecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:43.236266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44230c-a4b0-4f74-bb1b-a8b18729aecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:43.236542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44230c-a4b0-4f74-bb1b-a8b18729aecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:43.236811 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44230c-a4b0-4f74-bb1b-a8b18729aecf admin admin] PATH_INFO: `/v3/users/f3cf331c2c1a4233971700a2485ae81a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:43.237954 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44230c-a4b0-4f74-bb1b-a8b18729aecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3cf331c2c1a4233971700a2485ae81a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:43.240814 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44230c-a4b0-4f74-bb1b-a8b18729aecf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:43.299284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fa44230c-a4b0-4f74-bb1b-a8b18729aecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3cf331c2c1a4233971700a2485ae81a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:43.304249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fa44230c-a4b0-4f74-bb1b-a8b18729aecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3cf331c2c1a4233971700a2485ae81a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:43.305004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fa44230c-a4b0-4f74-bb1b-a8b18729aecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3cf331c2c1a4233971700a2485ae81a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:43.313495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fa44230c-a4b0-4f74-bb1b-a8b18729aecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3cf331c2c1a4233971700a2485ae81a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:43.327226 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fa44230c-a4b0-4f74-bb1b-a8b18729aecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3cf331c2c1a4233971700a2485ae81a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:43.347506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1180/2367] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:43 2022] DELETE /identity/v3/users/f3cf331c2c1a4233971700a2485ae81a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:43.352570 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3d1ca-d048-4093-9d03-a0a577871c19 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:43.352570 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3d1ca-d048-4093-9d03-a0a577871c19 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:43.352839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3d1ca-d048-4093-9d03-a0a577871c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:43.363819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44230c-a4b0-4f74-bb1b-a8b18729aecf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:43.365880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fa44230c-a4b0-4f74-bb1b-a8b18729aecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:43.377890 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-04f3d1ca-d048-4093-9d03-a0a577871c19 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:43.379177 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-04f3d1ca-d048-4093-9d03-a0a577871c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:43.454665 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44230c-a4b0-4f74-bb1b-a8b18729aecf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:43.459291 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8f9ef-02ab-486d-9ef6-d6c050ad1609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:43.459906 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8f9ef-02ab-486d-9ef6-d6c050ad1609 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:43.460223 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8f9ef-02ab-486d-9ef6-d6c050ad1609 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:43.460447 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8f9ef-02ab-486d-9ef6-d6c050ad1609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:43.462255 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-33a8f9ef-02ab-486d-9ef6-d6c050ad1609 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:43.469137 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1188/2368] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:43.476652 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3d1ca-d048-4093-9d03-a0a577871c19 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:43.478028 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-04f3d1ca-d048-4093-9d03-a0a577871c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:43.523258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:43.550550 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8f9ef-02ab-486d-9ef6-d6c050ad1609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:43.552549 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3d1ca-d048-4093-9d03-a0a577871c19 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:43.554157 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8f9ef-02ab-486d-9ef6-d6c050ad1609 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:43.564887 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f12495-a723-4e3d-98a3-8782bb23f25c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:43.565921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f12495-a723-4e3d-98a3-8782bb23f25c service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:43.566309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f12495-a723-4e3d-98a3-8782bb23f25c service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:43.566584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f12495-a723-4e3d-98a3-8782bb23f25c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:43.567975 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1181/2369] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:43.579923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f12495-a723-4e3d-98a3-8782bb23f25c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:43.581451 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f12495-a723-4e3d-98a3-8782bb23f25c service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:43.602596 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1189/2370] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:10:43.919046 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8f9ef-02ab-486d-9ef6-d6c050ad1609 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:43.920647 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-33a8f9ef-02ab-486d-9ef6-d6c050ad1609 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:43.944571 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8f9ef-02ab-486d-9ef6-d6c050ad1609 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:43.949436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834f213-f93a-45de-9059-6719373b84a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:43.950060 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834f213-f93a-45de-9059-6719373b84a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:43.950334 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834f213-f93a-45de-9059-6719373b84a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:43.950602 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834f213-f93a-45de-9059-6719373b84a9 admin admin] PATH_INFO: `/v3/projects/420c55b68ba1427bb1e5efb2cad6ee1a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:43.951737 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834f213-f93a-45de-9059-6719373b84a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=420c55b68ba1427bb1e5efb2cad6ee1a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:43.953628 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834f213-f93a-45de-9059-6719373b84a9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:43.999109 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3834f213-f93a-45de-9059-6719373b84a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '420c55b68ba1427bb1e5efb2cad6ee1a', 'request_id': 'req-3834f213-f93a-45de-9059-6719373b84a9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:44.005869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3834f213-f93a-45de-9059-6719373b84a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '420c55b68ba1427bb1e5efb2cad6ee1a', 'request_id': 'req-3834f213-f93a-45de-9059-6719373b84a9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:44.011715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3834f213-f93a-45de-9059-6719373b84a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '420c55b68ba1427bb1e5efb2cad6ee1a', 'request_id': 'req-3834f213-f93a-45de-9059-6719373b84a9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:44.023795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3834f213-f93a-45de-9059-6719373b84a9 admin admin] The token cache is being invalidate because project 420c55b68ba1427bb1e5efb2cad6ee1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:44.024451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3834f213-f93a-45de-9059-6719373b84a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:44.024680 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3834f213-f93a-45de-9059-6719373b84a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:44.026137 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1182/2371] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:43 2022] DELETE /identity/v3/projects/420c55b68ba1427bb1e5efb2cad6ee1a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:44.031243 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8b990-bf9c-449d-91bd-026589767fc2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:44.031751 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8b990-bf9c-449d-91bd-026589767fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:44.031843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8b990-bf9c-449d-91bd-026589767fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:44.052079 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-26c8b990-bf9c-449d-91bd-026589767fc2 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:44.053390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-26c8b990-bf9c-449d-91bd-026589767fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:44.104383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:44.112602 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1190/2372] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:44.125462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ef3b3-0e0a-41e3-addb-4c9315bea7eb None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:44.125999 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ef3b3-0e0a-41e3-addb-4c9315bea7eb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:44.125999 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ef3b3-0e0a-41e3-addb-4c9315bea7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:44.151698 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-891ef3b3-0e0a-41e3-addb-4c9315bea7eb None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:44.152889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-891ef3b3-0e0a-41e3-addb-4c9315bea7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:44.160779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1183/2373] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:44.164810 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8b990-bf9c-449d-91bd-026589767fc2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:44.174249 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8b990-bf9c-449d-91bd-026589767fc2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:44.179961 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe95ec-ea13-4069-9742-8223834dd966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:44.180558 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe95ec-ea13-4069-9742-8223834dd966 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:44.180855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe95ec-ea13-4069-9742-8223834dd966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:44.181124 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe95ec-ea13-4069-9742-8223834dd966 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:44.181762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe95ec-ea13-4069-9742-8223834dd966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:10:44.182061 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe95ec-ea13-4069-9742-8223834dd966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:44.183661 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe95ec-ea13-4069-9742-8223834dd966 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:44.195889 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1191/2374] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:10:44.200633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ef3b3-0e0a-41e3-addb-4c9315bea7eb None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:44.210591 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ef3b3-0e0a-41e3-addb-4c9315bea7eb None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:44.232513 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b68a06-0230-4fd0-8647-f8d180b5e833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:44.233190 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b68a06-0230-4fd0-8647-f8d180b5e833 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:44.233471 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b68a06-0230-4fd0-8647-f8d180b5e833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:44.233741 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b68a06-0230-4fd0-8647-f8d180b5e833 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:44.234446 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b68a06-0230-4fd0-8647-f8d180b5e833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:44.236454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b68a06-0230-4fd0-8647-f8d180b5e833 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:44.269113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1184/2375] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:44 2022] POST /identity/v3/projects => generated 363 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:44.271049 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe95ec-ea13-4069-9742-8223834dd966 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:44.281225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe95ec-ea13-4069-9742-8223834dd966 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:44.339905 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb464f75-0e6e-41b2-be72-30fbc980a0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:44.340505 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb464f75-0e6e-41b2-be72-30fbc980a0aa admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:44.340783 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb464f75-0e6e-41b2-be72-30fbc980a0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:44.341053 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb464f75-0e6e-41b2-be72-30fbc980a0aa admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:44.341665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb464f75-0e6e-41b2-be72-30fbc980a0aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:44.343599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb464f75-0e6e-41b2-be72-30fbc980a0aa admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:44.367734 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1192/2376] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:44 2022] POST /identity/v3/users => generated 282 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:44.371628 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b68a06-0230-4fd0-8647-f8d180b5e833 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:44.382054 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b68a06-0230-4fd0-8647-f8d180b5e833 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:44.387434 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b4563-6e83-47d9-b189-066d32289923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:44.388047 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b4563-6e83-47d9-b189-066d32289923 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:44.388324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b4563-6e83-47d9-b189-066d32289923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:44.388594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b4563-6e83-47d9-b189-066d32289923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:44.389231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b4563-6e83-47d9-b189-066d32289923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:44.390805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b4563-6e83-47d9-b189-066d32289923 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:44.403267 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1185/2377] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:44.407212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb464f75-0e6e-41b2-be72-30fbc980a0aa admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:44.419150 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb464f75-0e6e-41b2-be72-30fbc980a0aa admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:44.424581 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488af4b4-2f29-4dfb-84c2-0c6bea78f3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:44.425195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488af4b4-2f29-4dfb-84c2-0c6bea78f3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:44.425473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488af4b4-2f29-4dfb-84c2-0c6bea78f3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:44.425736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488af4b4-2f29-4dfb-84c2-0c6bea78f3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:44.426977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488af4b4-2f29-4dfb-84c2-0c6bea78f3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:44.428612 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488af4b4-2f29-4dfb-84c2-0c6bea78f3c4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:44.439931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1193/2378] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:44.444776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b4563-6e83-47d9-b189-066d32289923 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:44.454951 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b4563-6e83-47d9-b189-066d32289923 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:44.459879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046be168-c546-44d7-bcb7-fc437fcb0826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:44.460523 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be168-c546-44d7-bcb7-fc437fcb0826 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:44.460808 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be168-c546-44d7-bcb7-fc437fcb0826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:44.461074 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be168-c546-44d7-bcb7-fc437fcb0826 admin admin] PATH_INFO: `/v3/projects/4c1d7cc785c0459984089186e1be3a6f/users/25aac7a67fd640098a051e4143b94c4f/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:44.476153 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046be168-c546-44d7-bcb7-fc437fcb0826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1d7cc785c0459984089186e1be3a6f, user_id=25aac7a67fd640098a051e4143b94c4f, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:44.478759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046be168-c546-44d7-bcb7-fc437fcb0826 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:44.491777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1186/2379] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:44 2022] PUT /identity/v3/projects/4c1d7cc785c0459984089186e1be3a6f/users/25aac7a67fd640098a051e4143b94c4f/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:44.502129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0982174-d866-4ae7-89e7-f0443311ce83 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:44.502355 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0982174-d866-4ae7-89e7-f0443311ce83 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:44.502649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0982174-d866-4ae7-89e7-f0443311ce83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:44.529410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e0982174-d866-4ae7-89e7-f0443311ce83 None None] MFA Rules not processed for user `25aac7a67fd640098a051e4143b94c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:44.530999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e0982174-d866-4ae7-89e7-f0443311ce83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:44.597639 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1194/2380] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:44.609133 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046be168-c546-44d7-bcb7-fc437fcb0826 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:44.610838 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-046be168-c546-44d7-bcb7-fc437fcb0826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:44.669920 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046be168-c546-44d7-bcb7-fc437fcb0826 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:44.673557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260a553-b9e6-4f72-8c39-89730aa1f412 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:44.674158 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260a553-b9e6-4f72-8c39-89730aa1f412 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:44.674432 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260a553-b9e6-4f72-8c39-89730aa1f412 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:44.674700 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260a553-b9e6-4f72-8c39-89730aa1f412 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:44.682783 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260a553-b9e6-4f72-8c39-89730aa1f412 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:44.684279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260a553-b9e6-4f72-8c39-89730aa1f412 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:44.693410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1187/2381] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:48.796905 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0982174-d866-4ae7-89e7-f0443311ce83 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:48.797808 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e0982174-d866-4ae7-89e7-f0443311ce83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:48.861708 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:48.869701 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0982174-d866-4ae7-89e7-f0443311ce83 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:48.876162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b10110-e7ed-4e5d-be11-ecf58c224287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:48.876852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b10110-e7ed-4e5d-be11-ecf58c224287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:48.877128 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b10110-e7ed-4e5d-be11-ecf58c224287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:48.877421 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b10110-e7ed-4e5d-be11-ecf58c224287 admin admin] PATH_INFO: `/v3/users/d6bd0e34ef614213a6b539ac7c17743a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:48.878586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b10110-e7ed-4e5d-be11-ecf58c224287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6bd0e34ef614213a6b539ac7c17743a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:48.880533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b10110-e7ed-4e5d-be11-ecf58c224287 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:48.939516 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-72b10110-e7ed-4e5d-be11-ecf58c224287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6bd0e34ef614213a6b539ac7c17743a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:48.954796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-72b10110-e7ed-4e5d-be11-ecf58c224287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6bd0e34ef614213a6b539ac7c17743a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:48.955443 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-72b10110-e7ed-4e5d-be11-ecf58c224287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6bd0e34ef614213a6b539ac7c17743a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:48.968091 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-72b10110-e7ed-4e5d-be11-ecf58c224287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6bd0e34ef614213a6b539ac7c17743a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:48.976001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-72b10110-e7ed-4e5d-be11-ecf58c224287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6bd0e34ef614213a6b539ac7c17743a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:48.981825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1195/2382] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:48 2022] DELETE /identity/v3/users/d6bd0e34ef614213a6b539ac7c17743a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:48.986369 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb0eba-ad57-4238-aa03-c67f07710674 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:48.986892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb0eba-ad57-4238-aa03-c67f07710674 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:48.986988 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb0eba-ad57-4238-aa03-c67f07710674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:48.995069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:49.009321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d0bb0eba-ad57-4238-aa03-c67f07710674 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:49.010543 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d0bb0eba-ad57-4238-aa03-c67f07710674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:49.070190 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1188/2383] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:49.080938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b10110-e7ed-4e5d-be11-ecf58c224287 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:49.082372 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-72b10110-e7ed-4e5d-be11-ecf58c224287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:49.144751 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b10110-e7ed-4e5d-be11-ecf58c224287 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:49.148474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a4083-9e65-4b59-87dc-59804dc63e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:49.149066 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a4083-9e65-4b59-87dc-59804dc63e6f service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:49.149340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a4083-9e65-4b59-87dc-59804dc63e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:49.149608 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a4083-9e65-4b59-87dc-59804dc63e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:49.158549 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a4083-9e65-4b59-87dc-59804dc63e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:49.160052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a4083-9e65-4b59-87dc-59804dc63e6f service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:49.169474 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1196/2384] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:10:49.447996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb0eba-ad57-4238-aa03-c67f07710674 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:49.449740 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d0bb0eba-ad57-4238-aa03-c67f07710674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:49.463989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb0eba-ad57-4238-aa03-c67f07710674 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:49.470136 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d518a89-0db0-4ada-a0bc-04c86335a336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:49.470805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d518a89-0db0-4ada-a0bc-04c86335a336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:49.471077 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d518a89-0db0-4ada-a0bc-04c86335a336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:49.471473 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d518a89-0db0-4ada-a0bc-04c86335a336 admin admin] PATH_INFO: `/v3/projects/410233677757416187676bd0389350f1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:49.472547 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d518a89-0db0-4ada-a0bc-04c86335a336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=410233677757416187676bd0389350f1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:49.475437 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d518a89-0db0-4ada-a0bc-04c86335a336 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:49.521459 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8d518a89-0db0-4ada-a0bc-04c86335a336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410233677757416187676bd0389350f1', 'request_id': 'req-8d518a89-0db0-4ada-a0bc-04c86335a336'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:49.527327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8d518a89-0db0-4ada-a0bc-04c86335a336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410233677757416187676bd0389350f1', 'request_id': 'req-8d518a89-0db0-4ada-a0bc-04c86335a336'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:49.532653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8d518a89-0db0-4ada-a0bc-04c86335a336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410233677757416187676bd0389350f1', 'request_id': 'req-8d518a89-0db0-4ada-a0bc-04c86335a336'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:49.545430 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8d518a89-0db0-4ada-a0bc-04c86335a336 admin admin] The token cache is being invalidate because project 410233677757416187676bd0389350f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:49.545715 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8d518a89-0db0-4ada-a0bc-04c86335a336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:49.546343 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8d518a89-0db0-4ada-a0bc-04c86335a336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:49.551735 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1189/2385] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:49 2022] DELETE /identity/v3/projects/410233677757416187676bd0389350f1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:49.552621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a4083-9e65-4b59-87dc-59804dc63e6f service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:49.562529 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a4083-9e65-4b59-87dc-59804dc63e6f service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:49.631969 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f86cc-2ef8-4fb8-aefa-aed5b7c61782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:49.633042 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f86cc-2ef8-4fb8-aefa-aed5b7c61782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:49.633368 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f86cc-2ef8-4fb8-aefa-aed5b7c61782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:49.633636 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f86cc-2ef8-4fb8-aefa-aed5b7c61782 admin admin] PATH_INFO: `/v3/users/59608699d6fb4341826b5edafb28667d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:49.635113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f86cc-2ef8-4fb8-aefa-aed5b7c61782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59608699d6fb4341826b5edafb28667d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:49.637516 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f86cc-2ef8-4fb8-aefa-aed5b7c61782 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:49.672400 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:49.704037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1e6f86cc-2ef8-4fb8-aefa-aed5b7c61782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59608699d6fb4341826b5edafb28667d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:49.713337 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1e6f86cc-2ef8-4fb8-aefa-aed5b7c61782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59608699d6fb4341826b5edafb28667d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:49.713958 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1e6f86cc-2ef8-4fb8-aefa-aed5b7c61782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59608699d6fb4341826b5edafb28667d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:49.726272 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1e6f86cc-2ef8-4fb8-aefa-aed5b7c61782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59608699d6fb4341826b5edafb28667d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:49.733276 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1e6f86cc-2ef8-4fb8-aefa-aed5b7c61782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59608699d6fb4341826b5edafb28667d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:49.739837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1197/2386] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:49 2022] DELETE /identity/v3/users/59608699d6fb4341826b5edafb28667d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:10:50.051392 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d518a89-0db0-4ada-a0bc-04c86335a336 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:50.051392 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8d518a89-0db0-4ada-a0bc-04c86335a336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:50.069158 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d518a89-0db0-4ada-a0bc-04c86335a336 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:50.128727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a3802-5ea9-4be9-9306-d471f6d4d180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:50.129868 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a3802-5ea9-4be9-9306-d471f6d4d180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:50.130144 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a3802-5ea9-4be9-9306-d471f6d4d180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:50.130406 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a3802-5ea9-4be9-9306-d471f6d4d180 admin admin] PATH_INFO: `/v3/projects/20dcce603a4741dea04a4a6de5a32574` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:50.131556 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a3802-5ea9-4be9-9306-d471f6d4d180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20dcce603a4741dea04a4a6de5a32574)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:50.133450 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a3802-5ea9-4be9-9306-d471f6d4d180 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:50.164905 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:50.189856 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d8a3802-5ea9-4be9-9306-d471f6d4d180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20dcce603a4741dea04a4a6de5a32574', 'request_id': 'req-0d8a3802-5ea9-4be9-9306-d471f6d4d180'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:50.196970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d8a3802-5ea9-4be9-9306-d471f6d4d180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20dcce603a4741dea04a4a6de5a32574', 'request_id': 'req-0d8a3802-5ea9-4be9-9306-d471f6d4d180'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:50.203279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d8a3802-5ea9-4be9-9306-d471f6d4d180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20dcce603a4741dea04a4a6de5a32574', 'request_id': 'req-0d8a3802-5ea9-4be9-9306-d471f6d4d180'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:50.214885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d8a3802-5ea9-4be9-9306-d471f6d4d180 admin admin] The token cache is being invalidate because project 20dcce603a4741dea04a4a6de5a32574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:50.215209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d8a3802-5ea9-4be9-9306-d471f6d4d180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:50.215821 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d8a3802-5ea9-4be9-9306-d471f6d4d180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:50.217293 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1190/2387] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:50 2022] DELETE /identity/v3/projects/20dcce603a4741dea04a4a6de5a32574 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:50.221430 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f86cc-2ef8-4fb8-aefa-aed5b7c61782 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:50.222833 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1e6f86cc-2ef8-4fb8-aefa-aed5b7c61782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:50.236849 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f86cc-2ef8-4fb8-aefa-aed5b7c61782 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:50.296428 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84092c28-a890-4763-9c6a-b0a1f07cb2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:50.297062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84092c28-a890-4763-9c6a-b0a1f07cb2ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:50.297347 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84092c28-a890-4763-9c6a-b0a1f07cb2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:50.297618 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84092c28-a890-4763-9c6a-b0a1f07cb2ae admin admin] PATH_INFO: `/v3/users/74c85a4872834c8197cb7ec95802a449` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:50.298727 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84092c28-a890-4763-9c6a-b0a1f07cb2ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c85a4872834c8197cb7ec95802a449)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:50.300646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84092c28-a890-4763-9c6a-b0a1f07cb2ae admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:50.346963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-84092c28-a890-4763-9c6a-b0a1f07cb2ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c85a4872834c8197cb7ec95802a449'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:50.355432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-84092c28-a890-4763-9c6a-b0a1f07cb2ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c85a4872834c8197cb7ec95802a449'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:50.356069 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-84092c28-a890-4763-9c6a-b0a1f07cb2ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c85a4872834c8197cb7ec95802a449'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:50.369030 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-84092c28-a890-4763-9c6a-b0a1f07cb2ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c85a4872834c8197cb7ec95802a449'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:50.375885 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-84092c28-a890-4763-9c6a-b0a1f07cb2ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c85a4872834c8197cb7ec95802a449'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:50.382359 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1198/2388] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:10:50 2022] DELETE /identity/v3/users/74c85a4872834c8197cb7ec95802a449 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:50.661551 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a3802-5ea9-4be9-9306-d471f6d4d180 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:50.662984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0d8a3802-5ea9-4be9-9306-d471f6d4d180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:50.675713 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a3802-5ea9-4be9-9306-d471f6d4d180 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:50.757989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66852913-2195-4012-a217-424a2e9f5904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:50.758623 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66852913-2195-4012-a217-424a2e9f5904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:50.758904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66852913-2195-4012-a217-424a2e9f5904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:50.759221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66852913-2195-4012-a217-424a2e9f5904 admin admin] PATH_INFO: `/v3/projects/c0d333e758084914a307ccd00cd5d2b0` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:50.760329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66852913-2195-4012-a217-424a2e9f5904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d333e758084914a307ccd00cd5d2b0)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:50.762259 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66852913-2195-4012-a217-424a2e9f5904 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:50.820044 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-66852913-2195-4012-a217-424a2e9f5904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d333e758084914a307ccd00cd5d2b0', 'request_id': 'req-66852913-2195-4012-a217-424a2e9f5904'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:50.829725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-66852913-2195-4012-a217-424a2e9f5904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d333e758084914a307ccd00cd5d2b0', 'request_id': 'req-66852913-2195-4012-a217-424a2e9f5904'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:50.839011 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-66852913-2195-4012-a217-424a2e9f5904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d333e758084914a307ccd00cd5d2b0', 'request_id': 'req-66852913-2195-4012-a217-424a2e9f5904'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:50.853468 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-66852913-2195-4012-a217-424a2e9f5904 admin admin] The token cache is being invalidate because project c0d333e758084914a307ccd00cd5d2b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:10:50.853758 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-66852913-2195-4012-a217-424a2e9f5904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:50.854377 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-66852913-2195-4012-a217-424a2e9f5904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:10:50.856984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1191/2389] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:10:50 2022] DELETE /identity/v3/projects/c0d333e758084914a307ccd00cd5d2b0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:50.861858 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cf7a2-eb35-4757-976f-0aa11d093168 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:50.862143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cf7a2-eb35-4757-976f-0aa11d093168 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:50.862415 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cf7a2-eb35-4757-976f-0aa11d093168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:50.895758 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e22cf7a2-eb35-4757-976f-0aa11d093168 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:50.896956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e22cf7a2-eb35-4757-976f-0aa11d093168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:50.906826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:50.974551 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1199/2390] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:10:50.983306 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6f00d-e5a5-4947-83a1-68813d714957 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:50.983594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6f00d-e5a5-4947-83a1-68813d714957 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:50.983870 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6f00d-e5a5-4947-83a1-68813d714957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:51.004899 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0fa6f00d-e5a5-4947-83a1-68813d714957 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:51.006090 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0fa6f00d-e5a5-4947-83a1-68813d714957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:51.014149 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1192/2391] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:51.018233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cf7a2-eb35-4757-976f-0aa11d093168 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:51.028387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cf7a2-eb35-4757-976f-0aa11d093168 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:51.033106 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9ef83-740d-4ec0-8b32-e9a572a53eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:51.033697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9ef83-740d-4ec0-8b32-e9a572a53eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:51.033970 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9ef83-740d-4ec0-8b32-e9a572a53eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:51.034234 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9ef83-740d-4ec0-8b32-e9a572a53eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:51.034874 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9ef83-740d-4ec0-8b32-e9a572a53eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:10:51.035204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9ef83-740d-4ec0-8b32-e9a572a53eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:51.037035 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9ef83-740d-4ec0-8b32-e9a572a53eb4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:51.048531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1200/2392] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:10:51.053183 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6f00d-e5a5-4947-83a1-68813d714957 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:51.063070 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6f00d-e5a5-4947-83a1-68813d714957 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:51.070000 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54382bbc-6c58-42b7-9944-40ff35dced83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:51.070600 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54382bbc-6c58-42b7-9944-40ff35dced83 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:51.070877 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54382bbc-6c58-42b7-9944-40ff35dced83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:51.071183 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54382bbc-6c58-42b7-9944-40ff35dced83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:51.071807 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54382bbc-6c58-42b7-9944-40ff35dced83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:51.073936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54382bbc-6c58-42b7-9944-40ff35dced83 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:51.108885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1193/2393] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:10:51 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:51.111295 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9ef83-740d-4ec0-8b32-e9a572a53eb4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:51.122528 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9ef83-740d-4ec0-8b32-e9a572a53eb4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:51.182904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680223ae-a7a9-46e8-a466-0e138b78327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:51.183656 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680223ae-a7a9-46e8-a466-0e138b78327b admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:51.183935 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680223ae-a7a9-46e8-a466-0e138b78327b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:51.184209 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680223ae-a7a9-46e8-a466-0e138b78327b admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:51.184838 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680223ae-a7a9-46e8-a466-0e138b78327b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:51.186731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680223ae-a7a9-46e8-a466-0e138b78327b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:51.210408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1201/2394] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:10:51 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:10:51.214662 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54382bbc-6c58-42b7-9944-40ff35dced83 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:51.225473 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54382bbc-6c58-42b7-9944-40ff35dced83 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:51.231169 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37333f-820a-469c-8ae1-3aa412673577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:51.231762 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37333f-820a-469c-8ae1-3aa412673577 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:51.232041 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37333f-820a-469c-8ae1-3aa412673577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:51.232310 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37333f-820a-469c-8ae1-3aa412673577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:51.232953 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37333f-820a-469c-8ae1-3aa412673577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:51.234593 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37333f-820a-469c-8ae1-3aa412673577 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:51.245018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1194/2395] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:51.249038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680223ae-a7a9-46e8-a466-0e138b78327b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:51.259664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680223ae-a7a9-46e8-a466-0e138b78327b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:51.264335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bcf96-f71d-463f-bbcf-2eca7ccb473a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:51.264926 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bcf96-f71d-463f-bbcf-2eca7ccb473a admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:51.265204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bcf96-f71d-463f-bbcf-2eca7ccb473a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:51.265470 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bcf96-f71d-463f-bbcf-2eca7ccb473a admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:51.266101 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bcf96-f71d-463f-bbcf-2eca7ccb473a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:51.267706 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bcf96-f71d-463f-bbcf-2eca7ccb473a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:51.279166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1202/2396] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:10:51.283867 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37333f-820a-469c-8ae1-3aa412673577 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:51.295372 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37333f-820a-469c-8ae1-3aa412673577 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:51.300004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa36504-f765-4294-a091-52d415ad4ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:51.307914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa36504-f765-4294-a091-52d415ad4ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:51.308267 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa36504-f765-4294-a091-52d415ad4ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:51.308664 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa36504-f765-4294-a091-52d415ad4ba0 admin admin] PATH_INFO: `/v3/projects/70959808dd434e03b1268281d320d8e2/users/433bcb6a2aa2437e96d74c20f58c88bd/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:51.311410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:51.453723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa36504-f765-4294-a091-52d415ad4ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70959808dd434e03b1268281d320d8e2, user_id=433bcb6a2aa2437e96d74c20f58c88bd, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:51.456390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa36504-f765-4294-a091-52d415ad4ba0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:51.468645 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1195/2397] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:10:51 2022] PUT /identity/v3/projects/70959808dd434e03b1268281d320d8e2/users/433bcb6a2aa2437e96d74c20f58c88bd/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:10:51.474185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f6b26-d1cd-4520-b791-61e443a86916 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:51.474768 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f6b26-d1cd-4520-b791-61e443a86916 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:51.475048 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f6b26-d1cd-4520-b791-61e443a86916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:51.494650 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9e5f6b26-d1cd-4520-b791-61e443a86916 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:51.495876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9e5f6b26-d1cd-4520-b791-61e443a86916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:51.556090 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1203/2398] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:51.567670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa36504-f765-4294-a091-52d415ad4ba0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:51.569421 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8fa36504-f765-4294-a091-52d415ad4ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:51.629897 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa36504-f765-4294-a091-52d415ad4ba0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:51.634617 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13021345-0122-4ca9-b81a-1bbdfcd6ef17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:51.635487 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13021345-0122-4ca9-b81a-1bbdfcd6ef17 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:51.635614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13021345-0122-4ca9-b81a-1bbdfcd6ef17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:51.635786 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13021345-0122-4ca9-b81a-1bbdfcd6ef17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:51.645621 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13021345-0122-4ca9-b81a-1bbdfcd6ef17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:51.647037 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13021345-0122-4ca9-b81a-1bbdfcd6ef17 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:51.656191 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1196/2399] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:10:52.410650 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43217b58-2eca-438a-bdbb-e66c12ccb087 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:52.411499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43217b58-2eca-438a-bdbb-e66c12ccb087 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:52.411499 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43217b58-2eca-438a-bdbb-e66c12ccb087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:52.444389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-43217b58-2eca-438a-bdbb-e66c12ccb087 None None] MFA Rules not processed for user `433bcb6a2aa2437e96d74c20f58c88bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:52.445748 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-43217b58-2eca-438a-bdbb-e66c12ccb087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:52.457901 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:52.544556 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1204/2400] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:10:52.556448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13021345-0122-4ca9-b81a-1bbdfcd6ef17 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:10:52.557899 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-13021345-0122-4ca9-b81a-1bbdfcd6ef17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:52.638675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13021345-0122-4ca9-b81a-1bbdfcd6ef17 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:10:52.642212 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158f705-54a4-4299-bd12-2db2465dd780 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:10:52.642965 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158f705-54a4-4299-bd12-2db2465dd780 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:52.643278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158f705-54a4-4299-bd12-2db2465dd780 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:52.643808 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158f705-54a4-4299-bd12-2db2465dd780 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:52.653055 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158f705-54a4-4299-bd12-2db2465dd780 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:10:52.654559 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158f705-54a4-4299-bd12-2db2465dd780 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:10:52.669860 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1197/2401] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:10:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:10:55.143401 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab962bb4-2e91-43e7-9934-170fac3771d1 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:10:55.143876 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab962bb4-2e91-43e7-9934-170fac3771d1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:10:55.143986 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab962bb4-2e91-43e7-9934-170fac3771d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:10:55.163637 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ab962bb4-2e91-43e7-9934-170fac3771d1 None None] MFA Rules not processed for user `433bcb6a2aa2437e96d74c20f58c88bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:10:55.164824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ab962bb4-2e91-43e7-9934-170fac3771d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:10:55.171804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1205/2402] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:10:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:11:02.659344 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=59,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:05.157473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=25 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:21.654885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36148da5-de78-4d86-92b1-4366bae9cdb8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:21.655494 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36148da5-de78-4d86-92b1-4366bae9cdb8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:21.655494 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36148da5-de78-4d86-92b1-4366bae9cdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:21.676719 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-36148da5-de78-4d86-92b1-4366bae9cdb8 None None] MFA Rules not processed for user `433bcb6a2aa2437e96d74c20f58c88bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:11:21.677901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-36148da5-de78-4d86-92b1-4366bae9cdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:21.685691 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1198/2403] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:11:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:11:24.872276 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d77370-5921-4983-8d62-bb1e4bd4256e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:24.872815 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d77370-5921-4983-8d62-bb1e4bd4256e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:24.872914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d77370-5921-4983-8d62-bb1e4bd4256e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:24.892344 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a4d77370-5921-4983-8d62-bb1e4bd4256e None None] MFA Rules not processed for user `86b1015b309e4b06b21269892fbc8287`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:11:24.893541 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a4d77370-5921-4983-8d62-bb1e4bd4256e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:24.952200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1206/2404] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:11:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:11:25.942398 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36148da5-de78-4d86-92b1-4366bae9cdb8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:25.943977 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-36148da5-de78-4d86-92b1-4366bae9cdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:25.961092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36148da5-de78-4d86-92b1-4366bae9cdb8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:25.968713 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9aa44-0fc9-41c9-81ed-80dfd63c6e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:25.969653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9aa44-0fc9-41c9-81ed-80dfd63c6e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:25.970085 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9aa44-0fc9-41c9-81ed-80dfd63c6e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:25.970680 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9aa44-0fc9-41c9-81ed-80dfd63c6e04 admin admin] PATH_INFO: `/v3/users/689bb85821fd4564896a1e32edc78a19` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:25.972753 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9aa44-0fc9-41c9-81ed-80dfd63c6e04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=689bb85821fd4564896a1e32edc78a19)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:25.975184 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9aa44-0fc9-41c9-81ed-80dfd63c6e04 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:26.052327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5ec9aa44-0fc9-41c9-81ed-80dfd63c6e04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '689bb85821fd4564896a1e32edc78a19'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:26.053279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5ec9aa44-0fc9-41c9-81ed-80dfd63c6e04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '689bb85821fd4564896a1e32edc78a19'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:26.054639 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5ec9aa44-0fc9-41c9-81ed-80dfd63c6e04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '689bb85821fd4564896a1e32edc78a19'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:26.063444 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5ec9aa44-0fc9-41c9-81ed-80dfd63c6e04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '689bb85821fd4564896a1e32edc78a19'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:26.072864 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5ec9aa44-0fc9-41c9-81ed-80dfd63c6e04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '689bb85821fd4564896a1e32edc78a19'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:26.102015 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1199/2405] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:11:25 2022] DELETE /identity/v3/users/689bb85821fd4564896a1e32edc78a19 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:11:26.104023 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c0ba0-7d89-493e-93c2-fcd8016e2c84 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:26.104518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c0ba0-7d89-493e-93c2-fcd8016e2c84 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:26.104612 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c0ba0-7d89-493e-93c2-fcd8016e2c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:26.125995 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-658c0ba0-7d89-493e-93c2-fcd8016e2c84 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:11:26.127716 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-658c0ba0-7d89-493e-93c2-fcd8016e2c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:26.195114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1207/2406] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:11:26.203322 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9aa44-0fc9-41c9-81ed-80dfd63c6e04 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:26.204678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5ec9aa44-0fc9-41c9-81ed-80dfd63c6e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:26.262705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9aa44-0fc9-41c9-81ed-80dfd63c6e04 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:26.266320 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af5790-9ed1-4403-84b6-9deb84200f8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:26.266912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af5790-9ed1-4403-84b6-9deb84200f8e service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:26.267210 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af5790-9ed1-4403-84b6-9deb84200f8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:26.267474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af5790-9ed1-4403-84b6-9deb84200f8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:26.276110 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af5790-9ed1-4403-84b6-9deb84200f8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:26.278245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af5790-9ed1-4403-84b6-9deb84200f8e service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:26.287312 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1200/2407] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:11:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:11:26.664198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c0ba0-7d89-493e-93c2-fcd8016e2c84 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:26.665600 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-658c0ba0-7d89-493e-93c2-fcd8016e2c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:26.679294 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c0ba0-7d89-493e-93c2-fcd8016e2c84 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:26.686760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487ceb0-cd6d-401d-b14b-d64622a44d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:26.687764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487ceb0-cd6d-401d-b14b-d64622a44d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:26.688831 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487ceb0-cd6d-401d-b14b-d64622a44d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:26.689272 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487ceb0-cd6d-401d-b14b-d64622a44d9b admin admin] PATH_INFO: `/v3/projects/c6b89be3899d47f8a2113070c19785ee` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:26.690925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487ceb0-cd6d-401d-b14b-d64622a44d9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b89be3899d47f8a2113070c19785ee)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:26.693003 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487ceb0-cd6d-401d-b14b-d64622a44d9b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:26.758518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2487ceb0-cd6d-401d-b14b-d64622a44d9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b89be3899d47f8a2113070c19785ee', 'request_id': 'req-2487ceb0-cd6d-401d-b14b-d64622a44d9b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:26.765001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2487ceb0-cd6d-401d-b14b-d64622a44d9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b89be3899d47f8a2113070c19785ee', 'request_id': 'req-2487ceb0-cd6d-401d-b14b-d64622a44d9b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:26.771486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2487ceb0-cd6d-401d-b14b-d64622a44d9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b89be3899d47f8a2113070c19785ee', 'request_id': 'req-2487ceb0-cd6d-401d-b14b-d64622a44d9b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:26.785919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2487ceb0-cd6d-401d-b14b-d64622a44d9b admin admin] The token cache is being invalidate because project c6b89be3899d47f8a2113070c19785ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:11:26.786215 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2487ceb0-cd6d-401d-b14b-d64622a44d9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:26.786838 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2487ceb0-cd6d-401d-b14b-d64622a44d9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:26.791745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1208/2408] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:11:26 2022] DELETE /identity/v3/projects/c6b89be3899d47f8a2113070c19785ee => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:11:26.793743 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5046c8f-89d0-4678-9626-9f9af01d4a54 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:26.794025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5046c8f-89d0-4678-9626-9f9af01d4a54 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:26.794281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5046c8f-89d0-4678-9626-9f9af01d4a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:26.825351 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b5046c8f-89d0-4678-9626-9f9af01d4a54 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:11:26.826579 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b5046c8f-89d0-4678-9626-9f9af01d4a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:26.902670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1201/2409] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:11:26.910559 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f21cbd-7bd9-45b7-99e3-c5306d4c0364 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:26.910918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f21cbd-7bd9-45b7-99e3-c5306d4c0364 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:26.912503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f21cbd-7bd9-45b7-99e3-c5306d4c0364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:26.953549 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-63f21cbd-7bd9-45b7-99e3-c5306d4c0364 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:11:26.954807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-63f21cbd-7bd9-45b7-99e3-c5306d4c0364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:26.962851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1209/2410] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:11:26.967479 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5046c8f-89d0-4678-9626-9f9af01d4a54 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:26.978280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5046c8f-89d0-4678-9626-9f9af01d4a54 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:26.984258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffecd74-2c75-479f-b73a-523ad1e47596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:26.985060 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffecd74-2c75-479f-b73a-523ad1e47596 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:26.985550 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffecd74-2c75-479f-b73a-523ad1e47596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:26.986029 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffecd74-2c75-479f-b73a-523ad1e47596 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:26.987136 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffecd74-2c75-479f-b73a-523ad1e47596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:11:26.987647 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffecd74-2c75-479f-b73a-523ad1e47596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:26.989425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffecd74-2c75-479f-b73a-523ad1e47596 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:26.992341 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:27.009585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1202/2411] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:11:27.010490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f21cbd-7bd9-45b7-99e3-c5306d4c0364 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:27.021687 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f21cbd-7bd9-45b7-99e3-c5306d4c0364 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:27.027751 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c81b4d-2e04-462a-9036-e5affb5193d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:27.028300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c81b4d-2e04-462a-9036-e5affb5193d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:27.028573 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c81b4d-2e04-462a-9036-e5affb5193d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:27.028844 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c81b4d-2e04-462a-9036-e5affb5193d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:27.029475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c81b4d-2e04-462a-9036-e5affb5193d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:27.031657 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c81b4d-2e04-462a-9036-e5affb5193d6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:27.059830 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:27.070428 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1210/2412] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:11:27 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:11:27.074286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffecd74-2c75-479f-b73a-523ad1e47596 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:27.084682 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffecd74-2c75-479f-b73a-523ad1e47596 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:27.156738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9abea-daed-4440-a7ca-c9c8fb3b4a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:27.157540 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9abea-daed-4440-a7ca-c9c8fb3b4a6e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:27.157821 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9abea-daed-4440-a7ca-c9c8fb3b4a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:27.158064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9abea-daed-4440-a7ca-c9c8fb3b4a6e admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:27.158794 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9abea-daed-4440-a7ca-c9c8fb3b4a6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:27.161120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9abea-daed-4440-a7ca-c9c8fb3b4a6e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:27.183791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1203/2413] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:11:27 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:11:27.187905 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c81b4d-2e04-462a-9036-e5affb5193d6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:27.212580 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c81b4d-2e04-462a-9036-e5affb5193d6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:27.227072 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3338e02-e837-4545-92d2-72f660770b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:27.227998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3338e02-e837-4545-92d2-72f660770b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:27.228642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3338e02-e837-4545-92d2-72f660770b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:27.229055 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3338e02-e837-4545-92d2-72f660770b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:27.229904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3338e02-e837-4545-92d2-72f660770b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:27.231789 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3338e02-e837-4545-92d2-72f660770b32 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:27.248888 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1211/2414] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:11:27.252709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9abea-daed-4440-a7ca-c9c8fb3b4a6e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:27.266659 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9abea-daed-4440-a7ca-c9c8fb3b4a6e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:27.275042 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698f5c0-2192-4c07-8628-7fbaa294a811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:27.276012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698f5c0-2192-4c07-8628-7fbaa294a811 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:27.276502 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698f5c0-2192-4c07-8628-7fbaa294a811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:27.277085 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698f5c0-2192-4c07-8628-7fbaa294a811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:27.279326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698f5c0-2192-4c07-8628-7fbaa294a811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:27.285508 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698f5c0-2192-4c07-8628-7fbaa294a811 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:27.303906 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1204/2415] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:11:27.305389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3338e02-e837-4545-92d2-72f660770b32 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:27.317385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3338e02-e837-4545-92d2-72f660770b32 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:27.322932 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c5820-3a7b-45bf-9733-4461afe9bdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:27.325155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c5820-3a7b-45bf-9733-4461afe9bdae admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:27.325735 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c5820-3a7b-45bf-9733-4461afe9bdae admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:27.326181 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c5820-3a7b-45bf-9733-4461afe9bdae admin admin] PATH_INFO: `/v3/projects/3a207211bb424927b4da74b46c9a57c9/users/c16f053cb2904919a7922a5ab304a5d2/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:27.344143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c5820-3a7b-45bf-9733-4461afe9bdae admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a207211bb424927b4da74b46c9a57c9, user_id=c16f053cb2904919a7922a5ab304a5d2, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:27.348609 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c5820-3a7b-45bf-9733-4461afe9bdae admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:27.366153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1212/2416] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:11:27 2022] PUT /identity/v3/projects/3a207211bb424927b4da74b46c9a57c9/users/c16f053cb2904919a7922a5ab304a5d2/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:11:27.379380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b15129-6ffa-434d-947b-b06278a3fb26 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:27.379922 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b15129-6ffa-434d-947b-b06278a3fb26 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:27.380352 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b15129-6ffa-434d-947b-b06278a3fb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:27.445782 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f3b15129-6ffa-434d-947b-b06278a3fb26 None None] MFA Rules not processed for user `c16f053cb2904919a7922a5ab304a5d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:11:27.447001 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f3b15129-6ffa-434d-947b-b06278a3fb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:27.515113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1205/2417] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:11:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:11:27.525518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c5820-3a7b-45bf-9733-4461afe9bdae admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:27.527435 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1d5c5820-3a7b-45bf-9733-4461afe9bdae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:27.588479 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c5820-3a7b-45bf-9733-4461afe9bdae admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:27.592248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555112f0-205e-4f67-9813-6c60115360c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:27.592848 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555112f0-205e-4f67-9813-6c60115360c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:27.593119 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555112f0-205e-4f67-9813-6c60115360c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:27.593386 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555112f0-205e-4f67-9813-6c60115360c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:27.602665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555112f0-205e-4f67-9813-6c60115360c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:27.604140 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555112f0-205e-4f67-9813-6c60115360c8 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:27.614828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1213/2418] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:11:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:11:30.501092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc46a69-7388-4128-b57a-81a77c9ed996 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:30.501684 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc46a69-7388-4128-b57a-81a77c9ed996 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:30.501684 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc46a69-7388-4128-b57a-81a77c9ed996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:30.522478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4fc46a69-7388-4128-b57a-81a77c9ed996 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:11:30.524168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4fc46a69-7388-4128-b57a-81a77c9ed996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:30.623702 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1206/2419] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Aug 9 07:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:11:30.750104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555112f0-205e-4f67-9813-6c60115360c8 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:30.751646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-555112f0-205e-4f67-9813-6c60115360c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:30.835792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555112f0-205e-4f67-9813-6c60115360c8 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:30.842110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb41cf1-545d-44d9-a570-910546337f4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:30.842715 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb41cf1-545d-44d9-a570-910546337f4f service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:30.842995 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb41cf1-545d-44d9-a570-910546337f4f service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:30.843298 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb41cf1-545d-44d9-a570-910546337f4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:30.851794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb41cf1-545d-44d9-a570-910546337f4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:30.853405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb41cf1-545d-44d9-a570-910546337f4f service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:30.863417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1214/2420] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:11:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:11:33.421943 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc46a69-7388-4128-b57a-81a77c9ed996 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:33.424849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4fc46a69-7388-4128-b57a-81a77c9ed996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:33.450880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:33.456049 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc46a69-7388-4128-b57a-81a77c9ed996 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:33.472204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c9e31-562b-4e6e-8cde-60304233b034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:33.473938 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c9e31-562b-4e6e-8cde-60304233b034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:33.474541 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c9e31-562b-4e6e-8cde-60304233b034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:33.475066 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c9e31-562b-4e6e-8cde-60304233b034 admin admin] PATH_INFO: `/v3/users/25aac7a67fd640098a051e4143b94c4f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:33.476630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c9e31-562b-4e6e-8cde-60304233b034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25aac7a67fd640098a051e4143b94c4f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:33.479153 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c9e31-562b-4e6e-8cde-60304233b034 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:33.548277 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-103c9e31-562b-4e6e-8cde-60304233b034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25aac7a67fd640098a051e4143b94c4f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:33.548979 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-103c9e31-562b-4e6e-8cde-60304233b034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25aac7a67fd640098a051e4143b94c4f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:33.549765 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-103c9e31-562b-4e6e-8cde-60304233b034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25aac7a67fd640098a051e4143b94c4f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:33.560343 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-103c9e31-562b-4e6e-8cde-60304233b034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25aac7a67fd640098a051e4143b94c4f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:33.569311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-103c9e31-562b-4e6e-8cde-60304233b034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25aac7a67fd640098a051e4143b94c4f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:33.592050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1207/2421] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:11:33 2022] DELETE /identity/v3/users/25aac7a67fd640098a051e4143b94c4f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:11:33.596472 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49322617-f74d-4c7d-8936-61877bd632b6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:33.596951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49322617-f74d-4c7d-8936-61877bd632b6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:33.597043 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49322617-f74d-4c7d-8936-61877bd632b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:33.624350 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-49322617-f74d-4c7d-8936-61877bd632b6 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:11:33.625629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-49322617-f74d-4c7d-8936-61877bd632b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:33.679791 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:33.695281 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1215/2422] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:11:33.707586 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c9e31-562b-4e6e-8cde-60304233b034 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:33.709001 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-103c9e31-562b-4e6e-8cde-60304233b034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:33.769815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c9e31-562b-4e6e-8cde-60304233b034 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:33.773554 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2893c6d-9540-4a78-9bb5-28388d9eeab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:33.774157 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2893c6d-9540-4a78-9bb5-28388d9eeab8 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:33.774431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2893c6d-9540-4a78-9bb5-28388d9eeab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:33.774697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2893c6d-9540-4a78-9bb5-28388d9eeab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:33.784764 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2893c6d-9540-4a78-9bb5-28388d9eeab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:33.786249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2893c6d-9540-4a78-9bb5-28388d9eeab8 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:33.795849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1208/2423] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:11:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:11:34.084896 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49322617-f74d-4c7d-8936-61877bd632b6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:34.086828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-49322617-f74d-4c7d-8936-61877bd632b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:34.102142 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49322617-f74d-4c7d-8936-61877bd632b6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:34.108726 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a0d28-6e8c-4b87-b4e7-e328b8fc2df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:34.109387 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a0d28-6e8c-4b87-b4e7-e328b8fc2df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:34.109665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a0d28-6e8c-4b87-b4e7-e328b8fc2df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:34.109937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a0d28-6e8c-4b87-b4e7-e328b8fc2df9 admin admin] PATH_INFO: `/v3/projects/4c1d7cc785c0459984089186e1be3a6f` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:34.111185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a0d28-6e8c-4b87-b4e7-e328b8fc2df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1d7cc785c0459984089186e1be3a6f)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:34.113147 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a0d28-6e8c-4b87-b4e7-e328b8fc2df9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:34.170328 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e44a0d28-6e8c-4b87-b4e7-e328b8fc2df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1d7cc785c0459984089186e1be3a6f', 'request_id': 'req-e44a0d28-6e8c-4b87-b4e7-e328b8fc2df9'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:34.176051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e44a0d28-6e8c-4b87-b4e7-e328b8fc2df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1d7cc785c0459984089186e1be3a6f', 'request_id': 'req-e44a0d28-6e8c-4b87-b4e7-e328b8fc2df9'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:34.182411 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e44a0d28-6e8c-4b87-b4e7-e328b8fc2df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1d7cc785c0459984089186e1be3a6f', 'request_id': 'req-e44a0d28-6e8c-4b87-b4e7-e328b8fc2df9'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:34.197339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e44a0d28-6e8c-4b87-b4e7-e328b8fc2df9 admin admin] The token cache is being invalidate because project 4c1d7cc785c0459984089186e1be3a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:11:34.197544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e44a0d28-6e8c-4b87-b4e7-e328b8fc2df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:34.198336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e44a0d28-6e8c-4b87-b4e7-e328b8fc2df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:34.206778 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1216/2424] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:11:34 2022] DELETE /identity/v3/projects/4c1d7cc785c0459984089186e1be3a6f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:11:38.212479 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2893c6d-9540-4a78-9bb5-28388d9eeab8 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:38.214146 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c2893c6d-9540-4a78-9bb5-28388d9eeab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:38.225835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2893c6d-9540-4a78-9bb5-28388d9eeab8 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:38.301975 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62180c-9e39-45e5-960c-06d807e017c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:38.302813 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62180c-9e39-45e5-960c-06d807e017c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:38.303227 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62180c-9e39-45e5-960c-06d807e017c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:38.303615 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62180c-9e39-45e5-960c-06d807e017c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:38.305632 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3e62180c-9e39-45e5-960c-06d807e017c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:38.339647 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a0d28-6e8c-4b87-b4e7-e328b8fc2df9 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:38.342039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e44a0d28-6e8c-4b87-b4e7-e328b8fc2df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:38.346266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:38.387901 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62180c-9e39-45e5-960c-06d807e017c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:38.389678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62180c-9e39-45e5-960c-06d807e017c4 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:38.399599 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1209/2425] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:11:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:11:38.422643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a0d28-6e8c-4b87-b4e7-e328b8fc2df9 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:38.427287 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e1885-c4dd-4923-8416-6b47ee2cc034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:38.427916 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e1885-c4dd-4923-8416-6b47ee2cc034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:38.428191 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e1885-c4dd-4923-8416-6b47ee2cc034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:38.428459 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e1885-c4dd-4923-8416-6b47ee2cc034 admin admin] PATH_INFO: `/v3/users/c16f053cb2904919a7922a5ab304a5d2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:38.429578 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e1885-c4dd-4923-8416-6b47ee2cc034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16f053cb2904919a7922a5ab304a5d2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:38.431517 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e1885-c4dd-4923-8416-6b47ee2cc034 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:38.482055 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-932e1885-c4dd-4923-8416-6b47ee2cc034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16f053cb2904919a7922a5ab304a5d2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:38.491011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-932e1885-c4dd-4923-8416-6b47ee2cc034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16f053cb2904919a7922a5ab304a5d2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:38.491956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-932e1885-c4dd-4923-8416-6b47ee2cc034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16f053cb2904919a7922a5ab304a5d2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:38.510798 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-932e1885-c4dd-4923-8416-6b47ee2cc034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16f053cb2904919a7922a5ab304a5d2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:38.519314 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:38.520453 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-932e1885-c4dd-4923-8416-6b47ee2cc034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16f053cb2904919a7922a5ab304a5d2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:38.532391 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1217/2426] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:11:38 2022] DELETE /identity/v3/users/c16f053cb2904919a7922a5ab304a5d2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:11:38.536676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc340b-1905-406a-8fa5-8a7806fa0544 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:38.536895 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc340b-1905-406a-8fa5-8a7806fa0544 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:38.537147 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc340b-1905-406a-8fa5-8a7806fa0544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:38.565945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-40bc340b-1905-406a-8fa5-8a7806fa0544 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:11:38.569181 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-40bc340b-1905-406a-8fa5-8a7806fa0544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:38.675245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1210/2427] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:11:38.688076 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e1885-c4dd-4923-8416-6b47ee2cc034 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:38.689688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-932e1885-c4dd-4923-8416-6b47ee2cc034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:38.758355 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e1885-c4dd-4923-8416-6b47ee2cc034 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:38.762796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15d024-3ec5-4b9e-87ac-a60b13635d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:38.764986 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15d024-3ec5-4b9e-87ac-a60b13635d3f service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:38.765703 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15d024-3ec5-4b9e-87ac-a60b13635d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:38.765985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15d024-3ec5-4b9e-87ac-a60b13635d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:38.778795 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15d024-3ec5-4b9e-87ac-a60b13635d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:38.780283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15d024-3ec5-4b9e-87ac-a60b13635d3f service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:38.792717 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1218/2428] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:11:39.209599 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc340b-1905-406a-8fa5-8a7806fa0544 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:39.211540 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-40bc340b-1905-406a-8fa5-8a7806fa0544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:39.224294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc340b-1905-406a-8fa5-8a7806fa0544 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:39.230150 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59af2fa-101a-4c6b-91df-793e0d5c55c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:39.231532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59af2fa-101a-4c6b-91df-793e0d5c55c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:39.231653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59af2fa-101a-4c6b-91df-793e0d5c55c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:39.231972 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59af2fa-101a-4c6b-91df-793e0d5c55c6 admin admin] PATH_INFO: `/v3/projects/3a207211bb424927b4da74b46c9a57c9` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:39.233210 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59af2fa-101a-4c6b-91df-793e0d5c55c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a207211bb424927b4da74b46c9a57c9)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:39.235712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59af2fa-101a-4c6b-91df-793e0d5c55c6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:39.310212 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a59af2fa-101a-4c6b-91df-793e0d5c55c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a207211bb424927b4da74b46c9a57c9', 'request_id': 'req-a59af2fa-101a-4c6b-91df-793e0d5c55c6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:39.316875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a59af2fa-101a-4c6b-91df-793e0d5c55c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a207211bb424927b4da74b46c9a57c9', 'request_id': 'req-a59af2fa-101a-4c6b-91df-793e0d5c55c6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:39.322838 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a59af2fa-101a-4c6b-91df-793e0d5c55c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a207211bb424927b4da74b46c9a57c9', 'request_id': 'req-a59af2fa-101a-4c6b-91df-793e0d5c55c6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:39.338600 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a59af2fa-101a-4c6b-91df-793e0d5c55c6 admin admin] The token cache is being invalidate because project 3a207211bb424927b4da74b46c9a57c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:11:39.339638 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a59af2fa-101a-4c6b-91df-793e0d5c55c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:39.340297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a59af2fa-101a-4c6b-91df-793e0d5c55c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:39.341787 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1211/2429] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:11:39 2022] DELETE /identity/v3/projects/3a207211bb424927b4da74b46c9a57c9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:11:39.346789 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c5406-a72b-45bb-940c-5b4912b979ea None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:39.347329 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c5406-a72b-45bb-940c-5b4912b979ea None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:39.347618 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c5406-a72b-45bb-940c-5b4912b979ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:39.371960 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ba0c5406-a72b-45bb-940c-5b4912b979ea None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:11:39.373522 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ba0c5406-a72b-45bb-940c-5b4912b979ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:39.480130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1219/2430] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:11:39.482458 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acff6b-e9ba-484a-a2bd-4e6a3bacbb61 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:39.482916 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acff6b-e9ba-484a-a2bd-4e6a3bacbb61 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:39.483215 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acff6b-e9ba-484a-a2bd-4e6a3bacbb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:39.509342 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-89acff6b-e9ba-484a-a2bd-4e6a3bacbb61 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:11:39.510621 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-89acff6b-e9ba-484a-a2bd-4e6a3bacbb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:39.526090 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c5406-a72b-45bb-940c-5b4912b979ea None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:39.533534 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1212/2431] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:11:39.537784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c5406-a72b-45bb-940c-5b4912b979ea None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:39.543340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e33de3-608d-4816-aae8-388985ec1feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:39.544118 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e33de3-608d-4816-aae8-388985ec1feb admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:39.544394 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e33de3-608d-4816-aae8-388985ec1feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:39.544667 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e33de3-608d-4816-aae8-388985ec1feb admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:39.545315 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e33de3-608d-4816-aae8-388985ec1feb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:11:39.545615 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e33de3-608d-4816-aae8-388985ec1feb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:39.547299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e33de3-608d-4816-aae8-388985ec1feb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:39.563149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1220/2432] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:11:39.566777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acff6b-e9ba-484a-a2bd-4e6a3bacbb61 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:39.576566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acff6b-e9ba-484a-a2bd-4e6a3bacbb61 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:39.581486 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02239f-75b5-4bb0-a85d-f7efc560e68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:39.582176 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02239f-75b5-4bb0-a85d-f7efc560e68a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:39.582510 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02239f-75b5-4bb0-a85d-f7efc560e68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:39.582939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02239f-75b5-4bb0-a85d-f7efc560e68a admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:39.583939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02239f-75b5-4bb0-a85d-f7efc560e68a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:39.585665 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02239f-75b5-4bb0-a85d-f7efc560e68a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:39.626074 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1213/2433] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:11:39 2022] POST /identity/v3/projects => generated 397 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:11:39.631779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e33de3-608d-4816-aae8-388985ec1feb admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:39.642656 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e33de3-608d-4816-aae8-388985ec1feb admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:39.682191 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dbe21-6343-4100-a5ae-f6eafa47e4c1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:39.683185 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dbe21-6343-4100-a5ae-f6eafa47e4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:39.684218 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dbe21-6343-4100-a5ae-f6eafa47e4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:39.704322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b77b3c-2d27-4213-91a7-f4648f45731d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:39.704947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b77b3c-2d27-4213-91a7-f4648f45731d admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:39.705248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b77b3c-2d27-4213-91a7-f4648f45731d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:39.705486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b77b3c-2d27-4213-91a7-f4648f45731d admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:39.705763 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d48dbe21-6343-4100-a5ae-f6eafa47e4c1 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:11:39.706104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b77b3c-2d27-4213-91a7-f4648f45731d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:39.706971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d48dbe21-6343-4100-a5ae-f6eafa47e4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:39.708066 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b77b3c-2d27-4213-91a7-f4648f45731d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:39.715597 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1214/2434] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Aug 9 07:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:11:39.735100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1221/2435] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:11:39 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:11:39.736187 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dbe21-6343-4100-a5ae-f6eafa47e4c1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:39.746001 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dbe21-6343-4100-a5ae-f6eafa47e4c1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:39.750993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7bf15-3d8e-4d5b-b1ea-c687f4a8ad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:39.751614 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7bf15-3d8e-4d5b-b1ea-c687f4a8ad47 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:39.751883 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7bf15-3d8e-4d5b-b1ea-c687f4a8ad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:39.752154 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7bf15-3d8e-4d5b-b1ea-c687f4a8ad47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:39.752269 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b77b3c-2d27-4213-91a7-f4648f45731d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:39.752798 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7bf15-3d8e-4d5b-b1ea-c687f4a8ad47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:39.754313 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-83b77b3c-2d27-4213-91a7-f4648f45731d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:39.754435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7bf15-3d8e-4d5b-b1ea-c687f4a8ad47 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:39.768377 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1215/2436] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:11:39.770247 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7bf15-3d8e-4d5b-b1ea-c687f4a8ad47 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:39.780699 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:39.783263 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7bf15-3d8e-4d5b-b1ea-c687f4a8ad47 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:39.788221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35562f-6866-40d8-aedd-14519a70e115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:39.788811 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35562f-6866-40d8-aedd-14519a70e115 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:39.789084 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35562f-6866-40d8-aedd-14519a70e115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:39.789350 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35562f-6866-40d8-aedd-14519a70e115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:39.790000 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35562f-6866-40d8-aedd-14519a70e115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:39.791820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35562f-6866-40d8-aedd-14519a70e115 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:39.793532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:39.808912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1216/2437] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:11:39.813257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35562f-6866-40d8-aedd-14519a70e115 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:39.826089 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35562f-6866-40d8-aedd-14519a70e115 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:39.831059 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b363a8-5988-445e-b21b-9d4674bda3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:39.831745 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b363a8-5988-445e-b21b-9d4674bda3d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:39.832055 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b363a8-5988-445e-b21b-9d4674bda3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:39.832294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b363a8-5988-445e-b21b-9d4674bda3d1 admin admin] PATH_INFO: `/v3/projects/a03890803cc647938f7e7239161bf6ec/users/280048431aa448f0931f46b06ff60018/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:39.850423 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b363a8-5988-445e-b21b-9d4674bda3d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a03890803cc647938f7e7239161bf6ec, user_id=280048431aa448f0931f46b06ff60018, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:39.853901 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b77b3c-2d27-4213-91a7-f4648f45731d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:39.855017 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b363a8-5988-445e-b21b-9d4674bda3d1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:39.861121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f88507-e327-473f-ad9f-d7508b9b1e6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:39.861851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f88507-e327-473f-ad9f-d7508b9b1e6c service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:39.862131 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f88507-e327-473f-ad9f-d7508b9b1e6c service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:39.862524 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f88507-e327-473f-ad9f-d7508b9b1e6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:39.871401 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1217/2438] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:11:39 2022] PUT /identity/v3/projects/a03890803cc647938f7e7239161bf6ec/users/280048431aa448f0931f46b06ff60018/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:11:39.872283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f88507-e327-473f-ad9f-d7508b9b1e6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:39.873860 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f88507-e327-473f-ad9f-d7508b9b1e6c service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:39.882846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a9bc6-6d58-417a-9c72-604903f7b8ff None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:39.883158 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a9bc6-6d58-417a-9c72-604903f7b8ff None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:39.883438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a9bc6-6d58-417a-9c72-604903f7b8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:39.884000 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1222/2439] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:11:39.916852 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-094a9bc6-6d58-417a-9c72-604903f7b8ff None None] MFA Rules not processed for user `280048431aa448f0931f46b06ff60018`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:11:39.918622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-094a9bc6-6d58-417a-9c72-604903f7b8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:39.984591 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1218/2440] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:11:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:11:39.996685 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f88507-e327-473f-ad9f-d7508b9b1e6c service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:39.998132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b7f88507-e327-473f-ad9f-d7508b9b1e6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:40.060111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f88507-e327-473f-ad9f-d7508b9b1e6c service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:40.108995 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30474bb4-1f34-42b4-8f0f-bce92643d9fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:40.109599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30474bb4-1f34-42b4-8f0f-bce92643d9fb service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:40.109880 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30474bb4-1f34-42b4-8f0f-bce92643d9fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:40.110154 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30474bb4-1f34-42b4-8f0f-bce92643d9fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:40.118631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30474bb4-1f34-42b4-8f0f-bce92643d9fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:40.120754 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30474bb4-1f34-42b4-8f0f-bce92643d9fb service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:40.130000 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1223/2441] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:11:39 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:11:45.269611 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a9bc6-6d58-417a-9c72-604903f7b8ff None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:45.356116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a9bc6-6d58-417a-9c72-604903f7b8ff None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:45.360633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfaca96-f1f6-405c-b5d0-699d24b78869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:45.361255 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaca96-f1f6-405c-b5d0-699d24b78869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:45.361527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaca96-f1f6-405c-b5d0-699d24b78869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:45.361799 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaca96-f1f6-405c-b5d0-699d24b78869 admin admin] PATH_INFO: `/v3/users/280048431aa448f0931f46b06ff60018` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:45.362893 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfaca96-f1f6-405c-b5d0-699d24b78869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=280048431aa448f0931f46b06ff60018)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:45.364790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfaca96-f1f6-405c-b5d0-699d24b78869 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:45.413233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9dfaca96-f1f6-405c-b5d0-699d24b78869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '280048431aa448f0931f46b06ff60018'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:45.413867 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9dfaca96-f1f6-405c-b5d0-699d24b78869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '280048431aa448f0931f46b06ff60018'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:45.414463 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9dfaca96-f1f6-405c-b5d0-699d24b78869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '280048431aa448f0931f46b06ff60018'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:45.423971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9dfaca96-f1f6-405c-b5d0-699d24b78869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '280048431aa448f0931f46b06ff60018'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:45.435864 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9dfaca96-f1f6-405c-b5d0-699d24b78869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '280048431aa448f0931f46b06ff60018'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:45.437237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:45.464761 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1219/2442] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:11:45 2022] DELETE /identity/v3/users/280048431aa448f0931f46b06ff60018 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:11:45.469895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bac3a9-96b7-4b4c-8276-98cd840d7cbc None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:45.470367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bac3a9-96b7-4b4c-8276-98cd840d7cbc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:45.470519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bac3a9-96b7-4b4c-8276-98cd840d7cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:45.493135 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-29bac3a9-96b7-4b4c-8276-98cd840d7cbc None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:11:45.495889 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-29bac3a9-96b7-4b4c-8276-98cd840d7cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:45.558222 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:45.569694 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1224/2443] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:11:45.581188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfaca96-f1f6-405c-b5d0-699d24b78869 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:45.582785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9dfaca96-f1f6-405c-b5d0-699d24b78869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:45.653175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfaca96-f1f6-405c-b5d0-699d24b78869 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:45.657474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c19e4f-bd46-4030-9a40-270d8d000f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:45.658195 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c19e4f-bd46-4030-9a40-270d8d000f49 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:45.658577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c19e4f-bd46-4030-9a40-270d8d000f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:45.658948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c19e4f-bd46-4030-9a40-270d8d000f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:45.671868 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c19e4f-bd46-4030-9a40-270d8d000f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:45.672948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c19e4f-bd46-4030-9a40-270d8d000f49 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:45.683920 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1220/2444] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:11:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:11:45.987335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bac3a9-96b7-4b4c-8276-98cd840d7cbc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:45.989414 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-29bac3a9-96b7-4b4c-8276-98cd840d7cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:46.003434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bac3a9-96b7-4b4c-8276-98cd840d7cbc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:46.008295 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd454e5-7dea-4d74-9fba-08d07beb7cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:46.008959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd454e5-7dea-4d74-9fba-08d07beb7cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:46.009220 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd454e5-7dea-4d74-9fba-08d07beb7cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:46.009493 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd454e5-7dea-4d74-9fba-08d07beb7cc8 admin admin] PATH_INFO: `/v3/projects/a03890803cc647938f7e7239161bf6ec` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:46.011147 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd454e5-7dea-4d74-9fba-08d07beb7cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a03890803cc647938f7e7239161bf6ec)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:46.013855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd454e5-7dea-4d74-9fba-08d07beb7cc8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:46.064708 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1fd454e5-7dea-4d74-9fba-08d07beb7cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a03890803cc647938f7e7239161bf6ec', 'request_id': 'req-1fd454e5-7dea-4d74-9fba-08d07beb7cc8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:46.070703 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1fd454e5-7dea-4d74-9fba-08d07beb7cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a03890803cc647938f7e7239161bf6ec', 'request_id': 'req-1fd454e5-7dea-4d74-9fba-08d07beb7cc8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:46.078481 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1fd454e5-7dea-4d74-9fba-08d07beb7cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a03890803cc647938f7e7239161bf6ec', 'request_id': 'req-1fd454e5-7dea-4d74-9fba-08d07beb7cc8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:46.092084 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1fd454e5-7dea-4d74-9fba-08d07beb7cc8 admin admin] The token cache is being invalidate because project a03890803cc647938f7e7239161bf6ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:11:46.092369 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1fd454e5-7dea-4d74-9fba-08d07beb7cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:46.092985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1fd454e5-7dea-4d74-9fba-08d07beb7cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:11:46.094477 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1225/2445] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:11:45 2022] DELETE /identity/v3/projects/a03890803cc647938f7e7239161bf6ec => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:11:48.098248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19daf8c-fe54-4362-a420-8f1cc27130c5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:48.098853 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19daf8c-fe54-4362-a420-8f1cc27130c5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:48.098853 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19daf8c-fe54-4362-a420-8f1cc27130c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:48.118254 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b19daf8c-fe54-4362-a420-8f1cc27130c5 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:11:48.119513 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b19daf8c-fe54-4362-a420-8f1cc27130c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:48.178532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1221/2446] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Aug 9 07:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:11:48.201145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd454e5-7dea-4d74-9fba-08d07beb7cc8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:48.202545 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1fd454e5-7dea-4d74-9fba-08d07beb7cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:48.281945 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd454e5-7dea-4d74-9fba-08d07beb7cc8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:48.287659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cb4ec-0adf-4704-b0d0-f32e540f73c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:48.288269 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cb4ec-0adf-4704-b0d0-f32e540f73c4 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:48.288547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cb4ec-0adf-4704-b0d0-f32e540f73c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:48.288816 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cb4ec-0adf-4704-b0d0-f32e540f73c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:48.297653 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783cb4ec-0adf-4704-b0d0-f32e540f73c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:48.299299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783cb4ec-0adf-4704-b0d0-f32e540f73c4 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:48.309260 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1226/2447] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:11:53.257396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0006de-42c5-4ac5-885f-387eb911632a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:53.257875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0006de-42c5-4ac5-885f-387eb911632a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:53.258135 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0006de-42c5-4ac5-885f-387eb911632a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:53.289102 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ef0006de-42c5-4ac5-885f-387eb911632a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:11:53.296290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ef0006de-42c5-4ac5-885f-387eb911632a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:53.306452 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1222/2448] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Aug 9 07:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:11:53.329163 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cb4ec-0adf-4704-b0d0-f32e540f73c4 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:53.342417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cb4ec-0adf-4704-b0d0-f32e540f73c4 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:53.371046 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc7325-a73f-4350-82f9-14fa992307bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:53.372089 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc7325-a73f-4350-82f9-14fa992307bb service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:53.372744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc7325-a73f-4350-82f9-14fa992307bb service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:53.373998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc7325-a73f-4350-82f9-14fa992307bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:53.388345 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc7325-a73f-4350-82f9-14fa992307bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:53.391201 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc7325-a73f-4350-82f9-14fa992307bb service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:53.419334 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1227/2449] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:11:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:11:55.124703 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122673-1b47-4600-bb59-7c093fa695f5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:55.125175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122673-1b47-4600-bb59-7c093fa695f5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:55.125278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122673-1b47-4600-bb59-7c093fa695f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:55.144333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f3122673-1b47-4600-bb59-7c093fa695f5 None None] MFA Rules not processed for user `664e4353726c42c9bfb80b1701d35aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:11:55.145517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f3122673-1b47-4600-bb59-7c093fa695f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:55.199917 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1223/2450] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Aug 9 07:11:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:11:55.240942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc7325-a73f-4350-82f9-14fa992307bb service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:55.242852 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c5dc7325-a73f-4350-82f9-14fa992307bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:55.298711 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:55.314506 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc7325-a73f-4350-82f9-14fa992307bb service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:55.319381 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab10911-af3e-489c-93db-c3aa54929c71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f19a17424c44eea58efb957246cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:55.319988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab10911-af3e-489c-93db-c3aa54929c71 service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:55.320266 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab10911-af3e-489c-93db-c3aa54929c71 service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:55.320537 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab10911-af3e-489c-93db-c3aa54929c71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:55.328880 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab10911-af3e-489c-93db-c3aa54929c71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:55.330436 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab10911-af3e-489c-93db-c3aa54929c71 service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:55.339979 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1228/2451] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Aug 9 07:11:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 07:11:58.545770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005b5c6-3467-4b8a-ae9f-e4fa5fd008d2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:58.546990 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005b5c6-3467-4b8a-ae9f-e4fa5fd008d2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:58.547298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005b5c6-3467-4b8a-ae9f-e4fa5fd008d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:58.567630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3005b5c6-3467-4b8a-ae9f-e4fa5fd008d2 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:11:58.568955 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3005b5c6-3467-4b8a-ae9f-e4fa5fd008d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:58.578602 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1224/2452] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Aug 9 07:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:11:58.603368 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab10911-af3e-489c-93db-c3aa54929c71 service swift] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:11:58.606373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fab10911-af3e-489c-93db-c3aa54929c71 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:11:58.624498 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab10911-af3e-489c-93db-c3aa54929c71 service swift] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:11:58.631015 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ab0f8-264c-4c3f-a67e-ed75bdf63084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:11:58.631928 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ab0f8-264c-4c3f-a67e-ed75bdf63084 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:11:58.632271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ab0f8-264c-4c3f-a67e-ed75bdf63084 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:11:58.632608 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ab0f8-264c-4c3f-a67e-ed75bdf63084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:11:58.642752 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ab0f8-264c-4c3f-a67e-ed75bdf63084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:11:58.644547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ab0f8-264c-4c3f-a67e-ed75bdf63084 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:11:58.655816 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1229/2453] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:12:02.792141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a6db9-bb5b-4719-b106-ba5c0b8fc837 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:02.793129 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a6db9-bb5b-4719-b106-ba5c0b8fc837 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:02.793569 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a6db9-bb5b-4719-b106-ba5c0b8fc837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:02.813657 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-333a6db9-bb5b-4719-b106-ba5c0b8fc837 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:12:02.815170 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-333a6db9-bb5b-4719-b106-ba5c0b8fc837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:02.824940 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1225/2454] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Aug 9 07:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:12:02.850288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ab0f8-264c-4c3f-a67e-ed75bdf63084 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:02.874820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ab0f8-264c-4c3f-a67e-ed75bdf63084 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:02.892316 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09552d72-7dde-4df3-ad8f-151c66dd8ad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:02.894967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09552d72-7dde-4df3-ad8f-151c66dd8ad2 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:02.895841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09552d72-7dde-4df3-ad8f-151c66dd8ad2 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:02.897328 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09552d72-7dde-4df3-ad8f-151c66dd8ad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:02.914012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09552d72-7dde-4df3-ad8f-151c66dd8ad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:02.915666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09552d72-7dde-4df3-ad8f-151c66dd8ad2 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:02.928763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1230/2455] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:12:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:12:11.637441 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a07db-f640-43a3-a788-d6e957587991 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:11.637896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a07db-f640-43a3-a788-d6e957587991 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:11.637991 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a07db-f640-43a3-a788-d6e957587991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:11.657145 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8e9a07db-f640-43a3-a788-d6e957587991 None None] MFA Rules not processed for user `664e4353726c42c9bfb80b1701d35aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:12:11.658326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8e9a07db-f640-43a3-a788-d6e957587991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:11.665308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1226/2456] 10.222.0.40 () {58 vars in 967 bytes} [Tue Aug 9 07:12:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:12:11.678779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09552d72-7dde-4df3-ad8f-151c66dd8ad2 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:11.690269 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09552d72-7dde-4df3-ad8f-151c66dd8ad2 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:11.695185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587c2d6-7c81-4ddb-993d-560f8591cbc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f19a17424c44eea58efb957246cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:11.695764 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587c2d6-7c81-4ddb-993d-560f8591cbc0 service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:11.696037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587c2d6-7c81-4ddb-993d-560f8591cbc0 service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:11.696305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587c2d6-7c81-4ddb-993d-560f8591cbc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:11.704376 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587c2d6-7c81-4ddb-993d-560f8591cbc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:11.705907 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587c2d6-7c81-4ddb-993d-560f8591cbc0 service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:11.713913 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1231/2457] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Aug 9 07:12:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 07:12:13.865179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a07db-f640-43a3-a788-d6e957587991 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:13.866644 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8e9a07db-f640-43a3-a788-d6e957587991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:13.876113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:12:13.882531 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a07db-f640-43a3-a788-d6e957587991 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:13.888175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46d559-7255-4001-9ee3-a73e77b68dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:13.888826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46d559-7255-4001-9ee3-a73e77b68dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:13.889100 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46d559-7255-4001-9ee3-a73e77b68dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:13.889368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46d559-7255-4001-9ee3-a73e77b68dd4 admin admin] PATH_INFO: `/v3/users/433bcb6a2aa2437e96d74c20f58c88bd` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:13.890542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46d559-7255-4001-9ee3-a73e77b68dd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=433bcb6a2aa2437e96d74c20f58c88bd)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:13.892472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46d559-7255-4001-9ee3-a73e77b68dd4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:13.941135 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ed46d559-7255-4001-9ee3-a73e77b68dd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '433bcb6a2aa2437e96d74c20f58c88bd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:13.941998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ed46d559-7255-4001-9ee3-a73e77b68dd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '433bcb6a2aa2437e96d74c20f58c88bd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:13.942599 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ed46d559-7255-4001-9ee3-a73e77b68dd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '433bcb6a2aa2437e96d74c20f58c88bd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:13.950010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ed46d559-7255-4001-9ee3-a73e77b68dd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '433bcb6a2aa2437e96d74c20f58c88bd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:13.957385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ed46d559-7255-4001-9ee3-a73e77b68dd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '433bcb6a2aa2437e96d74c20f58c88bd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:13.974198 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1227/2458] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:12:13 2022] DELETE /identity/v3/users/433bcb6a2aa2437e96d74c20f58c88bd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:12:14.146881 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587c2d6-7c81-4ddb-993d-560f8591cbc0 service swift] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:14.158299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587c2d6-7c81-4ddb-993d-560f8591cbc0 service swift] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:14.230428 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773fcf1-1644-40e9-8765-89a2c34e36fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:14.231058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773fcf1-1644-40e9-8765-89a2c34e36fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:14.231379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773fcf1-1644-40e9-8765-89a2c34e36fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:14.231631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773fcf1-1644-40e9-8765-89a2c34e36fa admin admin] PATH_INFO: `/v3/projects/70959808dd434e03b1268281d320d8e2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:14.232910 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773fcf1-1644-40e9-8765-89a2c34e36fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=70959808dd434e03b1268281d320d8e2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:14.235002 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773fcf1-1644-40e9-8765-89a2c34e36fa admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:14.279670 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a773fcf1-1644-40e9-8765-89a2c34e36fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70959808dd434e03b1268281d320d8e2', 'request_id': 'req-a773fcf1-1644-40e9-8765-89a2c34e36fa'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:14.285170 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a773fcf1-1644-40e9-8765-89a2c34e36fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70959808dd434e03b1268281d320d8e2', 'request_id': 'req-a773fcf1-1644-40e9-8765-89a2c34e36fa'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:14.292055 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a773fcf1-1644-40e9-8765-89a2c34e36fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70959808dd434e03b1268281d320d8e2', 'request_id': 'req-a773fcf1-1644-40e9-8765-89a2c34e36fa'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:14.306392 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a773fcf1-1644-40e9-8765-89a2c34e36fa admin admin] The token cache is being invalidate because project 70959808dd434e03b1268281d320d8e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:12:14.306641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a773fcf1-1644-40e9-8765-89a2c34e36fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:14.307329 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a773fcf1-1644-40e9-8765-89a2c34e36fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:14.308871 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1232/2459] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:12:14 2022] DELETE /identity/v3/projects/70959808dd434e03b1268281d320d8e2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:12:14.313788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976857b8-748e-4a2d-b817-88f6b905ab6b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:14.314067 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976857b8-748e-4a2d-b817-88f6b905ab6b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:14.314331 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976857b8-748e-4a2d-b817-88f6b905ab6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:14.333702 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-976857b8-748e-4a2d-b817-88f6b905ab6b None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:12:14.334950 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-976857b8-748e-4a2d-b817-88f6b905ab6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:14.394299 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1228/2460] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:12:14.462099 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8ab1f-af87-4be1-b3fc-5c4ae0a2c991 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:14.462386 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8ab1f-af87-4be1-b3fc-5c4ae0a2c991 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:14.462659 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8ab1f-af87-4be1-b3fc-5c4ae0a2c991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:14.483550 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-eef8ab1f-af87-4be1-b3fc-5c4ae0a2c991 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:12:14.484737 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-eef8ab1f-af87-4be1-b3fc-5c4ae0a2c991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:14.492394 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1233/2461] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:12:14.497140 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976857b8-748e-4a2d-b817-88f6b905ab6b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:14.506418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976857b8-748e-4a2d-b817-88f6b905ab6b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:14.511044 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745acc31-7f75-45a2-bd87-3c9bfac73389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:14.511656 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745acc31-7f75-45a2-bd87-3c9bfac73389 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:14.511928 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745acc31-7f75-45a2-bd87-3c9bfac73389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:14.512192 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745acc31-7f75-45a2-bd87-3c9bfac73389 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:14.512824 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745acc31-7f75-45a2-bd87-3c9bfac73389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:12:14.513120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745acc31-7f75-45a2-bd87-3c9bfac73389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:14.514686 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745acc31-7f75-45a2-bd87-3c9bfac73389 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:14.526190 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1229/2462] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:12:14.530364 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8ab1f-af87-4be1-b3fc-5c4ae0a2c991 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:14.539450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8ab1f-af87-4be1-b3fc-5c4ae0a2c991 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:14.545069 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df755689-2e37-4616-bc51-a24df6fa7600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:14.545656 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df755689-2e37-4616-bc51-a24df6fa7600 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:14.545933 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df755689-2e37-4616-bc51-a24df6fa7600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:14.546202 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df755689-2e37-4616-bc51-a24df6fa7600 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:14.546818 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df755689-2e37-4616-bc51-a24df6fa7600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:14.548740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df755689-2e37-4616-bc51-a24df6fa7600 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:14.576932 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1234/2463] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:12:14 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:12:14.581209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745acc31-7f75-45a2-bd87-3c9bfac73389 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:14.591684 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745acc31-7f75-45a2-bd87-3c9bfac73389 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:14.646584 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd88250-a0e9-461f-bd4f-fcf8a5d5495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:14.647217 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd88250-a0e9-461f-bd4f-fcf8a5d5495b admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:14.647571 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd88250-a0e9-461f-bd4f-fcf8a5d5495b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:14.647846 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd88250-a0e9-461f-bd4f-fcf8a5d5495b admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:14.648470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd88250-a0e9-461f-bd4f-fcf8a5d5495b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:14.650988 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd88250-a0e9-461f-bd4f-fcf8a5d5495b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:14.659567 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:12:14.672863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1230/2464] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:12:14 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:12:14.676848 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df755689-2e37-4616-bc51-a24df6fa7600 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:14.687388 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df755689-2e37-4616-bc51-a24df6fa7600 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:14.692154 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dd61e-d7b3-4e0f-8fc0-c8fbecb0786a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:14.692745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dd61e-d7b3-4e0f-8fc0-c8fbecb0786a admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:14.693020 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dd61e-d7b3-4e0f-8fc0-c8fbecb0786a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:14.693286 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dd61e-d7b3-4e0f-8fc0-c8fbecb0786a admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:14.693918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dd61e-d7b3-4e0f-8fc0-c8fbecb0786a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:14.695579 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dd61e-d7b3-4e0f-8fc0-c8fbecb0786a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:14.697338 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:12:14.708187 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1235/2465] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:12:14.711623 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd88250-a0e9-461f-bd4f-fcf8a5d5495b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:14.721442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd88250-a0e9-461f-bd4f-fcf8a5d5495b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:14.726123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fa103-7522-4b75-9d52-56c708677bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:14.726709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fa103-7522-4b75-9d52-56c708677bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:14.726988 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fa103-7522-4b75-9d52-56c708677bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:14.727294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fa103-7522-4b75-9d52-56c708677bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:14.728432 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fa103-7522-4b75-9d52-56c708677bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:14.730017 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fa103-7522-4b75-9d52-56c708677bbf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:14.740199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1231/2466] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:12:14.744933 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dd61e-d7b3-4e0f-8fc0-c8fbecb0786a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:14.754563 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dd61e-d7b3-4e0f-8fc0-c8fbecb0786a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:14.759104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550e337-5fac-401f-a4f9-153b0d0393dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:14.759944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550e337-5fac-401f-a4f9-153b0d0393dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:14.760221 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550e337-5fac-401f-a4f9-153b0d0393dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:14.760490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550e337-5fac-401f-a4f9-153b0d0393dd admin admin] PATH_INFO: `/v3/projects/0d5ab46b609e496d88b9473b173d623e/users/7a3794d1175842feaa3c23b1b2b919cf/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:14.774448 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550e337-5fac-401f-a4f9-153b0d0393dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5ab46b609e496d88b9473b173d623e, user_id=7a3794d1175842feaa3c23b1b2b919cf, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:14.777217 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550e337-5fac-401f-a4f9-153b0d0393dd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:14.789458 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1236/2467] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:12:14 2022] PUT /identity/v3/projects/0d5ab46b609e496d88b9473b173d623e/users/7a3794d1175842feaa3c23b1b2b919cf/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:12:14.800164 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e00b02-d7c6-43f8-a9b2-4efc6dea540d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:14.800476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e00b02-d7c6-43f8-a9b2-4efc6dea540d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:14.800747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e00b02-d7c6-43f8-a9b2-4efc6dea540d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:14.828404 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-20e00b02-d7c6-43f8-a9b2-4efc6dea540d None None] MFA Rules not processed for user `7a3794d1175842feaa3c23b1b2b919cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:12:14.830428 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-20e00b02-d7c6-43f8-a9b2-4efc6dea540d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:14.893399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1232/2468] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:12:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:12:14.904280 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550e337-5fac-401f-a4f9-153b0d0393dd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:14.906319 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a550e337-5fac-401f-a4f9-153b0d0393dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:14.962266 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550e337-5fac-401f-a4f9-153b0d0393dd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:14.965894 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab8b44-5fe7-4b38-a421-bfe76e4ac415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:14.966481 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab8b44-5fe7-4b38-a421-bfe76e4ac415 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:14.966754 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab8b44-5fe7-4b38-a421-bfe76e4ac415 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:14.967019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab8b44-5fe7-4b38-a421-bfe76e4ac415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:14.975232 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab8b44-5fe7-4b38-a421-bfe76e4ac415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:14.976648 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab8b44-5fe7-4b38-a421-bfe76e4ac415 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:14.985379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1237/2469] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:12:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:12:16.369382 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eeb882-e5ef-4e70-ad8e-62463bb7f2b0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:16.369879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eeb882-e5ef-4e70-ad8e-62463bb7f2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:16.369972 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eeb882-e5ef-4e70-ad8e-62463bb7f2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:16.388907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e0eeb882-e5ef-4e70-ad8e-62463bb7f2b0 None None] MFA Rules not processed for user `7a3794d1175842feaa3c23b1b2b919cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:12:16.390088 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e0eeb882-e5ef-4e70-ad8e-62463bb7f2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:16.396902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1233/2470] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:12:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:12:17.481489 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab8b44-5fe7-4b38-a421-bfe76e4ac415 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:17.484016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b2ab8b44-5fe7-4b38-a421-bfe76e4ac415 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:17.572013 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab8b44-5fe7-4b38-a421-bfe76e4ac415 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:17.581997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86fa9f-07c7-44bb-8c0a-fe03388776f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07d2ee351e734fd09938cea9be3bb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:17.582936 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86fa9f-07c7-44bb-8c0a-fe03388776f0 service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:17.583444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86fa9f-07c7-44bb-8c0a-fe03388776f0 service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:17.583914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86fa9f-07c7-44bb-8c0a-fe03388776f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:17.586593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ea86fa9f-07c7-44bb-8c0a-fe03388776f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:17.600767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86fa9f-07c7-44bb-8c0a-fe03388776f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:17.608760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86fa9f-07c7-44bb-8c0a-fe03388776f0 service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:17.620611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1238/2471] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:12:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:12:22.922504 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7fbbd-8004-4ddf-b593-d0947633d1de None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:22.922998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7fbbd-8004-4ddf-b593-d0947633d1de None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:22.923122 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7fbbd-8004-4ddf-b593-d0947633d1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:22.942544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8bb7fbbd-8004-4ddf-b593-d0947633d1de None None] MFA Rules not processed for user `41e5fc59cdc14008b05fd15ca180542a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:12:22.943763 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8bb7fbbd-8004-4ddf-b593-d0947633d1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:22.996830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1234/2472] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:12:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:12:27.616308 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=70,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:12:32.989711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=2,keystone:SELECT=67 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:12:40.945517 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1e375-fdfe-45a0-b5e8-61f74ed01277 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:40.945983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1e375-fdfe-45a0-b5e8-61f74ed01277 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:40.946082 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1e375-fdfe-45a0-b5e8-61f74ed01277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:40.966110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-cbd1e375-fdfe-45a0-b5e8-61f74ed01277 None None] MFA Rules not processed for user `664e4353726c42c9bfb80b1701d35aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:12:40.967423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cbd1e375-fdfe-45a0-b5e8-61f74ed01277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:41.020865 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1239/2473] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Aug 9 07:12:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:12:41.032573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7fbbd-8004-4ddf-b593-d0947633d1de None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:41.033933 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8bb7fbbd-8004-4ddf-b593-d0947633d1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:41.103125 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7fbbd-8004-4ddf-b593-d0947633d1de None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:41.108453 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b78ad9-ea98-48f8-a753-2fb016214f00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f19a17424c44eea58efb957246cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:41.109077 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b78ad9-ea98-48f8-a753-2fb016214f00 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:41.109349 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b78ad9-ea98-48f8-a753-2fb016214f00 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:41.109613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b78ad9-ea98-48f8-a753-2fb016214f00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:41.117421 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b78ad9-ea98-48f8-a753-2fb016214f00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:41.119950 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b78ad9-ea98-48f8-a753-2fb016214f00 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:41.136114 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1235/2474] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Aug 9 07:12:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 07:12:41.704844 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a760dc-56c7-45ee-bd6c-66f9e1b5f6d2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:41.705129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a760dc-56c7-45ee-bd6c-66f9e1b5f6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:41.705399 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a760dc-56c7-45ee-bd6c-66f9e1b5f6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:41.725870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-05a760dc-56c7-45ee-bd6c-66f9e1b5f6d2 None None] MFA Rules not processed for user `664e4353726c42c9bfb80b1701d35aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:12:41.727057 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-05a760dc-56c7-45ee-bd6c-66f9e1b5f6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:41.735148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1240/2475] 10.222.0.40 () {58 vars in 967 bytes} [Tue Aug 9 07:12:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:12:41.751644 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b78ad9-ea98-48f8-a753-2fb016214f00 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:41.765255 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b78ad9-ea98-48f8-a753-2fb016214f00 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:41.770417 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c05f0-8a6c-4877-9455-2117a01ffafa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f19a17424c44eea58efb957246cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:41.771221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c05f0-8a6c-4877-9455-2117a01ffafa service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:41.771666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c05f0-8a6c-4877-9455-2117a01ffafa service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:41.772082 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c05f0-8a6c-4877-9455-2117a01ffafa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:41.784083 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c05f0-8a6c-4877-9455-2117a01ffafa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:41.785949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c05f0-8a6c-4877-9455-2117a01ffafa service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:41.794657 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1236/2476] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Aug 9 07:12:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 07:12:41.887576 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edd0d2-4eaa-41a1-9723-590d62cd1a8c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:41.887990 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edd0d2-4eaa-41a1-9723-590d62cd1a8c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:41.888454 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edd0d2-4eaa-41a1-9723-590d62cd1a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:41.910533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-78edd0d2-4eaa-41a1-9723-590d62cd1a8c None None] MFA Rules not processed for user `664e4353726c42c9bfb80b1701d35aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:12:41.911780 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-78edd0d2-4eaa-41a1-9723-590d62cd1a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:41.924726 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1241/2477] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Aug 9 07:12:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:12:41.937316 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c05f0-8a6c-4877-9455-2117a01ffafa service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:41.949533 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c05f0-8a6c-4877-9455-2117a01ffafa service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:41.955137 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb81989-928c-4e41-8a09-be30ae650aca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f19a17424c44eea58efb957246cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:41.955942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb81989-928c-4e41-8a09-be30ae650aca service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:41.956380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb81989-928c-4e41-8a09-be30ae650aca service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:41.956652 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb81989-928c-4e41-8a09-be30ae650aca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:41.967068 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb81989-928c-4e41-8a09-be30ae650aca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:41.968680 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb81989-928c-4e41-8a09-be30ae650aca service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:41.986096 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1237/2478] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Aug 9 07:12:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 07:12:42.072081 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca86b1b-445e-4a4a-b0c7-b6bed947dfc2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:42.073197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca86b1b-445e-4a4a-b0c7-b6bed947dfc2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:42.073637 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca86b1b-445e-4a4a-b0c7-b6bed947dfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:42.100167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1ca86b1b-445e-4a4a-b0c7-b6bed947dfc2 None None] MFA Rules not processed for user `664e4353726c42c9bfb80b1701d35aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:12:42.101647 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1ca86b1b-445e-4a4a-b0c7-b6bed947dfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:42.122310 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1242/2479] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Aug 9 07:12:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:12:42.138001 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb81989-928c-4e41-8a09-be30ae650aca service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:42.149550 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb81989-928c-4e41-8a09-be30ae650aca service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:42.157022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ba9f6-0728-4407-8a71-6491f876a231 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f19a17424c44eea58efb957246cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:42.157870 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ba9f6-0728-4407-8a71-6491f876a231 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:42.158216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ba9f6-0728-4407-8a71-6491f876a231 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:42.158556 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ba9f6-0728-4407-8a71-6491f876a231 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:42.168456 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ba9f6-0728-4407-8a71-6491f876a231 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:42.170092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ba9f6-0728-4407-8a71-6491f876a231 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:42.179005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1238/2480] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Aug 9 07:12:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 07:12:42.548033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf317d2b-f7dc-42d4-a3a2-b6fe9852e4ec None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:42.548317 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf317d2b-f7dc-42d4-a3a2-b6fe9852e4ec None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:42.548618 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf317d2b-f7dc-42d4-a3a2-b6fe9852e4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:42.569443 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-bf317d2b-f7dc-42d4-a3a2-b6fe9852e4ec None None] MFA Rules not processed for user `664e4353726c42c9bfb80b1701d35aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:12:42.570646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bf317d2b-f7dc-42d4-a3a2-b6fe9852e4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:42.581649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1243/2481] 10.222.0.40 () {58 vars in 967 bytes} [Tue Aug 9 07:12:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:12:42.596888 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ba9f6-0728-4407-8a71-6491f876a231 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:42.608981 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ba9f6-0728-4407-8a71-6491f876a231 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:42.616287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319b809-7aa0-4d04-9af4-1871bccc7cd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f19a17424c44eea58efb957246cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:42.618133 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319b809-7aa0-4d04-9af4-1871bccc7cd7 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:42.618635 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319b809-7aa0-4d04-9af4-1871bccc7cd7 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:42.619213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319b809-7aa0-4d04-9af4-1871bccc7cd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:42.636743 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319b809-7aa0-4d04-9af4-1871bccc7cd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:42.638755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319b809-7aa0-4d04-9af4-1871bccc7cd7 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:42.649709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1239/2482] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Aug 9 07:12:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 07:12:44.405000 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9401d-efd6-4e01-9d1d-f07d251cc8be None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:44.405000 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9401d-efd6-4e01-9d1d-f07d251cc8be None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:44.405638 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9401d-efd6-4e01-9d1d-f07d251cc8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:44.429982 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-78f9401d-efd6-4e01-9d1d-f07d251cc8be None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:12:44.431699 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-78f9401d-efd6-4e01-9d1d-f07d251cc8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:44.505367 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1244/2483] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Aug 9 07:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:12:44.552446 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319b809-7aa0-4d04-9af4-1871bccc7cd7 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:44.554049 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5319b809-7aa0-4d04-9af4-1871bccc7cd7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:44.644219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319b809-7aa0-4d04-9af4-1871bccc7cd7 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:44.650902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19ca70-60b6-46ca-900a-25c58c27d077 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:44.651917 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19ca70-60b6-46ca-900a-25c58c27d077 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:44.652554 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19ca70-60b6-46ca-900a-25c58c27d077 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:44.653039 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19ca70-60b6-46ca-900a-25c58c27d077 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:44.662966 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19ca70-60b6-46ca-900a-25c58c27d077 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:44.664572 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19ca70-60b6-46ca-900a-25c58c27d077 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:44.675361 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1240/2484] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:12:45.123404 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9401d-efd6-4e01-9d1d-f07d251cc8be None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:45.144514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9401d-efd6-4e01-9d1d-f07d251cc8be None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:45.149351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983630f-aaaa-4bd4-8537-54acc638ef93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:45.150324 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983630f-aaaa-4bd4-8537-54acc638ef93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:45.150644 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983630f-aaaa-4bd4-8537-54acc638ef93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:45.151480 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983630f-aaaa-4bd4-8537-54acc638ef93 admin admin] PATH_INFO: `/v3/users/7a3794d1175842feaa3c23b1b2b919cf` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:45.154200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983630f-aaaa-4bd4-8537-54acc638ef93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a3794d1175842feaa3c23b1b2b919cf)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:45.157223 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983630f-aaaa-4bd4-8537-54acc638ef93 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:45.275671 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5983630f-aaaa-4bd4-8537-54acc638ef93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a3794d1175842feaa3c23b1b2b919cf'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:45.289280 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5983630f-aaaa-4bd4-8537-54acc638ef93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a3794d1175842feaa3c23b1b2b919cf'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:45.289938 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5983630f-aaaa-4bd4-8537-54acc638ef93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a3794d1175842feaa3c23b1b2b919cf'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:45.302141 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5983630f-aaaa-4bd4-8537-54acc638ef93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a3794d1175842feaa3c23b1b2b919cf'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:45.304190 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:12:45.314632 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5983630f-aaaa-4bd4-8537-54acc638ef93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a3794d1175842feaa3c23b1b2b919cf'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:45.321071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1245/2485] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:12:45 2022] DELETE /identity/v3/users/7a3794d1175842feaa3c23b1b2b919cf => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:12:45.326549 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd552111-f09b-4bbe-8f24-d812a46a1cc4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:45.326834 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd552111-f09b-4bbe-8f24-d812a46a1cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:45.327293 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd552111-f09b-4bbe-8f24-d812a46a1cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:45.348961 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cd552111-f09b-4bbe-8f24-d812a46a1cc4 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:12:45.350189 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cd552111-f09b-4bbe-8f24-d812a46a1cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:45.375145 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:12:45.430254 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1241/2486] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:12:45.441490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983630f-aaaa-4bd4-8537-54acc638ef93 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:45.443511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5983630f-aaaa-4bd4-8537-54acc638ef93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:45.523947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983630f-aaaa-4bd4-8537-54acc638ef93 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:45.531835 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92351c-c782-4d47-9b18-63b997e8be71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:45.532719 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92351c-c782-4d47-9b18-63b997e8be71 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:45.533196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92351c-c782-4d47-9b18-63b997e8be71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:45.533648 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92351c-c782-4d47-9b18-63b997e8be71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:45.543976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92351c-c782-4d47-9b18-63b997e8be71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:45.545643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92351c-c782-4d47-9b18-63b997e8be71 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:45.556092 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1246/2487] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:12:45.763153 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd552111-f09b-4bbe-8f24-d812a46a1cc4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:45.765544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cd552111-f09b-4bbe-8f24-d812a46a1cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:45.781018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd552111-f09b-4bbe-8f24-d812a46a1cc4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:45.786658 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3ff0f-0b66-4717-b706-ebe8c7d7e6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:45.787953 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3ff0f-0b66-4717-b706-ebe8c7d7e6a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:45.788489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3ff0f-0b66-4717-b706-ebe8c7d7e6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:45.789750 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3ff0f-0b66-4717-b706-ebe8c7d7e6a1 admin admin] PATH_INFO: `/v3/projects/0d5ab46b609e496d88b9473b173d623e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:45.791385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3ff0f-0b66-4717-b706-ebe8c7d7e6a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5ab46b609e496d88b9473b173d623e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:45.793857 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3ff0f-0b66-4717-b706-ebe8c7d7e6a1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:45.858159 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fdd3ff0f-0b66-4717-b706-ebe8c7d7e6a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5ab46b609e496d88b9473b173d623e', 'request_id': 'req-fdd3ff0f-0b66-4717-b706-ebe8c7d7e6a1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:45.866639 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fdd3ff0f-0b66-4717-b706-ebe8c7d7e6a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5ab46b609e496d88b9473b173d623e', 'request_id': 'req-fdd3ff0f-0b66-4717-b706-ebe8c7d7e6a1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:45.874811 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fdd3ff0f-0b66-4717-b706-ebe8c7d7e6a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5ab46b609e496d88b9473b173d623e', 'request_id': 'req-fdd3ff0f-0b66-4717-b706-ebe8c7d7e6a1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:45.888702 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fdd3ff0f-0b66-4717-b706-ebe8c7d7e6a1 admin admin] The token cache is being invalidate because project 0d5ab46b609e496d88b9473b173d623e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:12:45.889130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fdd3ff0f-0b66-4717-b706-ebe8c7d7e6a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:45.889890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fdd3ff0f-0b66-4717-b706-ebe8c7d7e6a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:12:45.891604 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1242/2488] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:12:45 2022] DELETE /identity/v3/projects/0d5ab46b609e496d88b9473b173d623e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:12:48.663117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9eefb-a946-4eb2-92c2-445635f2d85d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:48.663671 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9eefb-a946-4eb2-92c2-445635f2d85d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:48.663900 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9eefb-a946-4eb2-92c2-445635f2d85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:48.686723 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f3b9eefb-a946-4eb2-92c2-445635f2d85d None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:12:48.688175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f3b9eefb-a946-4eb2-92c2-445635f2d85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:48.775124 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1247/2489] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Aug 9 07:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:12:48.799295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3ff0f-0b66-4717-b706-ebe8c7d7e6a1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:48.806392 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fdd3ff0f-0b66-4717-b706-ebe8c7d7e6a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:48.925548 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3ff0f-0b66-4717-b706-ebe8c7d7e6a1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:48.933933 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f94c1f-f6c2-4469-a027-9e8272d87542 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:48.934550 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f94c1f-f6c2-4469-a027-9e8272d87542 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:48.934832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f94c1f-f6c2-4469-a027-9e8272d87542 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:48.935127 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f94c1f-f6c2-4469-a027-9e8272d87542 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:48.943784 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f94c1f-f6c2-4469-a027-9e8272d87542 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:48.945412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f94c1f-f6c2-4469-a027-9e8272d87542 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:48.959750 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1243/2490] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:12:52.782304 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189cf06-18d2-477a-8cc7-5f64e0ab6978 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:52.782794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189cf06-18d2-477a-8cc7-5f64e0ab6978 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:52.782888 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189cf06-18d2-477a-8cc7-5f64e0ab6978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:52.803359 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d189cf06-18d2-477a-8cc7-5f64e0ab6978 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:12:52.804555 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d189cf06-18d2-477a-8cc7-5f64e0ab6978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:52.813411 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1248/2491] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Aug 9 07:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:12:52.845643 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f94c1f-f6c2-4469-a027-9e8272d87542 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:52.857633 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f94c1f-f6c2-4469-a027-9e8272d87542 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:52.863101 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f77dda-5813-47d7-85c8-d836a6e23d8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:52.863701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f77dda-5813-47d7-85c8-d836a6e23d8e service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:52.863975 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f77dda-5813-47d7-85c8-d836a6e23d8e service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:52.864242 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f77dda-5813-47d7-85c8-d836a6e23d8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:52.873003 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f77dda-5813-47d7-85c8-d836a6e23d8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:52.874567 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f77dda-5813-47d7-85c8-d836a6e23d8e service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:52.883764 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1244/2492] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:12:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:12:56.963560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117ea1d-83ae-417b-bbcd-a4ece6e71dfd None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:56.964070 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117ea1d-83ae-417b-bbcd-a4ece6e71dfd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:56.964070 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117ea1d-83ae-417b-bbcd-a4ece6e71dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:57.109047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9117ea1d-83ae-417b-bbcd-a4ece6e71dfd None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:12:57.110247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9117ea1d-83ae-417b-bbcd-a4ece6e71dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:57.117879 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1249/2493] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Aug 9 07:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:12:57.142813 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f77dda-5813-47d7-85c8-d836a6e23d8e service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:12:57.144248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c1f77dda-5813-47d7-85c8-d836a6e23d8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:12:57.159888 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f77dda-5813-47d7-85c8-d836a6e23d8e service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:12:57.165401 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb0431-3b62-418d-a8d1-7a7b9aae7ff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:12:57.165988 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb0431-3b62-418d-a8d1-7a7b9aae7ff9 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:12:57.166266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb0431-3b62-418d-a8d1-7a7b9aae7ff9 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:12:57.166534 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb0431-3b62-418d-a8d1-7a7b9aae7ff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:12:57.174592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb0431-3b62-418d-a8d1-7a7b9aae7ff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:12:57.176218 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb0431-3b62-418d-a8d1-7a7b9aae7ff9 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:12:57.185610 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1245/2494] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:12:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:13:01.498379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da15813-5054-455e-92b5-4ad8d561bbf7 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:01.498973 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da15813-5054-455e-92b5-4ad8d561bbf7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:01.498973 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da15813-5054-455e-92b5-4ad8d561bbf7 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:01.500299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1250/2495] 10.222.0.40 () {54 vars in 921 bytes} [Tue Aug 9 07:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:13:01.507197 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16a2de-282a-4e5a-b37e-56f0571e80fb None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:01.507698 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16a2de-282a-4e5a-b37e-56f0571e80fb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:01.507801 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16a2de-282a-4e5a-b37e-56f0571e80fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:01.516734 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:13:01.531972 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6f16a2de-282a-4e5a-b37e-56f0571e80fb None None] MFA Rules not processed for user `6e949d9666be44a0b6122d510168c7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:13:01.533647 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6f16a2de-282a-4e5a-b37e-56f0571e80fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:13:01.545785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1246/2496] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Aug 9 07:13:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:13:01.570708 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da15813-5054-455e-92b5-4ad8d561bbf7 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:13:01.573134 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0da15813-5054-455e-92b5-4ad8d561bbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:13:01.646293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da15813-5054-455e-92b5-4ad8d561bbf7 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:13:01.649690 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027b08a-5684-40c4-abf4-1839093470d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44c764958784616b8bdbf59e5692ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:13:01.650284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027b08a-5684-40c4-abf4-1839093470d3 service glance] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:01.650551 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027b08a-5684-40c4-abf4-1839093470d3 service glance] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:01.650810 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027b08a-5684-40c4-abf4-1839093470d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:01.660894 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027b08a-5684-40c4-abf4-1839093470d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:13:01.662281 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027b08a-5684-40c4-abf4-1839093470d3 service glance] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:13:01.674171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1251/2497] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:13:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:13:01.746609 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f454c7a-1b2f-4851-b634-183e390205e9 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:01.747202 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f454c7a-1b2f-4851-b634-183e390205e9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:01.747477 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f454c7a-1b2f-4851-b634-183e390205e9 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:01.748811 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1247/2498] 10.222.0.40 () {54 vars in 921 bytes} [Tue Aug 9 07:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:13:01.753828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce065a8-1d97-4824-b35b-d9ccf2098cc9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:01.754107 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce065a8-1d97-4824-b35b-d9ccf2098cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:01.754373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce065a8-1d97-4824-b35b-d9ccf2098cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:01.774394 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4ce065a8-1d97-4824-b35b-d9ccf2098cc9 None None] MFA Rules not processed for user `8d75da9360ef490f910fabc3920c8ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:13:01.775796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4ce065a8-1d97-4824-b35b-d9ccf2098cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:13:01.795822 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:13:01.830260 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1252/2499] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Aug 9 07:13:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:13:01.842535 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f454c7a-1b2f-4851-b634-183e390205e9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:13:01.844282 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4f454c7a-1b2f-4851-b634-183e390205e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:13:01.857884 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f454c7a-1b2f-4851-b634-183e390205e9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:13:01.861449 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56567ab-5f47-4d58-b779-690f70c5b5c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:13:01.862036 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56567ab-5f47-4d58-b779-690f70c5b5c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:01.862308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56567ab-5f47-4d58-b779-690f70c5b5c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:01.862575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56567ab-5f47-4d58-b779-690f70c5b5c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:01.869601 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56567ab-5f47-4d58-b779-690f70c5b5c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:13:01.871431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56567ab-5f47-4d58-b779-690f70c5b5c2 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:13:01.879152 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1248/2500] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:13:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:13:01.970943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f96571-99f7-4a86-8536-a66e341432e3 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:01.971376 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f96571-99f7-4a86-8536-a66e341432e3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:01.971706 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f96571-99f7-4a86-8536-a66e341432e3 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:01.973693 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1253/2501] 10.222.0.40 () {54 vars in 921 bytes} [Tue Aug 9 07:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:13:01.979249 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414998f-d81d-4360-af8f-84db264bb38b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:01.979677 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414998f-d81d-4360-af8f-84db264bb38b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:01.980103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414998f-d81d-4360-af8f-84db264bb38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:01.999848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b414998f-d81d-4360-af8f-84db264bb38b None None] MFA Rules not processed for user `6e949d9666be44a0b6122d510168c7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:13:02.001143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b414998f-d81d-4360-af8f-84db264bb38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:13:02.010266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1249/2502] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Aug 9 07:13:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:13:02.021122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f96571-99f7-4a86-8536-a66e341432e3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:13:02.032421 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f96571-99f7-4a86-8536-a66e341432e3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:13:02.036200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c1dc9-80ef-4ebf-88cb-2ff81bbe8d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:13:02.036788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c1dc9-80ef-4ebf-88cb-2ff81bbe8d37 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:02.037057 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c1dc9-80ef-4ebf-88cb-2ff81bbe8d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:02.037322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c1dc9-80ef-4ebf-88cb-2ff81bbe8d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:02.048267 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c1dc9-80ef-4ebf-88cb-2ff81bbe8d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:13:02.049664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c1dc9-80ef-4ebf-88cb-2ff81bbe8d37 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:13:02.062070 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1254/2503] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:13:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:13:03.219582 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651106c-7311-4828-97db-5a627f541d9c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:03.220067 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651106c-7311-4828-97db-5a627f541d9c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:03.220167 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651106c-7311-4828-97db-5a627f541d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:03.238765 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8651106c-7311-4828-97db-5a627f541d9c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:13:03.239997 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8651106c-7311-4828-97db-5a627f541d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:13:03.247821 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1250/2504] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Aug 9 07:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:13:03.274566 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c1dc9-80ef-4ebf-88cb-2ff81bbe8d37 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:13:03.286189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c1dc9-80ef-4ebf-88cb-2ff81bbe8d37 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:13:03.291473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55291c-b1e6-4cf3-b456-bb1c21b22a50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:13:03.292093 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55291c-b1e6-4cf3-b456-bb1c21b22a50 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:03.292641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55291c-b1e6-4cf3-b456-bb1c21b22a50 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:03.292641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55291c-b1e6-4cf3-b456-bb1c21b22a50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:03.300674 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55291c-b1e6-4cf3-b456-bb1c21b22a50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:13:03.302204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55291c-b1e6-4cf3-b456-bb1c21b22a50 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:13:03.311723 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1255/2505] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:13:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:13:06.292628 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbed0eb-bc5b-418e-bf2a-a0606127c165 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:06.293106 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbed0eb-bc5b-418e-bf2a-a0606127c165 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:06.293319 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbed0eb-bc5b-418e-bf2a-a0606127c165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:06.312094 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9dbed0eb-bc5b-418e-bf2a-a0606127c165 None None] MFA Rules not processed for user `664e4353726c42c9bfb80b1701d35aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:13:06.313287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9dbed0eb-bc5b-418e-bf2a-a0606127c165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:13:06.373982 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1251/2506] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Aug 9 07:13:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:13:06.397596 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55291c-b1e6-4cf3-b456-bb1c21b22a50 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:13:06.398982 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bd55291c-b1e6-4cf3-b456-bb1c21b22a50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:13:06.466603 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55291c-b1e6-4cf3-b456-bb1c21b22a50 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:13:06.471540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a1c77-6421-4d30-baa8-abad56ce6c25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f19a17424c44eea58efb957246cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:13:06.472131 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a1c77-6421-4d30-baa8-abad56ce6c25 service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:06.472404 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a1c77-6421-4d30-baa8-abad56ce6c25 service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:06.472668 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a1c77-6421-4d30-baa8-abad56ce6c25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:06.480773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a1c77-6421-4d30-baa8-abad56ce6c25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:13:06.482318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a1c77-6421-4d30-baa8-abad56ce6c25 service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:13:06.490386 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1256/2507] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Aug 9 07:13:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 07:13:16.367275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=38 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:13:16.487063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=56 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:13:34.735450 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f695d-3791-42ed-b4bf-2bad976c79fc None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:34.735967 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f695d-3791-42ed-b4bf-2bad976c79fc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:34.735967 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f695d-3791-42ed-b4bf-2bad976c79fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:34.769936 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-448f695d-3791-42ed-b4bf-2bad976c79fc None None] MFA Rules not processed for user `664e4353726c42c9bfb80b1701d35aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:13:34.771245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-448f695d-3791-42ed-b4bf-2bad976c79fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:13:34.778780 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1252/2508] 10.222.0.40 () {58 vars in 967 bytes} [Tue Aug 9 07:13:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:13:34.790804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a1c77-6421-4d30-baa8-abad56ce6c25 service swift] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:13:34.802047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a1c77-6421-4d30-baa8-abad56ce6c25 service swift] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:13:34.806972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf53101-6086-461c-b2f6-535e3a3f0d64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f19a17424c44eea58efb957246cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:13:34.807617 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf53101-6086-461c-b2f6-535e3a3f0d64 service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:34.807953 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf53101-6086-461c-b2f6-535e3a3f0d64 service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:34.808443 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf53101-6086-461c-b2f6-535e3a3f0d64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:34.816634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf53101-6086-461c-b2f6-535e3a3f0d64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:13:34.818242 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf53101-6086-461c-b2f6-535e3a3f0d64 service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:13:34.826461 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1257/2509] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Aug 9 07:13:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 07:13:44.752493 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:13:44.823754 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:13:52.553845 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f695d-3791-42ed-b4bf-2bad976c79fc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:13:52.563578 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f695d-3791-42ed-b4bf-2bad976c79fc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:13:52.567076 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1300787-2acf-436d-b2e3-72ae2f61be03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:13:52.567690 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1300787-2acf-436d-b2e3-72ae2f61be03 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:52.567961 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1300787-2acf-436d-b2e3-72ae2f61be03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:52.568223 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1300787-2acf-436d-b2e3-72ae2f61be03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:52.569910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d1300787-2acf-436d-b2e3-72ae2f61be03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:13:52.584178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1300787-2acf-436d-b2e3-72ae2f61be03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:13:52.585592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1300787-2acf-436d-b2e3-72ae2f61be03 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:13:52.597148 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1253/2510] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:13:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:13:55.616066 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf53101-6086-461c-b2f6-535e3a3f0d64 service swift] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:13:55.618338 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2bf53101-6086-461c-b2f6-535e3a3f0d64 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:13:55.633828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf53101-6086-461c-b2f6-535e3a3f0d64 service swift] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:13:55.639353 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd0cb6-0a8e-4765-bb9e-5f576970b776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:13:55.639974 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd0cb6-0a8e-4765-bb9e-5f576970b776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:55.640248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd0cb6-0a8e-4765-bb9e-5f576970b776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:55.640514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd0cb6-0a8e-4765-bb9e-5f576970b776 admin admin] PATH_INFO: `/v3/users/41e5fc59cdc14008b05fd15ca180542a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:55.641606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd0cb6-0a8e-4765-bb9e-5f576970b776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e5fc59cdc14008b05fd15ca180542a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:13:55.643566 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd0cb6-0a8e-4765-bb9e-5f576970b776 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:13:55.688677 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-20cd0cb6-0a8e-4765-bb9e-5f576970b776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e5fc59cdc14008b05fd15ca180542a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:13:55.695795 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-20cd0cb6-0a8e-4765-bb9e-5f576970b776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e5fc59cdc14008b05fd15ca180542a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:13:55.696658 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-20cd0cb6-0a8e-4765-bb9e-5f576970b776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e5fc59cdc14008b05fd15ca180542a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:13:55.708996 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-20cd0cb6-0a8e-4765-bb9e-5f576970b776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e5fc59cdc14008b05fd15ca180542a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:13:55.715776 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-20cd0cb6-0a8e-4765-bb9e-5f576970b776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e5fc59cdc14008b05fd15ca180542a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:13:55.721515 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1258/2511] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:13:55 2022] DELETE /identity/v3/users/41e5fc59cdc14008b05fd15ca180542a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:13:55.895069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1300787-2acf-436d-b2e3-72ae2f61be03 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:13:55.910969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1300787-2acf-436d-b2e3-72ae2f61be03 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:13:55.967474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6841549-4898-4c42-a401-aa952c555a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:13:55.968089 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6841549-4898-4c42-a401-aa952c555a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:55.968360 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6841549-4898-4c42-a401-aa952c555a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:55.968625 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6841549-4898-4c42-a401-aa952c555a00 admin admin] PATH_INFO: `/v3/projects/e6f8f2acb2b9479e99a9858dfbc0c055` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:55.969732 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6841549-4898-4c42-a401-aa952c555a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6f8f2acb2b9479e99a9858dfbc0c055)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:13:55.971639 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6841549-4898-4c42-a401-aa952c555a00 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:13:56.015870 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c6841549-4898-4c42-a401-aa952c555a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6f8f2acb2b9479e99a9858dfbc0c055', 'request_id': 'req-c6841549-4898-4c42-a401-aa952c555a00'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:13:56.022001 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c6841549-4898-4c42-a401-aa952c555a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6f8f2acb2b9479e99a9858dfbc0c055', 'request_id': 'req-c6841549-4898-4c42-a401-aa952c555a00'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:13:56.028190 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c6841549-4898-4c42-a401-aa952c555a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6f8f2acb2b9479e99a9858dfbc0c055', 'request_id': 'req-c6841549-4898-4c42-a401-aa952c555a00'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:13:56.039912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c6841549-4898-4c42-a401-aa952c555a00 admin admin] The token cache is being invalidate because project e6f8f2acb2b9479e99a9858dfbc0c055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:13:56.040198 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c6841549-4898-4c42-a401-aa952c555a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:13:56.040819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c6841549-4898-4c42-a401-aa952c555a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:13:56.042269 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1254/2512] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:13:55 2022] DELETE /identity/v3/projects/e6f8f2acb2b9479e99a9858dfbc0c055 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:13:56.276823 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30faa6a8-2d58-47fc-8ff3-ebd2bb7a60f5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:56.277105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30faa6a8-2d58-47fc-8ff3-ebd2bb7a60f5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:56.277402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30faa6a8-2d58-47fc-8ff3-ebd2bb7a60f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:56.297334 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-30faa6a8-2d58-47fc-8ff3-ebd2bb7a60f5 None None] MFA Rules not processed for user `86b1015b309e4b06b21269892fbc8287`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:13:56.298632 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-30faa6a8-2d58-47fc-8ff3-ebd2bb7a60f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:13:56.358608 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1259/2513] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:13:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:13:56.418654 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6841549-4898-4c42-a401-aa952c555a00 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:13:56.420243 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c6841549-4898-4c42-a401-aa952c555a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:13:56.485725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6841549-4898-4c42-a401-aa952c555a00 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:13:56.489173 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061d3be-ba95-4e05-ac5e-371e5f5c4070 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:13:56.489765 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061d3be-ba95-4e05-ac5e-371e5f5c4070 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:13:56.490034 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061d3be-ba95-4e05-ac5e-371e5f5c4070 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:13:56.490299 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061d3be-ba95-4e05-ac5e-371e5f5c4070 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:13:56.492041 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4061d3be-ba95-4e05-ac5e-371e5f5c4070 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:13:56.522880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:13:56.563768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061d3be-ba95-4e05-ac5e-371e5f5c4070 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:13:56.565276 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061d3be-ba95-4e05-ac5e-371e5f5c4070 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:13:56.576786 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1255/2514] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:13:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:14:06.352164 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:14:06.571423 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=19 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:14:15.353217 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30faa6a8-2d58-47fc-8ff3-ebd2bb7a60f5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:14:15.354672 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-30faa6a8-2d58-47fc-8ff3-ebd2bb7a60f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:14:15.371061 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30faa6a8-2d58-47fc-8ff3-ebd2bb7a60f5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:14:15.376360 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bd237-f6c0-40f6-b166-269c7627e430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:14:15.376973 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bd237-f6c0-40f6-b166-269c7627e430 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:14:15.377245 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bd237-f6c0-40f6-b166-269c7627e430 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:14:15.377504 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bd237-f6c0-40f6-b166-269c7627e430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:14:15.379154 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c70bd237-f6c0-40f6-b166-269c7627e430 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:14:15.434821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bd237-f6c0-40f6-b166-269c7627e430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:14:15.436386 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bd237-f6c0-40f6-b166-269c7627e430 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:14:15.445105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1260/2515] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:14:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:14:25.440979 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=28 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:14:35.767912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061d3be-ba95-4e05-ac5e-371e5f5c4070 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:14:35.769329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4061d3be-ba95-4e05-ac5e-371e5f5c4070 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:14:35.783703 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061d3be-ba95-4e05-ac5e-371e5f5c4070 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:14:35.789123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5b7dc-4904-47bb-b000-c8e0b37e18f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:14:35.789710 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5b7dc-4904-47bb-b000-c8e0b37e18f4 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:14:35.789985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5b7dc-4904-47bb-b000-c8e0b37e18f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:14:35.790256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5b7dc-4904-47bb-b000-c8e0b37e18f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:14:35.791925 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-19a5b7dc-4904-47bb-b000-c8e0b37e18f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:14:35.849299 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5b7dc-4904-47bb-b000-c8e0b37e18f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:14:35.850861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5b7dc-4904-47bb-b000-c8e0b37e18f4 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:14:35.860251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1256/2516] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:14:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:14:40.841985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bd237-f6c0-40f6-b166-269c7627e430 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:14:40.853312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bd237-f6c0-40f6-b166-269c7627e430 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:14:40.859664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa224c1-1ebc-4598-9873-960ddb97bd34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:14:40.860272 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa224c1-1ebc-4598-9873-960ddb97bd34 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:14:40.860545 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa224c1-1ebc-4598-9873-960ddb97bd34 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:14:40.861147 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa224c1-1ebc-4598-9873-960ddb97bd34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:14:40.862686 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1aa224c1-1ebc-4598-9873-960ddb97bd34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:14:40.875585 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa224c1-1ebc-4598-9873-960ddb97bd34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:14:40.877237 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa224c1-1ebc-4598-9873-960ddb97bd34 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:14:40.888263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1261/2517] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:14:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:14:43.324209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5b7dc-4904-47bb-b000-c8e0b37e18f4 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:14:43.325628 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-19a5b7dc-4904-47bb-b000-c8e0b37e18f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:14:43.385791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5b7dc-4904-47bb-b000-c8e0b37e18f4 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:14:43.389487 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd2fbb-26ec-4270-9a96-01b21b6da00e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:14:43.390093 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd2fbb-26ec-4270-9a96-01b21b6da00e service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:14:43.390371 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd2fbb-26ec-4270-9a96-01b21b6da00e service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:14:43.390641 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd2fbb-26ec-4270-9a96-01b21b6da00e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:14:43.392380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4bbd2fbb-26ec-4270-9a96-01b21b6da00e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:14:43.402183 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd2fbb-26ec-4270-9a96-01b21b6da00e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:14:43.403635 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd2fbb-26ec-4270-9a96-01b21b6da00e service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:14:43.411598 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1257/2518] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:14:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:14:45.374127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d08798-9ecd-4c5f-9ba6-93a1850171f5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:14:45.374650 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d08798-9ecd-4c5f-9ba6-93a1850171f5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:14:45.374760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d08798-9ecd-4c5f-9ba6-93a1850171f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:14:45.393975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-84d08798-9ecd-4c5f-9ba6-93a1850171f5 None None] MFA Rules not processed for user `6cead1e7fb98489fbe122f9bff8a63b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:14:45.395207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-84d08798-9ecd-4c5f-9ba6-93a1850171f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:14:45.402307 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1262/2519] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:14:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:14:45.966204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd2fbb-26ec-4270-9a96-01b21b6da00e service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:14:45.974813 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd2fbb-26ec-4270-9a96-01b21b6da00e service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:14:45.978509 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7e193-0ad7-4bdf-bddf-2da099162f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:14:45.979119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7e193-0ad7-4bdf-bddf-2da099162f04 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:14:45.979392 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7e193-0ad7-4bdf-bddf-2da099162f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:14:45.979665 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7e193-0ad7-4bdf-bddf-2da099162f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:14:45.982193 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b5e7e193-0ad7-4bdf-bddf-2da099162f04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:14:45.996194 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7e193-0ad7-4bdf-bddf-2da099162f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:14:45.997425 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7e193-0ad7-4bdf-bddf-2da099162f04 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:14:46.005416 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1258/2520] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:14:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:14:46.335260 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d08798-9ecd-4c5f-9ba6-93a1850171f5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:14:46.337047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-84d08798-9ecd-4c5f-9ba6-93a1850171f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:14:46.416837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d08798-9ecd-4c5f-9ba6-93a1850171f5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:14:46.422279 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58482856-c923-41c5-95a6-fbe738396d34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07d2ee351e734fd09938cea9be3bb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:14:46.422874 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58482856-c923-41c5-95a6-fbe738396d34 service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:14:46.423171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58482856-c923-41c5-95a6-fbe738396d34 service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:14:46.423435 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58482856-c923-41c5-95a6-fbe738396d34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:14:46.425153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-58482856-c923-41c5-95a6-fbe738396d34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:14:46.438175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58482856-c923-41c5-95a6-fbe738396d34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:14:46.439931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58482856-c923-41c5-95a6-fbe738396d34 service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:14:46.451503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1263/2521] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:14:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:14:49.946519 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7e193-0ad7-4bdf-bddf-2da099162f04 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:14:49.961738 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7e193-0ad7-4bdf-bddf-2da099162f04 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:14:49.968521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a3bfd-9b08-48cd-a180-a3842b6c172d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:14:49.969330 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a3bfd-9b08-48cd-a180-a3842b6c172d service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:14:49.969589 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a3bfd-9b08-48cd-a180-a3842b6c172d service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:14:49.969851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a3bfd-9b08-48cd-a180-a3842b6c172d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:14:49.972018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-463a3bfd-9b08-48cd-a180-a3842b6c172d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:14:49.986672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a3bfd-9b08-48cd-a180-a3842b6c172d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:14:49.988302 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a3bfd-9b08-48cd-a180-a3842b6c172d service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:14:50.011943 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1259/2522] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:14:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:14:56.446208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=41 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:14:59.995528 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=66 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:03.982675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58482856-c923-41c5-95a6-fbe738396d34 service placement] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:03.995868 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58482856-c923-41c5-95a6-fbe738396d34 service placement] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:04.001400 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930ef64-7f71-4c9e-9167-0fd710d2ce1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:04.001995 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930ef64-7f71-4c9e-9167-0fd710d2ce1f service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:04.002266 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930ef64-7f71-4c9e-9167-0fd710d2ce1f service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:04.002529 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930ef64-7f71-4c9e-9167-0fd710d2ce1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:04.004262 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3930ef64-7f71-4c9e-9167-0fd710d2ce1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:04.017068 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930ef64-7f71-4c9e-9167-0fd710d2ce1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:04.018714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930ef64-7f71-4c9e-9167-0fd710d2ce1f service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:04.029746 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1264/2523] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:15:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:15:05.630455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a3bfd-9b08-48cd-a180-a3842b6c172d service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:05.631938 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-463a3bfd-9b08-48cd-a180-a3842b6c172d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:05.643672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a3bfd-9b08-48cd-a180-a3842b6c172d service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:05.647215 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86602dcd-7954-4857-9718-d04bd2142985 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:05.647801 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86602dcd-7954-4857-9718-d04bd2142985 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:05.648076 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86602dcd-7954-4857-9718-d04bd2142985 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:05.648348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86602dcd-7954-4857-9718-d04bd2142985 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:05.649993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-86602dcd-7954-4857-9718-d04bd2142985 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:05.660487 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86602dcd-7954-4857-9718-d04bd2142985 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:05.661895 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86602dcd-7954-4857-9718-d04bd2142985 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:05.671191 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1260/2524] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:15:05 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:15:14.024745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:15.666595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:21.614504 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee463a99-2291-409b-bec8-9e0324b56be7 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:21.615039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee463a99-2291-409b-bec8-9e0324b56be7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:21.615039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee463a99-2291-409b-bec8-9e0324b56be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:21.634459 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ee463a99-2291-409b-bec8-9e0324b56be7 None None] MFA Rules not processed for user `4c652bdbf6fb432eb25b6be62b5b5077`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:21.635690 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ee463a99-2291-409b-bec8-9e0324b56be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:21.642675 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1265/2525] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:21.940269 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86602dcd-7954-4857-9718-d04bd2142985 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:21.941669 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-86602dcd-7954-4857-9718-d04bd2142985 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:21.953401 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86602dcd-7954-4857-9718-d04bd2142985 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:21.957172 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7d695-b3db-4aed-8880-89d7093ab8d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:21.957760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7d695-b3db-4aed-8880-89d7093ab8d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:21.958032 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7d695-b3db-4aed-8880-89d7093ab8d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:21.958299 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7d695-b3db-4aed-8880-89d7093ab8d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:21.959976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-76b7d695-b3db-4aed-8880-89d7093ab8d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:21.969640 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7d695-b3db-4aed-8880-89d7093ab8d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:21.971188 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7d695-b3db-4aed-8880-89d7093ab8d5 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:21.979006 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1261/2526] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:15:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:15:24.885041 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee463a99-2291-409b-bec8-9e0324b56be7 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:24.894848 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee463a99-2291-409b-bec8-9e0324b56be7 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:24.898462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7c2d1-6514-4805-80fa-a789d4d7a3e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:24.899059 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7c2d1-6514-4805-80fa-a789d4d7a3e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:24.899380 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7c2d1-6514-4805-80fa-a789d4d7a3e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:24.899649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7c2d1-6514-4805-80fa-a789d4d7a3e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:24.902142 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-05a7c2d1-6514-4805-80fa-a789d4d7a3e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:24.968085 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7c2d1-6514-4805-80fa-a789d4d7a3e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:24.969494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7c2d1-6514-4805-80fa-a789d4d7a3e1 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:24.978995 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1266/2527] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:15:28.468839 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7d695-b3db-4aed-8880-89d7093ab8d5 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:28.470308 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-76b7d695-b3db-4aed-8880-89d7093ab8d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:28.485767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7d695-b3db-4aed-8880-89d7093ab8d5 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:28.490818 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b182c8-5391-4bea-b6d5-0c81f6a0f894 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07d2ee351e734fd09938cea9be3bb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:28.491440 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b182c8-5391-4bea-b6d5-0c81f6a0f894 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:28.491714 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b182c8-5391-4bea-b6d5-0c81f6a0f894 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:28.491983 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b182c8-5391-4bea-b6d5-0c81f6a0f894 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:28.493682 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-46b182c8-5391-4bea-b6d5-0c81f6a0f894 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:28.506686 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b182c8-5391-4bea-b6d5-0c81f6a0f894 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:28.508351 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b182c8-5391-4bea-b6d5-0c81f6a0f894 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:28.522083 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1262/2528] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:15:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:15:28.526811 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7c2d1-6514-4805-80fa-a789d4d7a3e1 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:28.529722 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-05a7c2d1-6514-4805-80fa-a789d4d7a3e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:28.543827 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7c2d1-6514-4805-80fa-a789d4d7a3e1 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:28.548838 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc327ee-5063-4247-bbc5-4407fead7117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:28.549530 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc327ee-5063-4247-bbc5-4407fead7117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:28.549804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc327ee-5063-4247-bbc5-4407fead7117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:28.550067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc327ee-5063-4247-bbc5-4407fead7117 admin admin] PATH_INFO: `/v3/users/86b1015b309e4b06b21269892fbc8287` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:28.551242 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc327ee-5063-4247-bbc5-4407fead7117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86b1015b309e4b06b21269892fbc8287)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:28.553375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc327ee-5063-4247-bbc5-4407fead7117 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:28.599135 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dcc327ee-5063-4247-bbc5-4407fead7117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86b1015b309e4b06b21269892fbc8287'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:28.608752 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dcc327ee-5063-4247-bbc5-4407fead7117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86b1015b309e4b06b21269892fbc8287'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:28.609406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dcc327ee-5063-4247-bbc5-4407fead7117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86b1015b309e4b06b21269892fbc8287'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:28.623017 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dcc327ee-5063-4247-bbc5-4407fead7117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86b1015b309e4b06b21269892fbc8287'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:28.630062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dcc327ee-5063-4247-bbc5-4407fead7117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86b1015b309e4b06b21269892fbc8287'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:28.636327 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1267/2529] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:15:28 2022] DELETE /identity/v3/users/86b1015b309e4b06b21269892fbc8287 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:28.810919 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b182c8-5391-4bea-b6d5-0c81f6a0f894 service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:28.822106 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b182c8-5391-4bea-b6d5-0c81f6a0f894 service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:28.882032 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a8320-5d04-4678-99b7-095e8e1f3103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:28.882659 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a8320-5d04-4678-99b7-095e8e1f3103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:28.882934 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a8320-5d04-4678-99b7-095e8e1f3103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:28.883232 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a8320-5d04-4678-99b7-095e8e1f3103 admin admin] PATH_INFO: `/v3/projects/1d57da5185404e4d991960f56a10323f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:28.884335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a8320-5d04-4678-99b7-095e8e1f3103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d57da5185404e4d991960f56a10323f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:28.886257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a8320-5d04-4678-99b7-095e8e1f3103 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:28.938675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2b7a8320-5d04-4678-99b7-095e8e1f3103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d57da5185404e4d991960f56a10323f', 'request_id': 'req-2b7a8320-5d04-4678-99b7-095e8e1f3103'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:28.945750 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2b7a8320-5d04-4678-99b7-095e8e1f3103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d57da5185404e4d991960f56a10323f', 'request_id': 'req-2b7a8320-5d04-4678-99b7-095e8e1f3103'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:28.953003 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2b7a8320-5d04-4678-99b7-095e8e1f3103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d57da5185404e4d991960f56a10323f', 'request_id': 'req-2b7a8320-5d04-4678-99b7-095e8e1f3103'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:28.968483 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2b7a8320-5d04-4678-99b7-095e8e1f3103 admin admin] The token cache is being invalidate because project 1d57da5185404e4d991960f56a10323f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:15:28.968768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2b7a8320-5d04-4678-99b7-095e8e1f3103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:28.969464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2b7a8320-5d04-4678-99b7-095e8e1f3103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:28.970974 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1263/2530] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:15:28 2022] DELETE /identity/v3/projects/1d57da5185404e4d991960f56a10323f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:28.976111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedef03-f532-4c77-a10d-482d299e93d2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:28.976662 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedef03-f532-4c77-a10d-482d299e93d2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:28.977002 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedef03-f532-4c77-a10d-482d299e93d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:29.000422 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6bedef03-f532-4c77-a10d-482d299e93d2 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:29.001940 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6bedef03-f532-4c77-a10d-482d299e93d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:29.059307 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:29.069228 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1268/2531] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:29.079487 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4948f6c-1fb4-443c-ac96-84f32569dfe1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:29.079739 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4948f6c-1fb4-443c-ac96-84f32569dfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:29.079976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4948f6c-1fb4-443c-ac96-84f32569dfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:29.102864 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e4948f6c-1fb4-443c-ac96-84f32569dfe1 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:29.104101 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e4948f6c-1fb4-443c-ac96-84f32569dfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:29.112389 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1264/2532] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:15:29.116590 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedef03-f532-4c77-a10d-482d299e93d2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:29.126467 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedef03-f532-4c77-a10d-482d299e93d2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:29.131432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce790ee-6dcf-4ee3-b0a3-0025eb95b547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:29.131919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce790ee-6dcf-4ee3-b0a3-0025eb95b547 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:29.132172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce790ee-6dcf-4ee3-b0a3-0025eb95b547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:29.132436 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce790ee-6dcf-4ee3-b0a3-0025eb95b547 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:29.133082 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce790ee-6dcf-4ee3-b0a3-0025eb95b547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:15:29.133415 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce790ee-6dcf-4ee3-b0a3-0025eb95b547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:29.134981 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce790ee-6dcf-4ee3-b0a3-0025eb95b547 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:29.147348 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1269/2533] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:15:29.151238 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4948f6c-1fb4-443c-ac96-84f32569dfe1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:29.160257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4948f6c-1fb4-443c-ac96-84f32569dfe1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:29.164886 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecadb6-fc25-45d8-adfc-35a9ff5a9a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:29.165469 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecadb6-fc25-45d8-adfc-35a9ff5a9a3b admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:29.165739 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecadb6-fc25-45d8-adfc-35a9ff5a9a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:29.166006 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecadb6-fc25-45d8-adfc-35a9ff5a9a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:29.166618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecadb6-fc25-45d8-adfc-35a9ff5a9a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:29.169148 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecadb6-fc25-45d8-adfc-35a9ff5a9a3b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:29.198793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1265/2534] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:15:29 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:15:29.202663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce790ee-6dcf-4ee3-b0a3-0025eb95b547 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:29.212951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce790ee-6dcf-4ee3-b0a3-0025eb95b547 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:29.273167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4d596-4472-44d2-b51e-b2858b1e25d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:29.273771 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4d596-4472-44d2-b51e-b2858b1e25d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:29.274047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4d596-4472-44d2-b51e-b2858b1e25d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:29.274329 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4d596-4472-44d2-b51e-b2858b1e25d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:29.274932 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4d596-4472-44d2-b51e-b2858b1e25d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:29.277542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4d596-4472-44d2-b51e-b2858b1e25d3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:29.298828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1270/2535] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:15:29 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:15:29.303125 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecadb6-fc25-45d8-adfc-35a9ff5a9a3b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:29.314875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecadb6-fc25-45d8-adfc-35a9ff5a9a3b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:29.320095 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555e365-a933-4375-af67-696bfa57c7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:29.320700 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555e365-a933-4375-af67-696bfa57c7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:29.320959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555e365-a933-4375-af67-696bfa57c7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:29.321215 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555e365-a933-4375-af67-696bfa57c7d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:29.321841 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555e365-a933-4375-af67-696bfa57c7d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:29.324210 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555e365-a933-4375-af67-696bfa57c7d9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:29.338468 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1266/2536] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:15:29.342816 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4d596-4472-44d2-b51e-b2858b1e25d3 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:29.353000 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4d596-4472-44d2-b51e-b2858b1e25d3 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:29.358783 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dae62-ff2f-4b32-8071-38f554955988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:29.359070 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dae62-ff2f-4b32-8071-38f554955988 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:29.359379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dae62-ff2f-4b32-8071-38f554955988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:29.359740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dae62-ff2f-4b32-8071-38f554955988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:29.360312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dae62-ff2f-4b32-8071-38f554955988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:29.361899 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dae62-ff2f-4b32-8071-38f554955988 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:29.377792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1271/2537] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:15:29.381750 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555e365-a933-4375-af67-696bfa57c7d9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:29.392544 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555e365-a933-4375-af67-696bfa57c7d9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:29.397171 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b9a80-0f57-44d3-be7a-5cd67e7182e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:29.397822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b9a80-0f57-44d3-be7a-5cd67e7182e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:29.398100 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b9a80-0f57-44d3-be7a-5cd67e7182e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:29.398373 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b9a80-0f57-44d3-be7a-5cd67e7182e1 admin admin] PATH_INFO: `/v3/projects/a41f7a7549ac4886a1e23c1d5f5339b5/users/36f6789523434768b3f8256c1708e590/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:29.414928 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b9a80-0f57-44d3-be7a-5cd67e7182e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41f7a7549ac4886a1e23c1d5f5339b5, user_id=36f6789523434768b3f8256c1708e590, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:29.418841 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b9a80-0f57-44d3-be7a-5cd67e7182e1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:29.427890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:29.434020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1267/2538] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:15:29 2022] PUT /identity/v3/projects/a41f7a7549ac4886a1e23c1d5f5339b5/users/36f6789523434768b3f8256c1708e590/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:29.444577 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba2fde-2d76-416c-be46-20eb08a82fe8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:29.445236 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba2fde-2d76-416c-be46-20eb08a82fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:29.445527 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba2fde-2d76-416c-be46-20eb08a82fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:29.473858 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-66ba2fde-2d76-416c-be46-20eb08a82fe8 None None] MFA Rules not processed for user `36f6789523434768b3f8256c1708e590`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:29.475053 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-66ba2fde-2d76-416c-be46-20eb08a82fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:29.540749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1272/2539] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:29.552848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b9a80-0f57-44d3-be7a-5cd67e7182e1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:29.554510 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3d0b9a80-0f57-44d3-be7a-5cd67e7182e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:29.628247 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b9a80-0f57-44d3-be7a-5cd67e7182e1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:29.633736 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867baa7e-e971-4a90-8d95-16a5ecded4e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:29.634336 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867baa7e-e971-4a90-8d95-16a5ecded4e7 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:29.634609 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867baa7e-e971-4a90-8d95-16a5ecded4e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:29.634875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867baa7e-e971-4a90-8d95-16a5ecded4e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:29.642852 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867baa7e-e971-4a90-8d95-16a5ecded4e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:29.644448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867baa7e-e971-4a90-8d95-16a5ecded4e7 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:29.653824 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1268/2540] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:15:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:15:34.843681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba2fde-2d76-416c-be46-20eb08a82fe8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:34.901641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:34.909337 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba2fde-2d76-416c-be46-20eb08a82fe8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:34.914051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2100030-2d7e-48a1-9b9b-46c24185aa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:34.914699 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2100030-2d7e-48a1-9b9b-46c24185aa64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:34.914960 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2100030-2d7e-48a1-9b9b-46c24185aa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:34.915269 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2100030-2d7e-48a1-9b9b-46c24185aa64 admin admin] PATH_INFO: `/v3/users/36f6789523434768b3f8256c1708e590` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:34.916389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2100030-2d7e-48a1-9b9b-46c24185aa64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36f6789523434768b3f8256c1708e590)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:34.918528 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2100030-2d7e-48a1-9b9b-46c24185aa64 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:34.968055 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e2100030-2d7e-48a1-9b9b-46c24185aa64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36f6789523434768b3f8256c1708e590'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:34.975378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e2100030-2d7e-48a1-9b9b-46c24185aa64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36f6789523434768b3f8256c1708e590'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:34.975947 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e2100030-2d7e-48a1-9b9b-46c24185aa64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36f6789523434768b3f8256c1708e590'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:34.988360 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e2100030-2d7e-48a1-9b9b-46c24185aa64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36f6789523434768b3f8256c1708e590'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:34.995331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e2100030-2d7e-48a1-9b9b-46c24185aa64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36f6789523434768b3f8256c1708e590'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:35.001599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1273/2541] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:15:34 2022] DELETE /identity/v3/users/36f6789523434768b3f8256c1708e590 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:35.006031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7741a4-25a2-4518-8101-df8708e766b5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:35.006496 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7741a4-25a2-4518-8101-df8708e766b5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:35.006580 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7741a4-25a2-4518-8101-df8708e766b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:35.025365 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ee7741a4-25a2-4518-8101-df8708e766b5 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:35.026574 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ee7741a4-25a2-4518-8101-df8708e766b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:35.085062 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1269/2542] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:35.095405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2100030-2d7e-48a1-9b9b-46c24185aa64 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:35.096807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e2100030-2d7e-48a1-9b9b-46c24185aa64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:35.158318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2100030-2d7e-48a1-9b9b-46c24185aa64 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:35.162250 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f2d9d-2a09-459b-a596-fcc2ab22a611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:35.162859 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f2d9d-2a09-459b-a596-fcc2ab22a611 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:35.163188 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f2d9d-2a09-459b-a596-fcc2ab22a611 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:35.163457 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f2d9d-2a09-459b-a596-fcc2ab22a611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:35.173560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f2d9d-2a09-459b-a596-fcc2ab22a611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:35.174964 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f2d9d-2a09-459b-a596-fcc2ab22a611 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:35.185269 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1274/2543] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:15:35.466255 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7741a4-25a2-4518-8101-df8708e766b5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:35.467724 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ee7741a4-25a2-4518-8101-df8708e766b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:35.482562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7741a4-25a2-4518-8101-df8708e766b5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:35.487230 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca70e1-3601-4670-97c6-3d5dcff5b14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:35.487913 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca70e1-3601-4670-97c6-3d5dcff5b14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:35.488128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca70e1-3601-4670-97c6-3d5dcff5b14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:35.488394 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca70e1-3601-4670-97c6-3d5dcff5b14e admin admin] PATH_INFO: `/v3/projects/a41f7a7549ac4886a1e23c1d5f5339b5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:35.489502 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca70e1-3601-4670-97c6-3d5dcff5b14e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41f7a7549ac4886a1e23c1d5f5339b5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:35.491431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca70e1-3601-4670-97c6-3d5dcff5b14e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:35.558043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-66ca70e1-3601-4670-97c6-3d5dcff5b14e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41f7a7549ac4886a1e23c1d5f5339b5', 'request_id': 'req-66ca70e1-3601-4670-97c6-3d5dcff5b14e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:35.564925 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-66ca70e1-3601-4670-97c6-3d5dcff5b14e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41f7a7549ac4886a1e23c1d5f5339b5', 'request_id': 'req-66ca70e1-3601-4670-97c6-3d5dcff5b14e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:35.574696 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-66ca70e1-3601-4670-97c6-3d5dcff5b14e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41f7a7549ac4886a1e23c1d5f5339b5', 'request_id': 'req-66ca70e1-3601-4670-97c6-3d5dcff5b14e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:35.591760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-66ca70e1-3601-4670-97c6-3d5dcff5b14e admin admin] The token cache is being invalidate because project a41f7a7549ac4886a1e23c1d5f5339b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:15:35.592137 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-66ca70e1-3601-4670-97c6-3d5dcff5b14e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:35.593706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-66ca70e1-3601-4670-97c6-3d5dcff5b14e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:35.595468 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1270/2544] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:15:35 2022] DELETE /identity/v3/projects/a41f7a7549ac4886a1e23c1d5f5339b5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:35.600203 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707b1e2-144d-406f-936c-2aa34d8240ca None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:35.600726 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707b1e2-144d-406f-936c-2aa34d8240ca None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:35.601048 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707b1e2-144d-406f-936c-2aa34d8240ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:35.628719 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9707b1e2-144d-406f-936c-2aa34d8240ca None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:35.630170 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9707b1e2-144d-406f-936c-2aa34d8240ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:35.703829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1275/2545] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:35.712658 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38105d-7a93-4739-a239-7944b38a4e6a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:35.712938 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38105d-7a93-4739-a239-7944b38a4e6a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:35.713209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38105d-7a93-4739-a239-7944b38a4e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:35.735404 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fe38105d-7a93-4739-a239-7944b38a4e6a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:35.736626 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fe38105d-7a93-4739-a239-7944b38a4e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:35.746690 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1271/2546] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:35.750955 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707b1e2-144d-406f-936c-2aa34d8240ca None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:35.763741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707b1e2-144d-406f-936c-2aa34d8240ca None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:35.768932 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c08242-e766-45d2-a718-63223915aa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:35.769923 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c08242-e766-45d2-a718-63223915aa11 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:35.770452 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c08242-e766-45d2-a718-63223915aa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:35.770943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c08242-e766-45d2-a718-63223915aa11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:35.771883 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c08242-e766-45d2-a718-63223915aa11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:15:35.772438 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c08242-e766-45d2-a718-63223915aa11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:35.774365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c08242-e766-45d2-a718-63223915aa11 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:35.787376 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1276/2547] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:15:35.791832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38105d-7a93-4739-a239-7944b38a4e6a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:35.797079 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:35.804213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38105d-7a93-4739-a239-7944b38a4e6a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:35.812742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742116f-07d5-479f-a93d-399e7167a780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:35.813370 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742116f-07d5-479f-a93d-399e7167a780 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:35.813745 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742116f-07d5-479f-a93d-399e7167a780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:35.814084 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742116f-07d5-479f-a93d-399e7167a780 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:35.814780 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742116f-07d5-479f-a93d-399e7167a780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:35.818111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742116f-07d5-479f-a93d-399e7167a780 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:35.851285 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1272/2548] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:15:35 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:15:35.855408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c08242-e766-45d2-a718-63223915aa11 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:35.863326 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:35.867960 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c08242-e766-45d2-a718-63223915aa11 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:35.936098 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f39bac-33f6-4955-981d-60da18e46b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:35.936708 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f39bac-33f6-4955-981d-60da18e46b86 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:35.936983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f39bac-33f6-4955-981d-60da18e46b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:35.937255 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f39bac-33f6-4955-981d-60da18e46b86 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:35.937877 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f39bac-33f6-4955-981d-60da18e46b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:35.939880 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f39bac-33f6-4955-981d-60da18e46b86 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:35.968964 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1277/2549] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:15:35 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:15:35.973032 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742116f-07d5-479f-a93d-399e7167a780 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:35.986073 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742116f-07d5-479f-a93d-399e7167a780 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:35.992380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30bb77-9185-4c18-b804-ceaf11eb5943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:35.993080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30bb77-9185-4c18-b804-ceaf11eb5943 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:35.993445 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30bb77-9185-4c18-b804-ceaf11eb5943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:35.993799 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30bb77-9185-4c18-b804-ceaf11eb5943 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:35.994525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30bb77-9185-4c18-b804-ceaf11eb5943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:35.997027 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30bb77-9185-4c18-b804-ceaf11eb5943 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:36.010965 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1273/2550] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:15:36.012339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f39bac-33f6-4955-981d-60da18e46b86 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:36.022094 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f39bac-33f6-4955-981d-60da18e46b86 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:36.027569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3dfa1-dd4e-4351-8df9-7c8ab091aa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:36.029071 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3dfa1-dd4e-4351-8df9-7c8ab091aa73 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:36.029344 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3dfa1-dd4e-4351-8df9-7c8ab091aa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:36.030045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3dfa1-dd4e-4351-8df9-7c8ab091aa73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:36.030766 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3dfa1-dd4e-4351-8df9-7c8ab091aa73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:36.032546 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3dfa1-dd4e-4351-8df9-7c8ab091aa73 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:36.045202 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1278/2551] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:15:36.049536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30bb77-9185-4c18-b804-ceaf11eb5943 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:36.060721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30bb77-9185-4c18-b804-ceaf11eb5943 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:36.065837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d94c7-d644-4684-b237-81819041cc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:36.066557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d94c7-d644-4684-b237-81819041cc35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:36.066765 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d94c7-d644-4684-b237-81819041cc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:36.067166 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d94c7-d644-4684-b237-81819041cc35 admin admin] PATH_INFO: `/v3/projects/7f2a47c9d43e48f5b0016e8220bc2bcf/users/7ecbf83934b14282a424f14ea424765b/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:36.084473 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d94c7-d644-4684-b237-81819041cc35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2a47c9d43e48f5b0016e8220bc2bcf, user_id=7ecbf83934b14282a424f14ea424765b, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:36.087216 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d94c7-d644-4684-b237-81819041cc35 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:36.103168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1274/2552] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:15:36 2022] PUT /identity/v3/projects/7f2a47c9d43e48f5b0016e8220bc2bcf/users/7ecbf83934b14282a424f14ea424765b/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:36.110958 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2049a-fc49-4b54-a3db-84368ae23129 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:36.111274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2049a-fc49-4b54-a3db-84368ae23129 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:36.111543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2049a-fc49-4b54-a3db-84368ae23129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:36.142065 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b9a2049a-fc49-4b54-a3db-84368ae23129 None None] MFA Rules not processed for user `7ecbf83934b14282a424f14ea424765b`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:36.143319 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b9a2049a-fc49-4b54-a3db-84368ae23129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:36.206613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1279/2553] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:36.218445 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d94c7-d644-4684-b237-81819041cc35 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:36.220286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0e3d94c7-d644-4684-b237-81819041cc35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:36.295257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d94c7-d644-4684-b237-81819041cc35 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:36.301002 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120879a-3811-449e-90da-6423f3e6dd31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:36.301619 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120879a-3811-449e-90da-6423f3e6dd31 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:36.301899 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120879a-3811-449e-90da-6423f3e6dd31 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:36.302176 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120879a-3811-449e-90da-6423f3e6dd31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:36.311337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120879a-3811-449e-90da-6423f3e6dd31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:36.312663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120879a-3811-449e-90da-6423f3e6dd31 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:36.322426 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1275/2554] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:15:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:15:36.554073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2049a-fc49-4b54-a3db-84368ae23129 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:36.620109 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2049a-fc49-4b54-a3db-84368ae23129 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:36.625113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4694d5-0861-444a-8a69-f64f2f3c9c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:36.625738 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4694d5-0861-444a-8a69-f64f2f3c9c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:36.626020 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4694d5-0861-444a-8a69-f64f2f3c9c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:36.626292 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4694d5-0861-444a-8a69-f64f2f3c9c30 admin admin] PATH_INFO: `/v3/users/7ecbf83934b14282a424f14ea424765b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:36.627497 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4694d5-0861-444a-8a69-f64f2f3c9c30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ecbf83934b14282a424f14ea424765b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:36.629443 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4694d5-0861-444a-8a69-f64f2f3c9c30 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:36.644885 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:36.682405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2e4694d5-0861-444a-8a69-f64f2f3c9c30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ecbf83934b14282a424f14ea424765b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:36.689682 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2e4694d5-0861-444a-8a69-f64f2f3c9c30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ecbf83934b14282a424f14ea424765b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:36.690303 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2e4694d5-0861-444a-8a69-f64f2f3c9c30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ecbf83934b14282a424f14ea424765b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:36.702393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2e4694d5-0861-444a-8a69-f64f2f3c9c30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ecbf83934b14282a424f14ea424765b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:36.709241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2e4694d5-0861-444a-8a69-f64f2f3c9c30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ecbf83934b14282a424f14ea424765b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:36.715017 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1280/2555] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:15:36 2022] DELETE /identity/v3/users/7ecbf83934b14282a424f14ea424765b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:15:36.719582 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91a43-017a-4170-b4c6-bc9339520865 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:36.719867 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91a43-017a-4170-b4c6-bc9339520865 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:36.720141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91a43-017a-4170-b4c6-bc9339520865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:36.738758 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1da91a43-017a-4170-b4c6-bc9339520865 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:36.739987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1da91a43-017a-4170-b4c6-bc9339520865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:36.798671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1276/2556] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:36.808390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4694d5-0861-444a-8a69-f64f2f3c9c30 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:36.809782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2e4694d5-0861-444a-8a69-f64f2f3c9c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:36.866591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4694d5-0861-444a-8a69-f64f2f3c9c30 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:36.870139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849debd-df03-4aca-b1d9-3aa6507cbaee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:36.870775 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849debd-df03-4aca-b1d9-3aa6507cbaee service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:36.871051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849debd-df03-4aca-b1d9-3aa6507cbaee service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:36.871360 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849debd-df03-4aca-b1d9-3aa6507cbaee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:36.880241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849debd-df03-4aca-b1d9-3aa6507cbaee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:36.881642 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849debd-df03-4aca-b1d9-3aa6507cbaee service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:36.891514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1281/2557] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:15:37.164449 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da91a43-017a-4170-b4c6-bc9339520865 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:37.165898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1da91a43-017a-4170-b4c6-bc9339520865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:37.180171 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da91a43-017a-4170-b4c6-bc9339520865 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:37.185696 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7bb43-ecab-48ca-b015-6fe61c89b192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:37.186751 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7bb43-ecab-48ca-b015-6fe61c89b192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:37.187278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7bb43-ecab-48ca-b015-6fe61c89b192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:37.187649 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7bb43-ecab-48ca-b015-6fe61c89b192 admin admin] PATH_INFO: `/v3/projects/7f2a47c9d43e48f5b0016e8220bc2bcf` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:37.188829 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7bb43-ecab-48ca-b015-6fe61c89b192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2a47c9d43e48f5b0016e8220bc2bcf)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:37.190666 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7bb43-ecab-48ca-b015-6fe61c89b192 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:37.224687 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:37.243610 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a1a7bb43-ecab-48ca-b015-6fe61c89b192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2a47c9d43e48f5b0016e8220bc2bcf', 'request_id': 'req-a1a7bb43-ecab-48ca-b015-6fe61c89b192'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:37.250521 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a1a7bb43-ecab-48ca-b015-6fe61c89b192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2a47c9d43e48f5b0016e8220bc2bcf', 'request_id': 'req-a1a7bb43-ecab-48ca-b015-6fe61c89b192'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:37.256022 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a1a7bb43-ecab-48ca-b015-6fe61c89b192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2a47c9d43e48f5b0016e8220bc2bcf', 'request_id': 'req-a1a7bb43-ecab-48ca-b015-6fe61c89b192'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:37.268140 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a1a7bb43-ecab-48ca-b015-6fe61c89b192 admin admin] The token cache is being invalidate because project 7f2a47c9d43e48f5b0016e8220bc2bcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:15:37.268440 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a1a7bb43-ecab-48ca-b015-6fe61c89b192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:37.269040 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a1a7bb43-ecab-48ca-b015-6fe61c89b192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:37.270561 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1277/2558] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:15:37 2022] DELETE /identity/v3/projects/7f2a47c9d43e48f5b0016e8220bc2bcf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:37.275503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef92aaf-8fb6-4e5a-bacd-9a822befff74 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:37.275790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef92aaf-8fb6-4e5a-bacd-9a822befff74 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:37.276084 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef92aaf-8fb6-4e5a-bacd-9a822befff74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:37.296299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2ef92aaf-8fb6-4e5a-bacd-9a822befff74 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:37.297478 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2ef92aaf-8fb6-4e5a-bacd-9a822befff74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:37.357282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1282/2559] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:15:37.365239 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea437d8-d7e9-4f0b-a6fe-c82f8f0abd3e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:37.365520 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea437d8-d7e9-4f0b-a6fe-c82f8f0abd3e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:37.365788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea437d8-d7e9-4f0b-a6fe-c82f8f0abd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:37.388087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9ea437d8-d7e9-4f0b-a6fe-c82f8f0abd3e None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:37.389272 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9ea437d8-d7e9-4f0b-a6fe-c82f8f0abd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:37.397051 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1278/2560] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:37.401293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef92aaf-8fb6-4e5a-bacd-9a822befff74 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:37.411788 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef92aaf-8fb6-4e5a-bacd-9a822befff74 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:37.416214 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6df6b-4d60-4daf-8449-4b7b42e359cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:37.416798 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6df6b-4d60-4daf-8449-4b7b42e359cd admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:37.417072 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6df6b-4d60-4daf-8449-4b7b42e359cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:37.417336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6df6b-4d60-4daf-8449-4b7b42e359cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:37.418964 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6df6b-4d60-4daf-8449-4b7b42e359cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:15:37.419291 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6df6b-4d60-4daf-8449-4b7b42e359cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:37.420848 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6df6b-4d60-4daf-8449-4b7b42e359cd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:37.431900 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1283/2561] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:15:37.436707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea437d8-d7e9-4f0b-a6fe-c82f8f0abd3e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:37.445951 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea437d8-d7e9-4f0b-a6fe-c82f8f0abd3e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:37.450677 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7935d-24ab-486a-88c1-972c4fcec5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:37.451288 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7935d-24ab-486a-88c1-972c4fcec5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:37.451570 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7935d-24ab-486a-88c1-972c4fcec5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:37.451837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7935d-24ab-486a-88c1-972c4fcec5a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:37.452455 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7935d-24ab-486a-88c1-972c4fcec5a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:37.454325 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7935d-24ab-486a-88c1-972c4fcec5a7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:37.480871 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1279/2562] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:15:37 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:15:37.485021 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6df6b-4d60-4daf-8449-4b7b42e359cd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:37.494639 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6df6b-4d60-4daf-8449-4b7b42e359cd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:37.516444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:37.555256 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614be0a8-7f69-4ba3-98de-6bd1dfe2ea4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:37.555857 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614be0a8-7f69-4ba3-98de-6bd1dfe2ea4a admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:37.556135 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614be0a8-7f69-4ba3-98de-6bd1dfe2ea4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:37.556405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614be0a8-7f69-4ba3-98de-6bd1dfe2ea4a admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:37.557027 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614be0a8-7f69-4ba3-98de-6bd1dfe2ea4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:37.559061 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614be0a8-7f69-4ba3-98de-6bd1dfe2ea4a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:37.578781 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1284/2563] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:15:37 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:15:37.583005 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7935d-24ab-486a-88c1-972c4fcec5a7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:37.594246 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7935d-24ab-486a-88c1-972c4fcec5a7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:37.598902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d46d27-c124-4836-9fc2-7b5742effa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:37.599530 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d46d27-c124-4836-9fc2-7b5742effa18 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:37.599809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d46d27-c124-4836-9fc2-7b5742effa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:37.600080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d46d27-c124-4836-9fc2-7b5742effa18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:37.600747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d46d27-c124-4836-9fc2-7b5742effa18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:37.602317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d46d27-c124-4836-9fc2-7b5742effa18 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:37.612821 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1280/2564] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:15:37.616614 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614be0a8-7f69-4ba3-98de-6bd1dfe2ea4a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:37.627162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614be0a8-7f69-4ba3-98de-6bd1dfe2ea4a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:37.631635 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f932692-99b6-42f2-89fb-47edfe8c62a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:37.632613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f932692-99b6-42f2-89fb-47edfe8c62a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:37.632613 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f932692-99b6-42f2-89fb-47edfe8c62a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:37.632803 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f932692-99b6-42f2-89fb-47edfe8c62a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:37.633346 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f932692-99b6-42f2-89fb-47edfe8c62a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:37.634905 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f932692-99b6-42f2-89fb-47edfe8c62a2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:37.646230 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1285/2565] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:15:37.650360 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d46d27-c124-4836-9fc2-7b5742effa18 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:37.660446 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d46d27-c124-4836-9fc2-7b5742effa18 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:37.665000 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c589d9-61ee-4d10-97e7-71c6bcd814b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:37.665571 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c589d9-61ee-4d10-97e7-71c6bcd814b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:37.665845 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c589d9-61ee-4d10-97e7-71c6bcd814b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:37.666121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c589d9-61ee-4d10-97e7-71c6bcd814b9 admin admin] PATH_INFO: `/v3/projects/c13ef0d39d374ec69e56e8e0d9aed5ed/users/08da60db9f4643c8a8a114ddbc92b04b/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:37.680186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c589d9-61ee-4d10-97e7-71c6bcd814b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13ef0d39d374ec69e56e8e0d9aed5ed, user_id=08da60db9f4643c8a8a114ddbc92b04b, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:37.682811 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c589d9-61ee-4d10-97e7-71c6bcd814b9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:37.695730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1281/2566] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:15:37 2022] PUT /identity/v3/projects/c13ef0d39d374ec69e56e8e0d9aed5ed/users/08da60db9f4643c8a8a114ddbc92b04b/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:37.707519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d7db0-cd80-488e-ae50-10255d151206 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:37.707834 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d7db0-cd80-488e-ae50-10255d151206 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:37.708107 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d7db0-cd80-488e-ae50-10255d151206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:37.734524 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1b7d7db0-cd80-488e-ae50-10255d151206 None None] MFA Rules not processed for user `08da60db9f4643c8a8a114ddbc92b04b`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:37.735759 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1b7d7db0-cd80-488e-ae50-10255d151206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:37.799330 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1286/2567] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:37.803854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c589d9-61ee-4d10-97e7-71c6bcd814b9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:37.864889 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c589d9-61ee-4d10-97e7-71c6bcd814b9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:37.869612 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52d2db-d095-4bb5-a946-ea0552163dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:37.870206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52d2db-d095-4bb5-a946-ea0552163dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:37.870483 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52d2db-d095-4bb5-a946-ea0552163dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:37.870822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52d2db-d095-4bb5-a946-ea0552163dd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:37.871562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52d2db-d095-4bb5-a946-ea0552163dd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:37.873441 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52d2db-d095-4bb5-a946-ea0552163dd7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:37.899362 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1282/2568] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:15:37 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:15:37.904232 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d7db0-cd80-488e-ae50-10255d151206 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:37.914539 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d7db0-cd80-488e-ae50-10255d151206 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:37.969091 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522156b-8181-4708-8b3d-eee02f41faf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:37.969689 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522156b-8181-4708-8b3d-eee02f41faf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:37.969968 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522156b-8181-4708-8b3d-eee02f41faf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:37.970235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522156b-8181-4708-8b3d-eee02f41faf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:37.970855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522156b-8181-4708-8b3d-eee02f41faf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:37.972776 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522156b-8181-4708-8b3d-eee02f41faf2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:37.994290 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1287/2569] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:15:37 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:15:37.998290 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52d2db-d095-4bb5-a946-ea0552163dd7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:38.008252 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52d2db-d095-4bb5-a946-ea0552163dd7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:38.013446 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4e0ab-e31f-4966-a7d7-4985b17fb44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:38.014031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4e0ab-e31f-4966-a7d7-4985b17fb44b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:38.014303 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4e0ab-e31f-4966-a7d7-4985b17fb44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:38.014568 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4e0ab-e31f-4966-a7d7-4985b17fb44b admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:38.015231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4e0ab-e31f-4966-a7d7-4985b17fb44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:38.016801 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4e0ab-e31f-4966-a7d7-4985b17fb44b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:38.027013 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1283/2570] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:15:38.031722 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522156b-8181-4708-8b3d-eee02f41faf2 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:38.041646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522156b-8181-4708-8b3d-eee02f41faf2 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:38.047175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2348e-52f4-4a52-9360-54220dd12e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:38.047819 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2348e-52f4-4a52-9360-54220dd12e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:38.048098 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2348e-52f4-4a52-9360-54220dd12e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:38.048369 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2348e-52f4-4a52-9360-54220dd12e47 admin admin] PATH_INFO: `/v3/projects/fd38346e257c4681a11e1245165671e6/users/dc931a48aac74769859abf7469af92f7/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:38.063235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2348e-52f4-4a52-9360-54220dd12e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd38346e257c4681a11e1245165671e6, user_id=dc931a48aac74769859abf7469af92f7, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:38.065826 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2348e-52f4-4a52-9360-54220dd12e47 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:38.068848 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:38.080804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1288/2571] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:15:38 2022] PUT /identity/v3/projects/fd38346e257c4681a11e1245165671e6/users/dc931a48aac74769859abf7469af92f7/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:38.085062 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4e0ab-e31f-4966-a7d7-4985b17fb44b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:38.095166 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4e0ab-e31f-4966-a7d7-4985b17fb44b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:38.114753 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:38.151841 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e45392-7a8f-4514-b795-dae2a26d1794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:38.152576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e45392-7a8f-4514-b795-dae2a26d1794 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:38.152849 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e45392-7a8f-4514-b795-dae2a26d1794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:38.153123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e45392-7a8f-4514-b795-dae2a26d1794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:38.153748 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e45392-7a8f-4514-b795-dae2a26d1794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:38.155348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e45392-7a8f-4514-b795-dae2a26d1794 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:38.164744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1284/2572] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:15:38.169558 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2348e-52f4-4a52-9360-54220dd12e47 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:38.179767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2348e-52f4-4a52-9360-54220dd12e47 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:38.184368 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a80a0-a1a1-429b-8c10-766053b92baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:38.185005 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a80a0-a1a1-429b-8c10-766053b92baa admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:38.185283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a80a0-a1a1-429b-8c10-766053b92baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:38.185557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a80a0-a1a1-429b-8c10-766053b92baa admin admin] PATH_INFO: `/v3/projects/fd38346e257c4681a11e1245165671e6/users/dc931a48aac74769859abf7469af92f7/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:38.187472 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a80a0-a1a1-429b-8c10-766053b92baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd38346e257c4681a11e1245165671e6, user_id=dc931a48aac74769859abf7469af92f7, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:38.190079 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a80a0-a1a1-429b-8c10-766053b92baa admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:38.201220 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1289/2573] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:15:38 2022] PUT /identity/v3/projects/fd38346e257c4681a11e1245165671e6/users/dc931a48aac74769859abf7469af92f7/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:38.211034 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77886bab-7a57-4eef-a5b4-d67b7957fa87 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:38.211410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77886bab-7a57-4eef-a5b4-d67b7957fa87 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:38.211689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77886bab-7a57-4eef-a5b4-d67b7957fa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:38.238823 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-77886bab-7a57-4eef-a5b4-d67b7957fa87 None None] MFA Rules not processed for user `dc931a48aac74769859abf7469af92f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:38.239985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-77886bab-7a57-4eef-a5b4-d67b7957fa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:38.309948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1285/2574] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:38.321629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a80a0-a1a1-429b-8c10-766053b92baa admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:38.323431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e24a80a0-a1a1-429b-8c10-766053b92baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:38.381616 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a80a0-a1a1-429b-8c10-766053b92baa admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:38.385344 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7abf0-a647-4152-8332-633c46955a57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:38.385935 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7abf0-a647-4152-8332-633c46955a57 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:38.386239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7abf0-a647-4152-8332-633c46955a57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:38.387069 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7abf0-a647-4152-8332-633c46955a57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:38.395748 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7abf0-a647-4152-8332-633c46955a57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:38.397171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7abf0-a647-4152-8332-633c46955a57 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:38.406228 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1290/2575] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:15:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:15:38.822303 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77886bab-7a57-4eef-a5b4-d67b7957fa87 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:38.884658 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77886bab-7a57-4eef-a5b4-d67b7957fa87 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:38.889948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401a668-fe91-40cd-b76a-085f01dbf317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:38.890568 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401a668-fe91-40cd-b76a-085f01dbf317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:38.890842 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401a668-fe91-40cd-b76a-085f01dbf317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:38.891254 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401a668-fe91-40cd-b76a-085f01dbf317 admin admin] PATH_INFO: `/v3/users/08da60db9f4643c8a8a114ddbc92b04b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:38.892355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401a668-fe91-40cd-b76a-085f01dbf317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08da60db9f4643c8a8a114ddbc92b04b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:38.894245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401a668-fe91-40cd-b76a-085f01dbf317 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:38.946574 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3401a668-fe91-40cd-b76a-085f01dbf317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08da60db9f4643c8a8a114ddbc92b04b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:38.947266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3401a668-fe91-40cd-b76a-085f01dbf317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08da60db9f4643c8a8a114ddbc92b04b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:38.947883 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3401a668-fe91-40cd-b76a-085f01dbf317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08da60db9f4643c8a8a114ddbc92b04b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:38.949117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:38.956872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3401a668-fe91-40cd-b76a-085f01dbf317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08da60db9f4643c8a8a114ddbc92b04b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:38.963675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3401a668-fe91-40cd-b76a-085f01dbf317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08da60db9f4643c8a8a114ddbc92b04b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:38.981275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1286/2576] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:15:38 2022] DELETE /identity/v3/users/08da60db9f4643c8a8a114ddbc92b04b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:38.985740 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cc6d4-ed7a-4607-9974-7d1fe6fd071b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:38.986204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cc6d4-ed7a-4607-9974-7d1fe6fd071b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:38.986326 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cc6d4-ed7a-4607-9974-7d1fe6fd071b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:39.005290 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7c3cc6d4-ed7a-4607-9974-7d1fe6fd071b None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:39.006434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7c3cc6d4-ed7a-4607-9974-7d1fe6fd071b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:39.064816 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1291/2577] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:39.075295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401a668-fe91-40cd-b76a-085f01dbf317 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:39.076697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3401a668-fe91-40cd-b76a-085f01dbf317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:39.131444 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401a668-fe91-40cd-b76a-085f01dbf317 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:39.135033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789571d-64d9-4518-815d-2578a9a11523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:39.135651 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789571d-64d9-4518-815d-2578a9a11523 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:39.135925 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789571d-64d9-4518-815d-2578a9a11523 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:39.136190 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789571d-64d9-4518-815d-2578a9a11523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:39.147914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789571d-64d9-4518-815d-2578a9a11523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:39.150068 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789571d-64d9-4518-815d-2578a9a11523 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:39.159406 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1287/2578] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:15:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:15:39.433667 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cc6d4-ed7a-4607-9974-7d1fe6fd071b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:39.435107 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7c3cc6d4-ed7a-4607-9974-7d1fe6fd071b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:39.449526 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cc6d4-ed7a-4607-9974-7d1fe6fd071b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:39.454350 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202259a0-20a3-447e-bda6-20f01308646f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:39.454989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202259a0-20a3-447e-bda6-20f01308646f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:39.455419 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202259a0-20a3-447e-bda6-20f01308646f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:39.455691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202259a0-20a3-447e-bda6-20f01308646f admin admin] PATH_INFO: `/v3/projects/c13ef0d39d374ec69e56e8e0d9aed5ed` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:39.456820 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202259a0-20a3-447e-bda6-20f01308646f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13ef0d39d374ec69e56e8e0d9aed5ed)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:39.458760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202259a0-20a3-447e-bda6-20f01308646f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:39.506093 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-202259a0-20a3-447e-bda6-20f01308646f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13ef0d39d374ec69e56e8e0d9aed5ed', 'request_id': 'req-202259a0-20a3-447e-bda6-20f01308646f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:39.511324 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-202259a0-20a3-447e-bda6-20f01308646f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13ef0d39d374ec69e56e8e0d9aed5ed', 'request_id': 'req-202259a0-20a3-447e-bda6-20f01308646f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:39.517224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-202259a0-20a3-447e-bda6-20f01308646f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13ef0d39d374ec69e56e8e0d9aed5ed', 'request_id': 'req-202259a0-20a3-447e-bda6-20f01308646f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:39.528944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-202259a0-20a3-447e-bda6-20f01308646f admin admin] The token cache is being invalidate because project c13ef0d39d374ec69e56e8e0d9aed5ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:15:39.529222 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-202259a0-20a3-447e-bda6-20f01308646f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:39.529831 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-202259a0-20a3-447e-bda6-20f01308646f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:39.531301 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1292/2579] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:15:39 2022] DELETE /identity/v3/projects/c13ef0d39d374ec69e56e8e0d9aed5ed => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:39.535193 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789571d-64d9-4518-815d-2578a9a11523 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:39.545490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789571d-64d9-4518-815d-2578a9a11523 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:39.602066 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6825f-d715-44a6-904c-38b9456aae16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:39.602689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6825f-d715-44a6-904c-38b9456aae16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:39.602975 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6825f-d715-44a6-904c-38b9456aae16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:39.603276 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6825f-d715-44a6-904c-38b9456aae16 admin admin] PATH_INFO: `/v3/users/dc931a48aac74769859abf7469af92f7` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:39.604377 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6825f-d715-44a6-904c-38b9456aae16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc931a48aac74769859abf7469af92f7)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:39.606858 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6825f-d715-44a6-904c-38b9456aae16 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:39.653937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6cd6825f-d715-44a6-904c-38b9456aae16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc931a48aac74769859abf7469af92f7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:39.654589 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6cd6825f-d715-44a6-904c-38b9456aae16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc931a48aac74769859abf7469af92f7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:39.655235 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6cd6825f-d715-44a6-904c-38b9456aae16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc931a48aac74769859abf7469af92f7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:39.662156 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6cd6825f-d715-44a6-904c-38b9456aae16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc931a48aac74769859abf7469af92f7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:39.669766 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6cd6825f-d715-44a6-904c-38b9456aae16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc931a48aac74769859abf7469af92f7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:39.675078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:39.689596 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1288/2580] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:15:39 2022] DELETE /identity/v3/users/dc931a48aac74769859abf7469af92f7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:39.960289 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202259a0-20a3-447e-bda6-20f01308646f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:39.961808 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-202259a0-20a3-447e-bda6-20f01308646f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:39.976041 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202259a0-20a3-447e-bda6-20f01308646f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:39.982338 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:40.036561 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5899fa-fdf2-4736-9dbd-703411f2e250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:40.037186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5899fa-fdf2-4736-9dbd-703411f2e250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:40.037390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5899fa-fdf2-4736-9dbd-703411f2e250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:40.037661 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5899fa-fdf2-4736-9dbd-703411f2e250 admin admin] PATH_INFO: `/v3/projects/fd38346e257c4681a11e1245165671e6` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:40.038772 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5899fa-fdf2-4736-9dbd-703411f2e250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd38346e257c4681a11e1245165671e6)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:40.040801 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5899fa-fdf2-4736-9dbd-703411f2e250 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:40.086113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8d5899fa-fdf2-4736-9dbd-703411f2e250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd38346e257c4681a11e1245165671e6', 'request_id': 'req-8d5899fa-fdf2-4736-9dbd-703411f2e250'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:40.091694 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8d5899fa-fdf2-4736-9dbd-703411f2e250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd38346e257c4681a11e1245165671e6', 'request_id': 'req-8d5899fa-fdf2-4736-9dbd-703411f2e250'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:40.097604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8d5899fa-fdf2-4736-9dbd-703411f2e250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd38346e257c4681a11e1245165671e6', 'request_id': 'req-8d5899fa-fdf2-4736-9dbd-703411f2e250'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:40.110014 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8d5899fa-fdf2-4736-9dbd-703411f2e250 admin admin] The token cache is being invalidate because project fd38346e257c4681a11e1245165671e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:15:40.110298 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8d5899fa-fdf2-4736-9dbd-703411f2e250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:40.110916 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8d5899fa-fdf2-4736-9dbd-703411f2e250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:40.112514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1293/2581] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:15:39 2022] DELETE /identity/v3/projects/fd38346e257c4681a11e1245165671e6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:15:40.117323 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03626d4e-553c-493e-8c61-e41884b091c8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:40.117676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03626d4e-553c-493e-8c61-e41884b091c8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:40.118023 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03626d4e-553c-493e-8c61-e41884b091c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:40.138735 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-03626d4e-553c-493e-8c61-e41884b091c8 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:40.139953 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-03626d4e-553c-493e-8c61-e41884b091c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:40.198484 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1289/2582] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:40.206626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc5584-b400-4c45-8348-658b51e4718b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:40.206935 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc5584-b400-4c45-8348-658b51e4718b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:40.207254 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc5584-b400-4c45-8348-658b51e4718b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:40.226365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-91bc5584-b400-4c45-8348-658b51e4718b None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:40.227590 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-91bc5584-b400-4c45-8348-658b51e4718b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:40.235827 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1294/2583] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:40.241362 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03626d4e-553c-493e-8c61-e41884b091c8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:40.251948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03626d4e-553c-493e-8c61-e41884b091c8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:40.256471 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7130813-c73d-48d5-b02b-97a0c593c12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:40.257073 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7130813-c73d-48d5-b02b-97a0c593c12d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:40.257332 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7130813-c73d-48d5-b02b-97a0c593c12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:40.257602 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7130813-c73d-48d5-b02b-97a0c593c12d admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:40.258239 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7130813-c73d-48d5-b02b-97a0c593c12d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:15:40.258541 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7130813-c73d-48d5-b02b-97a0c593c12d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:40.260170 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7130813-c73d-48d5-b02b-97a0c593c12d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:40.271948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1290/2584] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:15:40.276031 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc5584-b400-4c45-8348-658b51e4718b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:40.285171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc5584-b400-4c45-8348-658b51e4718b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:40.289797 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919522e-dce5-44c0-bb69-8291566b6d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:40.290326 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919522e-dce5-44c0-bb69-8291566b6d57 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:40.290598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919522e-dce5-44c0-bb69-8291566b6d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:40.290861 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919522e-dce5-44c0-bb69-8291566b6d57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:40.291506 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919522e-dce5-44c0-bb69-8291566b6d57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:40.293893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919522e-dce5-44c0-bb69-8291566b6d57 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:40.321111 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1295/2585] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:15:40 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:15:40.325387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7130813-c73d-48d5-b02b-97a0c593c12d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:40.335683 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7130813-c73d-48d5-b02b-97a0c593c12d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:40.393634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc006a-173c-4335-bd23-678a70810d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:40.394230 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc006a-173c-4335-bd23-678a70810d44 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:40.394507 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc006a-173c-4335-bd23-678a70810d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:40.394782 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc006a-173c-4335-bd23-678a70810d44 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:40.395438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc006a-173c-4335-bd23-678a70810d44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:40.397326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc006a-173c-4335-bd23-678a70810d44 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:40.419104 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1291/2586] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:15:40 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:15:40.423379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919522e-dce5-44c0-bb69-8291566b6d57 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:40.434774 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919522e-dce5-44c0-bb69-8291566b6d57 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:40.439383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fef5c-9bb2-4fd5-9668-7abcff253a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:40.439974 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fef5c-9bb2-4fd5-9668-7abcff253a73 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:40.440248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fef5c-9bb2-4fd5-9668-7abcff253a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:40.440518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fef5c-9bb2-4fd5-9668-7abcff253a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:40.441153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fef5c-9bb2-4fd5-9668-7abcff253a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:40.442708 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fef5c-9bb2-4fd5-9668-7abcff253a73 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:40.453702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1296/2587] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:15:40.457486 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc006a-173c-4335-bd23-678a70810d44 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:40.467757 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc006a-173c-4335-bd23-678a70810d44 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:40.472328 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b90aa-1095-4a77-a3a5-9e48483a1f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:40.472912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b90aa-1095-4a77-a3a5-9e48483a1f6e admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:40.473190 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b90aa-1095-4a77-a3a5-9e48483a1f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:40.473464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b90aa-1095-4a77-a3a5-9e48483a1f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:40.474096 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b90aa-1095-4a77-a3a5-9e48483a1f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:40.475695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b90aa-1095-4a77-a3a5-9e48483a1f6e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:40.487757 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1292/2588] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:15:40.492241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fef5c-9bb2-4fd5-9668-7abcff253a73 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:40.502943 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fef5c-9bb2-4fd5-9668-7abcff253a73 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:40.507584 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e422c9-4a15-468d-8d99-700f81352b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:40.508219 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e422c9-4a15-468d-8d99-700f81352b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:40.508511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e422c9-4a15-468d-8d99-700f81352b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:40.508762 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e422c9-4a15-468d-8d99-700f81352b86 admin admin] PATH_INFO: `/v3/projects/25c5990b77684d4ab6dbc397f9fcc6ac/users/ba8a35d478f8476fa81d8cea2e0aa543/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:40.523175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e422c9-4a15-468d-8d99-700f81352b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25c5990b77684d4ab6dbc397f9fcc6ac, user_id=ba8a35d478f8476fa81d8cea2e0aa543, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:40.525736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e422c9-4a15-468d-8d99-700f81352b86 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:40.538900 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1297/2589] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:15:40 2022] PUT /identity/v3/projects/25c5990b77684d4ab6dbc397f9fcc6ac/users/ba8a35d478f8476fa81d8cea2e0aa543/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:40.549656 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86c11d-f0fc-406c-8d87-84b45403c44b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:40.550125 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86c11d-f0fc-406c-8d87-84b45403c44b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:40.550125 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86c11d-f0fc-406c-8d87-84b45403c44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:40.577530 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1f86c11d-f0fc-406c-8d87-84b45403c44b None None] MFA Rules not processed for user `ba8a35d478f8476fa81d8cea2e0aa543`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:40.578732 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1f86c11d-f0fc-406c-8d87-84b45403c44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:40.619255 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:40.645224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1293/2590] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:40.649694 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e422c9-4a15-468d-8d99-700f81352b86 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:40.689014 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:40.713211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e422c9-4a15-468d-8d99-700f81352b86 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:40.717929 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa087d-1cbd-4e13-aa41-f834ce32b0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:40.718514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa087d-1cbd-4e13-aa41-f834ce32b0de admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:40.718792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa087d-1cbd-4e13-aa41-f834ce32b0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:40.719056 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa087d-1cbd-4e13-aa41-f834ce32b0de admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:40.719692 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa087d-1cbd-4e13-aa41-f834ce32b0de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:40.721538 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa087d-1cbd-4e13-aa41-f834ce32b0de admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:40.747526 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1298/2591] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:15:40 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:15:40.751698 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86c11d-f0fc-406c-8d87-84b45403c44b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:40.763355 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86c11d-f0fc-406c-8d87-84b45403c44b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:40.817724 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f803966-3664-49bf-93c9-d01e3861c529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:40.818268 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f803966-3664-49bf-93c9-d01e3861c529 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:40.818542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f803966-3664-49bf-93c9-d01e3861c529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:40.818815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f803966-3664-49bf-93c9-d01e3861c529 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:40.819454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f803966-3664-49bf-93c9-d01e3861c529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:40.821585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f803966-3664-49bf-93c9-d01e3861c529 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:40.843379 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1294/2592] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:15:40 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:15:40.847423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa087d-1cbd-4e13-aa41-f834ce32b0de admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:40.857766 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa087d-1cbd-4e13-aa41-f834ce32b0de admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:40.862821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad45e96-ea6e-4eb4-913c-2e4e16876bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:40.863434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad45e96-ea6e-4eb4-913c-2e4e16876bce admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:40.863709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad45e96-ea6e-4eb4-913c-2e4e16876bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:40.863976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad45e96-ea6e-4eb4-913c-2e4e16876bce admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:40.864601 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad45e96-ea6e-4eb4-913c-2e4e16876bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:40.866149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad45e96-ea6e-4eb4-913c-2e4e16876bce admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:40.877082 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1299/2593] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:15:40.881084 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f803966-3664-49bf-93c9-d01e3861c529 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:40.892388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f803966-3664-49bf-93c9-d01e3861c529 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:40.897042 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526a14f-ab1d-4fe4-ab0c-7c171ac73389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:40.897676 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a14f-ab1d-4fe4-ab0c-7c171ac73389 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:40.897952 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a14f-ab1d-4fe4-ab0c-7c171ac73389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:40.898222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a14f-ab1d-4fe4-ab0c-7c171ac73389 admin admin] PATH_INFO: `/v3/projects/c725c46d94d546bbb693df475ecd3a9a/users/6ef4d2da92ba480cadca0a4132ec9b94/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:40.913206 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526a14f-ab1d-4fe4-ab0c-7c171ac73389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c725c46d94d546bbb693df475ecd3a9a, user_id=6ef4d2da92ba480cadca0a4132ec9b94, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:40.915843 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526a14f-ab1d-4fe4-ab0c-7c171ac73389 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:40.929410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1295/2594] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:15:40 2022] PUT /identity/v3/projects/c725c46d94d546bbb693df475ecd3a9a/users/6ef4d2da92ba480cadca0a4132ec9b94/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:40.934213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad45e96-ea6e-4eb4-913c-2e4e16876bce admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:40.943911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad45e96-ea6e-4eb4-913c-2e4e16876bce admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:40.999978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bbad0-0719-4932-b081-82404e97e491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:41.000572 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bbad0-0719-4932-b081-82404e97e491 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:41.000846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bbad0-0719-4932-b081-82404e97e491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:41.001113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bbad0-0719-4932-b081-82404e97e491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:41.001736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bbad0-0719-4932-b081-82404e97e491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:41.003349 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bbad0-0719-4932-b081-82404e97e491 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:41.012660 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1300/2595] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:15:41.016862 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526a14f-ab1d-4fe4-ab0c-7c171ac73389 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:41.027168 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526a14f-ab1d-4fe4-ab0c-7c171ac73389 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:41.032007 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0267000-1c74-4ef1-b2ac-a7200b6d6414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:41.032650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0267000-1c74-4ef1-b2ac-a7200b6d6414 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:41.032925 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0267000-1c74-4ef1-b2ac-a7200b6d6414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:41.033196 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0267000-1c74-4ef1-b2ac-a7200b6d6414 admin admin] PATH_INFO: `/v3/projects/c725c46d94d546bbb693df475ecd3a9a/users/6ef4d2da92ba480cadca0a4132ec9b94/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:41.035220 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0267000-1c74-4ef1-b2ac-a7200b6d6414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c725c46d94d546bbb693df475ecd3a9a, user_id=6ef4d2da92ba480cadca0a4132ec9b94, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:41.037857 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0267000-1c74-4ef1-b2ac-a7200b6d6414 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:41.048709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1296/2596] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:15:41 2022] PUT /identity/v3/projects/c725c46d94d546bbb693df475ecd3a9a/users/6ef4d2da92ba480cadca0a4132ec9b94/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:41.060143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13810da-43c8-4516-b3a6-85ee29576056 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:41.060621 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13810da-43c8-4516-b3a6-85ee29576056 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:41.060720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13810da-43c8-4516-b3a6-85ee29576056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:41.087378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a13810da-43c8-4516-b3a6-85ee29576056 None None] MFA Rules not processed for user `6ef4d2da92ba480cadca0a4132ec9b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:41.088496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a13810da-43c8-4516-b3a6-85ee29576056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:41.157094 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1301/2597] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:41.168337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0267000-1c74-4ef1-b2ac-a7200b6d6414 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:41.169997 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a0267000-1c74-4ef1-b2ac-a7200b6d6414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:41.227940 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0267000-1c74-4ef1-b2ac-a7200b6d6414 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:41.232094 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421d89b-a04c-4eb4-8753-05d13ee88fd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:41.232698 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421d89b-a04c-4eb4-8753-05d13ee88fd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:41.232977 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421d89b-a04c-4eb4-8753-05d13ee88fd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:41.233248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421d89b-a04c-4eb4-8753-05d13ee88fd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:41.242193 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421d89b-a04c-4eb4-8753-05d13ee88fd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:41.243667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421d89b-a04c-4eb4-8753-05d13ee88fd3 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:41.253653 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1297/2598] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:15:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:15:41.328617 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13810da-43c8-4516-b3a6-85ee29576056 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:41.338083 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13810da-43c8-4516-b3a6-85ee29576056 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:41.341668 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8bcef-28e1-4c31-9271-a22cd82636d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:41.342248 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8bcef-28e1-4c31-9271-a22cd82636d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:41.342519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8bcef-28e1-4c31-9271-a22cd82636d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:41.342821 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8bcef-28e1-4c31-9271-a22cd82636d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:41.372636 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:41.401216 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8bcef-28e1-4c31-9271-a22cd82636d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:41.402626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8bcef-28e1-4c31-9271-a22cd82636d0 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:41.411312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1302/2599] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:15:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:15:44.121433 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421d89b-a04c-4eb4-8753-05d13ee88fd3 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:44.161879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:44.183822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421d89b-a04c-4eb4-8753-05d13ee88fd3 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:44.188921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13e770-d3b6-462d-8955-919a16c87326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:44.189536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13e770-d3b6-462d-8955-919a16c87326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:44.189807 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13e770-d3b6-462d-8955-919a16c87326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:44.190071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13e770-d3b6-462d-8955-919a16c87326 admin admin] PATH_INFO: `/v3/users/ba8a35d478f8476fa81d8cea2e0aa543` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:44.191192 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13e770-d3b6-462d-8955-919a16c87326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba8a35d478f8476fa81d8cea2e0aa543)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:44.193080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13e770-d3b6-462d-8955-919a16c87326 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:44.237747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3a13e770-d3b6-462d-8955-919a16c87326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba8a35d478f8476fa81d8cea2e0aa543'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:44.238385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3a13e770-d3b6-462d-8955-919a16c87326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba8a35d478f8476fa81d8cea2e0aa543'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:44.238982 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3a13e770-d3b6-462d-8955-919a16c87326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba8a35d478f8476fa81d8cea2e0aa543'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:44.245697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3a13e770-d3b6-462d-8955-919a16c87326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba8a35d478f8476fa81d8cea2e0aa543'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:44.253067 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3a13e770-d3b6-462d-8955-919a16c87326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba8a35d478f8476fa81d8cea2e0aa543'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:44.270860 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1298/2600] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:15:44 2022] DELETE /identity/v3/users/ba8a35d478f8476fa81d8cea2e0aa543 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:44.275400 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc858fd-73b1-4c2f-a850-5f06f35b0c03 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:44.275883 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc858fd-73b1-4c2f-a850-5f06f35b0c03 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:44.275991 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc858fd-73b1-4c2f-a850-5f06f35b0c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:44.294998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8cc858fd-73b1-4c2f-a850-5f06f35b0c03 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:44.296220 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8cc858fd-73b1-4c2f-a850-5f06f35b0c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:44.354804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1303/2601] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:44.365260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13e770-d3b6-462d-8955-919a16c87326 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:44.366646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3a13e770-d3b6-462d-8955-919a16c87326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:44.424220 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13e770-d3b6-462d-8955-919a16c87326 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:44.427909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182728fe-4127-49e2-b144-4c87f3688887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:44.428536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182728fe-4127-49e2-b144-4c87f3688887 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:44.428813 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182728fe-4127-49e2-b144-4c87f3688887 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:44.429085 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182728fe-4127-49e2-b144-4c87f3688887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:44.438897 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182728fe-4127-49e2-b144-4c87f3688887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:44.440359 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182728fe-4127-49e2-b144-4c87f3688887 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:44.449826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1299/2602] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:15:44.717109 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc858fd-73b1-4c2f-a850-5f06f35b0c03 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:44.718554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8cc858fd-73b1-4c2f-a850-5f06f35b0c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:44.730198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc858fd-73b1-4c2f-a850-5f06f35b0c03 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:44.735379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cdffc-8865-40cd-82ef-2b88cb2888bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:44.735999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cdffc-8865-40cd-82ef-2b88cb2888bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:44.736273 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cdffc-8865-40cd-82ef-2b88cb2888bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:44.736538 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cdffc-8865-40cd-82ef-2b88cb2888bf admin admin] PATH_INFO: `/v3/projects/25c5990b77684d4ab6dbc397f9fcc6ac` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:44.737667 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cdffc-8865-40cd-82ef-2b88cb2888bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=25c5990b77684d4ab6dbc397f9fcc6ac)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:44.739712 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cdffc-8865-40cd-82ef-2b88cb2888bf admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:44.787312 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-955cdffc-8865-40cd-82ef-2b88cb2888bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25c5990b77684d4ab6dbc397f9fcc6ac', 'request_id': 'req-955cdffc-8865-40cd-82ef-2b88cb2888bf'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:44.792811 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-955cdffc-8865-40cd-82ef-2b88cb2888bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25c5990b77684d4ab6dbc397f9fcc6ac', 'request_id': 'req-955cdffc-8865-40cd-82ef-2b88cb2888bf'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:44.799026 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-955cdffc-8865-40cd-82ef-2b88cb2888bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25c5990b77684d4ab6dbc397f9fcc6ac', 'request_id': 'req-955cdffc-8865-40cd-82ef-2b88cb2888bf'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:44.811626 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-955cdffc-8865-40cd-82ef-2b88cb2888bf admin admin] The token cache is being invalidate because project 25c5990b77684d4ab6dbc397f9fcc6ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:15:44.811908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-955cdffc-8865-40cd-82ef-2b88cb2888bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:44.812549 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-955cdffc-8865-40cd-82ef-2b88cb2888bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:44.813996 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1304/2603] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:15:44 2022] DELETE /identity/v3/projects/25c5990b77684d4ab6dbc397f9fcc6ac => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:44.817995 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182728fe-4127-49e2-b144-4c87f3688887 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:44.828310 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182728fe-4127-49e2-b144-4c87f3688887 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:44.884152 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfb5e0-d48e-4899-b085-fdf516075d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:44.884770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfb5e0-d48e-4899-b085-fdf516075d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:44.885044 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfb5e0-d48e-4899-b085-fdf516075d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:44.885337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfb5e0-d48e-4899-b085-fdf516075d40 admin admin] PATH_INFO: `/v3/users/6ef4d2da92ba480cadca0a4132ec9b94` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:44.886461 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfb5e0-d48e-4899-b085-fdf516075d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ef4d2da92ba480cadca0a4132ec9b94)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:44.889212 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfb5e0-d48e-4899-b085-fdf516075d40 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:44.890683 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:44.937177 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-29bfb5e0-d48e-4899-b085-fdf516075d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ef4d2da92ba480cadca0a4132ec9b94'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:44.937819 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-29bfb5e0-d48e-4899-b085-fdf516075d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ef4d2da92ba480cadca0a4132ec9b94'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:44.938416 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-29bfb5e0-d48e-4899-b085-fdf516075d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ef4d2da92ba480cadca0a4132ec9b94'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:44.945564 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-29bfb5e0-d48e-4899-b085-fdf516075d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ef4d2da92ba480cadca0a4132ec9b94'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:44.953706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-29bfb5e0-d48e-4899-b085-fdf516075d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ef4d2da92ba480cadca0a4132ec9b94'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:44.971120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1300/2604] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:15:44 2022] DELETE /identity/v3/users/6ef4d2da92ba480cadca0a4132ec9b94 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:45.263824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cdffc-8865-40cd-82ef-2b88cb2888bf admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:45.265344 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-955cdffc-8865-40cd-82ef-2b88cb2888bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:45.279223 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cdffc-8865-40cd-82ef-2b88cb2888bf admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:45.326714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:45.336817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abb4b3-09fe-48d9-b68d-ae197a6abeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:45.337436 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abb4b3-09fe-48d9-b68d-ae197a6abeff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:45.337720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abb4b3-09fe-48d9-b68d-ae197a6abeff admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:45.337989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abb4b3-09fe-48d9-b68d-ae197a6abeff admin admin] PATH_INFO: `/v3/projects/c725c46d94d546bbb693df475ecd3a9a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:45.339297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abb4b3-09fe-48d9-b68d-ae197a6abeff admin admin] RBAC: Authorizing `identity:delete_project(project_id=c725c46d94d546bbb693df475ecd3a9a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:45.341902 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abb4b3-09fe-48d9-b68d-ae197a6abeff admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:45.387175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-10abb4b3-09fe-48d9-b68d-ae197a6abeff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c725c46d94d546bbb693df475ecd3a9a', 'request_id': 'req-10abb4b3-09fe-48d9-b68d-ae197a6abeff'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:45.393007 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-10abb4b3-09fe-48d9-b68d-ae197a6abeff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c725c46d94d546bbb693df475ecd3a9a', 'request_id': 'req-10abb4b3-09fe-48d9-b68d-ae197a6abeff'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:45.398871 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-10abb4b3-09fe-48d9-b68d-ae197a6abeff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c725c46d94d546bbb693df475ecd3a9a', 'request_id': 'req-10abb4b3-09fe-48d9-b68d-ae197a6abeff'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:45.410840 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-10abb4b3-09fe-48d9-b68d-ae197a6abeff admin admin] The token cache is being invalidate because project c725c46d94d546bbb693df475ecd3a9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:15:45.411155 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-10abb4b3-09fe-48d9-b68d-ae197a6abeff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:45.411760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-10abb4b3-09fe-48d9-b68d-ae197a6abeff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:15:45.413200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1305/2605] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:15:45 2022] DELETE /identity/v3/projects/c725c46d94d546bbb693df475ecd3a9a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:45.418196 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdde48d-3569-44bb-ad08-5f71012bf74f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:45.419306 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdde48d-3569-44bb-ad08-5f71012bf74f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:45.419459 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdde48d-3569-44bb-ad08-5f71012bf74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:45.438995 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3bdde48d-3569-44bb-ad08-5f71012bf74f None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:45.440217 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3bdde48d-3569-44bb-ad08-5f71012bf74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:45.499461 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1301/2606] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:45.508403 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4fa55-1f06-4312-8974-af8f7dfd2392 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:45.508681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4fa55-1f06-4312-8974-af8f7dfd2392 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:45.508951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4fa55-1f06-4312-8974-af8f7dfd2392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:45.527933 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4ec4fa55-1f06-4312-8974-af8f7dfd2392 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:45.529454 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4ec4fa55-1f06-4312-8974-af8f7dfd2392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:45.537121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1306/2607] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:45.541274 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdde48d-3569-44bb-ad08-5f71012bf74f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:45.551628 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdde48d-3569-44bb-ad08-5f71012bf74f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:45.556100 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4e381-0055-4f92-a466-91443b06f049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:45.556690 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4e381-0055-4f92-a466-91443b06f049 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:45.556967 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4e381-0055-4f92-a466-91443b06f049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:45.557238 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4e381-0055-4f92-a466-91443b06f049 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:45.557875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4e381-0055-4f92-a466-91443b06f049 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:15:45.558176 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4e381-0055-4f92-a466-91443b06f049 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:45.560506 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4e381-0055-4f92-a466-91443b06f049 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:45.571957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1302/2608] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:15:45.576649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4fa55-1f06-4312-8974-af8f7dfd2392 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:45.585694 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4fa55-1f06-4312-8974-af8f7dfd2392 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:45.590398 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc596b5f-1c16-4ec4-93d5-143dc68483bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:45.591614 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc596b5f-1c16-4ec4-93d5-143dc68483bf admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:45.591890 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc596b5f-1c16-4ec4-93d5-143dc68483bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:45.592156 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc596b5f-1c16-4ec4-93d5-143dc68483bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:45.592783 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc596b5f-1c16-4ec4-93d5-143dc68483bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:45.594687 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc596b5f-1c16-4ec4-93d5-143dc68483bf admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:45.621099 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1307/2609] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:15:45 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:15:45.625260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4e381-0055-4f92-a466-91443b06f049 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:45.635184 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4e381-0055-4f92-a466-91443b06f049 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:45.691362 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91365f4d-1fe3-48db-ad3c-d7c65716ffa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:45.691966 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91365f4d-1fe3-48db-ad3c-d7c65716ffa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:45.692245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91365f4d-1fe3-48db-ad3c-d7c65716ffa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:45.692518 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91365f4d-1fe3-48db-ad3c-d7c65716ffa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:45.693136 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91365f4d-1fe3-48db-ad3c-d7c65716ffa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:45.695332 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91365f4d-1fe3-48db-ad3c-d7c65716ffa4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:45.706400 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:45.718664 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1303/2610] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:15:45 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:15:45.722630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc596b5f-1c16-4ec4-93d5-143dc68483bf admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:45.732604 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc596b5f-1c16-4ec4-93d5-143dc68483bf admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:45.737191 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e330d9-7e12-4076-9754-977c24222fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:45.737771 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e330d9-7e12-4076-9754-977c24222fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:45.738041 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e330d9-7e12-4076-9754-977c24222fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:45.738313 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e330d9-7e12-4076-9754-977c24222fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:45.738940 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e330d9-7e12-4076-9754-977c24222fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:45.740513 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e330d9-7e12-4076-9754-977c24222fc8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:45.751234 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1308/2611] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:15:45.754788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91365f4d-1fe3-48db-ad3c-d7c65716ffa4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:45.765949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91365f4d-1fe3-48db-ad3c-d7c65716ffa4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:45.770606 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7d3aa-7be4-4287-9eba-1402856d30ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:45.771228 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7d3aa-7be4-4287-9eba-1402856d30ae admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:45.771505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7d3aa-7be4-4287-9eba-1402856d30ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:45.771774 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7d3aa-7be4-4287-9eba-1402856d30ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:45.772407 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7d3aa-7be4-4287-9eba-1402856d30ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:45.773970 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7d3aa-7be4-4287-9eba-1402856d30ae admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:45.784654 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1304/2612] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:15:45.788704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e330d9-7e12-4076-9754-977c24222fc8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:45.798288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e330d9-7e12-4076-9754-977c24222fc8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:45.802900 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bf71a-0c25-4017-bdb1-3c6092213f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:45.803553 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bf71a-0c25-4017-bdb1-3c6092213f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:45.803829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bf71a-0c25-4017-bdb1-3c6092213f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:45.804097 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bf71a-0c25-4017-bdb1-3c6092213f97 admin admin] PATH_INFO: `/v3/projects/12274dd0741240a591126694a36a49d7/users/2fe2114b9cf7467cb98830d3a5abc53e/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:45.818749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bf71a-0c25-4017-bdb1-3c6092213f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12274dd0741240a591126694a36a49d7, user_id=2fe2114b9cf7467cb98830d3a5abc53e, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:45.821616 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bf71a-0c25-4017-bdb1-3c6092213f97 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:45.835384 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1309/2613] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:15:45 2022] PUT /identity/v3/projects/12274dd0741240a591126694a36a49d7/users/2fe2114b9cf7467cb98830d3a5abc53e/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:45.840369 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b932ac5-c126-4852-af9d-f5acbaad867b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:45.840646 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b932ac5-c126-4852-af9d-f5acbaad867b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:45.840917 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b932ac5-c126-4852-af9d-f5acbaad867b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:45.859426 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7b932ac5-c126-4852-af9d-f5acbaad867b None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:45.860589 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7b932ac5-c126-4852-af9d-f5acbaad867b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:45.918734 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1305/2614] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:45.928905 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bf71a-0c25-4017-bdb1-3c6092213f97 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:45.930596 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-085bf71a-0c25-4017-bdb1-3c6092213f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:45.986528 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bf71a-0c25-4017-bdb1-3c6092213f97 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:45.990057 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23fce3-015b-4cfe-992e-64415b947271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:45.990643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23fce3-015b-4cfe-992e-64415b947271 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:45.990917 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23fce3-015b-4cfe-992e-64415b947271 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:45.991217 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23fce3-015b-4cfe-992e-64415b947271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:46.000363 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23fce3-015b-4cfe-992e-64415b947271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:46.001760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23fce3-015b-4cfe-992e-64415b947271 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:46.010807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1310/2615] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:15:46.656166 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24064f-9b03-4662-a243-284d37e3b8f5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:46.656706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24064f-9b03-4662-a243-284d37e3b8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:46.656888 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24064f-9b03-4662-a243-284d37e3b8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:46.690918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ac24064f-9b03-4662-a243-284d37e3b8f5 None None] MFA Rules not processed for user `2fe2114b9cf7467cb98830d3a5abc53e`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:46.692182 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ac24064f-9b03-4662-a243-284d37e3b8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:46.758911 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1306/2616] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:46.763828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23fce3-015b-4cfe-992e-64415b947271 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:46.773435 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23fce3-015b-4cfe-992e-64415b947271 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:46.777909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5223e6-7327-4337-8e2b-6be6f7f8e010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:46.778799 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5223e6-7327-4337-8e2b-6be6f7f8e010 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:46.779339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5223e6-7327-4337-8e2b-6be6f7f8e010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:46.779707 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5223e6-7327-4337-8e2b-6be6f7f8e010 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:46.780396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5223e6-7327-4337-8e2b-6be6f7f8e010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:46.782401 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5223e6-7327-4337-8e2b-6be6f7f8e010 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:46.804101 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:46.812091 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1311/2617] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:15:46 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:15:46.816179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24064f-9b03-4662-a243-284d37e3b8f5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:46.827199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24064f-9b03-4662-a243-284d37e3b8f5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:46.882190 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6f5ef-e3b7-44ce-83df-20700f926e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:46.882791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6f5ef-e3b7-44ce-83df-20700f926e7e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:46.883067 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6f5ef-e3b7-44ce-83df-20700f926e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:46.883368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6f5ef-e3b7-44ce-83df-20700f926e7e admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:46.883976 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6f5ef-e3b7-44ce-83df-20700f926e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:46.885869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6f5ef-e3b7-44ce-83df-20700f926e7e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:46.907004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1307/2618] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:15:46 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:15:46.911010 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5223e6-7327-4337-8e2b-6be6f7f8e010 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:46.921179 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5223e6-7327-4337-8e2b-6be6f7f8e010 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:46.925718 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9630e-19dc-4551-8a0f-58c2b20732ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:46.926305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9630e-19dc-4551-8a0f-58c2b20732ac admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:46.926582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9630e-19dc-4551-8a0f-58c2b20732ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:46.926853 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9630e-19dc-4551-8a0f-58c2b20732ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:46.927516 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9630e-19dc-4551-8a0f-58c2b20732ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:46.929106 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9630e-19dc-4551-8a0f-58c2b20732ac admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:46.939454 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1312/2619] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:15:46.943376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6f5ef-e3b7-44ce-83df-20700f926e7e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:46.950625 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:46.954508 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6f5ef-e3b7-44ce-83df-20700f926e7e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:46.960204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf279e-bb86-42b5-b6fc-fdb2a9b40e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:46.960877 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf279e-bb86-42b5-b6fc-fdb2a9b40e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:46.961155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf279e-bb86-42b5-b6fc-fdb2a9b40e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:46.961428 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf279e-bb86-42b5-b6fc-fdb2a9b40e93 admin admin] PATH_INFO: `/v3/projects/5234ed3640d8454489827dac5c4def89/users/f2236797f8264d579309a63c954f9d9d/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:46.976648 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf279e-bb86-42b5-b6fc-fdb2a9b40e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5234ed3640d8454489827dac5c4def89, user_id=f2236797f8264d579309a63c954f9d9d, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:46.979287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf279e-bb86-42b5-b6fc-fdb2a9b40e93 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:46.992307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1308/2620] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:15:46 2022] PUT /identity/v3/projects/5234ed3640d8454489827dac5c4def89/users/f2236797f8264d579309a63c954f9d9d/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:15:46.996219 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9630e-19dc-4551-8a0f-58c2b20732ac admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:47.005805 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9630e-19dc-4551-8a0f-58c2b20732ac admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:47.059365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352767f1-9987-466f-a6f6-d2487ed09bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:47.060078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352767f1-9987-466f-a6f6-d2487ed09bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:47.060353 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352767f1-9987-466f-a6f6-d2487ed09bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:47.060617 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352767f1-9987-466f-a6f6-d2487ed09bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:47.061247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352767f1-9987-466f-a6f6-d2487ed09bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:47.062796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352767f1-9987-466f-a6f6-d2487ed09bb9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:47.072414 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1313/2621] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:15:47.077226 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf279e-bb86-42b5-b6fc-fdb2a9b40e93 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:47.087319 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf279e-bb86-42b5-b6fc-fdb2a9b40e93 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:47.092743 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea579b-4b63-47ba-867c-7df6bf75df6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:47.093383 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea579b-4b63-47ba-867c-7df6bf75df6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:47.093655 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea579b-4b63-47ba-867c-7df6bf75df6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:47.093921 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea579b-4b63-47ba-867c-7df6bf75df6e admin admin] PATH_INFO: `/v3/projects/5234ed3640d8454489827dac5c4def89/users/f2236797f8264d579309a63c954f9d9d/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:47.095815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea579b-4b63-47ba-867c-7df6bf75df6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5234ed3640d8454489827dac5c4def89, user_id=f2236797f8264d579309a63c954f9d9d, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:47.098475 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea579b-4b63-47ba-867c-7df6bf75df6e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:47.108680 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1309/2622] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:15:47 2022] PUT /identity/v3/projects/5234ed3640d8454489827dac5c4def89/users/f2236797f8264d579309a63c954f9d9d/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:15:47.717018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a166bf-fed9-4243-a59c-b43e6b4e29fb None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:47.717326 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a166bf-fed9-4243-a59c-b43e6b4e29fb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:47.717594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a166bf-fed9-4243-a59c-b43e6b4e29fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:47.745519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e5a166bf-fed9-4243-a59c-b43e6b4e29fb None None] MFA Rules not processed for user `f2236797f8264d579309a63c954f9d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:47.746783 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e5a166bf-fed9-4243-a59c-b43e6b4e29fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:47.817690 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1314/2623] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:47.829075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66769e35-5845-4fa1-b591-0c068c0715e6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:47.829619 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66769e35-5845-4fa1-b591-0c068c0715e6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:47.829619 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66769e35-5845-4fa1-b591-0c068c0715e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:47.849368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-66769e35-5845-4fa1-b591-0c068c0715e6 None None] MFA Rules not processed for user `2fe2114b9cf7467cb98830d3a5abc53e`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:15:47.850558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-66769e35-5845-4fa1-b591-0c068c0715e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:47.907012 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1310/2624] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:15:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:15:47.922100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a166bf-fed9-4243-a59c-b43e6b4e29fb None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:15:47.923518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e5a166bf-fed9-4243-a59c-b43e6b4e29fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:15:47.996046 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a166bf-fed9-4243-a59c-b43e6b4e29fb None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:15:48.001414 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710f7e5-4d0b-463c-94d9-23f16c406a75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:15:48.002013 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710f7e5-4d0b-463c-94d9-23f16c406a75 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:15:48.002292 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710f7e5-4d0b-463c-94d9-23f16c406a75 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:15:48.002571 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710f7e5-4d0b-463c-94d9-23f16c406a75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:15:48.008055 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:48.010227 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710f7e5-4d0b-463c-94d9-23f16c406a75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:15:48.012147 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710f7e5-4d0b-463c-94d9-23f16c406a75 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:15:48.021384 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1315/2625] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:15:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:15:57.900201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=38,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:58.017375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:03.329225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66769e35-5845-4fa1-b591-0c068c0715e6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:03.330672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-66769e35-5845-4fa1-b591-0c068c0715e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:03.388750 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66769e35-5845-4fa1-b591-0c068c0715e6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:03.392378 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fe67f-e398-46b6-aafc-96a3b839a73b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:03.392980 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fe67f-e398-46b6-aafc-96a3b839a73b service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:03.393257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fe67f-e398-46b6-aafc-96a3b839a73b service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:03.393529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fe67f-e398-46b6-aafc-96a3b839a73b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:03.403452 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fe67f-e398-46b6-aafc-96a3b839a73b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:03.404870 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fe67f-e398-46b6-aafc-96a3b839a73b service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:03.414149 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1311/2626] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:16:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:16:13.410052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=26 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:22.445354 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710f7e5-4d0b-463c-94d9-23f16c406a75 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:22.446806 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7710f7e5-4d0b-463c-94d9-23f16c406a75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:22.519336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710f7e5-4d0b-463c-94d9-23f16c406a75 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:22.523640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a11095-43f6-485a-a54d-a24411ba5c0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07d2ee351e734fd09938cea9be3bb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:22.524273 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a11095-43f6-485a-a54d-a24411ba5c0b service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:22.524546 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a11095-43f6-485a-a54d-a24411ba5c0b service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:22.524814 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a11095-43f6-485a-a54d-a24411ba5c0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:22.526569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d4a11095-43f6-485a-a54d-a24411ba5c0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:22.538687 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a11095-43f6-485a-a54d-a24411ba5c0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:22.540283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a11095-43f6-485a-a54d-a24411ba5c0b service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:22.550653 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1316/2627] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:16:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:16:23.013223 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fe67f-e398-46b6-aafc-96a3b839a73b service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:23.076025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fe67f-e398-46b6-aafc-96a3b839a73b service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:23.080259 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1f002-3cbb-4639-b5d4-2ee1172704b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:23.080871 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1f002-3cbb-4639-b5d4-2ee1172704b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:23.081144 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1f002-3cbb-4639-b5d4-2ee1172704b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:23.081410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1f002-3cbb-4639-b5d4-2ee1172704b8 admin admin] PATH_INFO: `/v3/users/2fe2114b9cf7467cb98830d3a5abc53e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:23.082491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1f002-3cbb-4639-b5d4-2ee1172704b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fe2114b9cf7467cb98830d3a5abc53e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:23.084542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1f002-3cbb-4639-b5d4-2ee1172704b8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:23.130720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a0a1f002-3cbb-4639-b5d4-2ee1172704b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fe2114b9cf7467cb98830d3a5abc53e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.131388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a0a1f002-3cbb-4639-b5d4-2ee1172704b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fe2114b9cf7467cb98830d3a5abc53e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.131987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a0a1f002-3cbb-4639-b5d4-2ee1172704b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fe2114b9cf7467cb98830d3a5abc53e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.139688 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a0a1f002-3cbb-4639-b5d4-2ee1172704b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fe2114b9cf7467cb98830d3a5abc53e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.146952 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a0a1f002-3cbb-4639-b5d4-2ee1172704b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fe2114b9cf7467cb98830d3a5abc53e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.164784 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1312/2628] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:16:23 2022] DELETE /identity/v3/users/2fe2114b9cf7467cb98830d3a5abc53e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:16:23.336559 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a11095-43f6-485a-a54d-a24411ba5c0b service placement] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:23.353741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a11095-43f6-485a-a54d-a24411ba5c0b service placement] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:23.418909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509345df-c1c1-4268-9aac-91a7a2fa7b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:23.419518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509345df-c1c1-4268-9aac-91a7a2fa7b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:23.419794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509345df-c1c1-4268-9aac-91a7a2fa7b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:23.420062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509345df-c1c1-4268-9aac-91a7a2fa7b32 admin admin] PATH_INFO: `/v3/projects/12274dd0741240a591126694a36a49d7` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:23.421176 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509345df-c1c1-4268-9aac-91a7a2fa7b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12274dd0741240a591126694a36a49d7)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:23.423041 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509345df-c1c1-4268-9aac-91a7a2fa7b32 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:23.471038 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-509345df-c1c1-4268-9aac-91a7a2fa7b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12274dd0741240a591126694a36a49d7', 'request_id': 'req-509345df-c1c1-4268-9aac-91a7a2fa7b32'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.476346 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-509345df-c1c1-4268-9aac-91a7a2fa7b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12274dd0741240a591126694a36a49d7', 'request_id': 'req-509345df-c1c1-4268-9aac-91a7a2fa7b32'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.482257 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-509345df-c1c1-4268-9aac-91a7a2fa7b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12274dd0741240a591126694a36a49d7', 'request_id': 'req-509345df-c1c1-4268-9aac-91a7a2fa7b32'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.493966 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-509345df-c1c1-4268-9aac-91a7a2fa7b32 admin admin] The token cache is being invalidate because project 12274dd0741240a591126694a36a49d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:16:23.494234 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-509345df-c1c1-4268-9aac-91a7a2fa7b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.494836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-509345df-c1c1-4268-9aac-91a7a2fa7b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.496329 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1317/2629] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:16:23 2022] DELETE /identity/v3/projects/12274dd0741240a591126694a36a49d7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:16:23.500923 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1f002-3cbb-4639-b5d4-2ee1172704b8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:23.502292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a0a1f002-3cbb-4639-b5d4-2ee1172704b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:23.515352 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1f002-3cbb-4639-b5d4-2ee1172704b8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:23.569688 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747619d-4443-4e6d-a705-a2d258a6586a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:23.570304 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747619d-4443-4e6d-a705-a2d258a6586a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:23.570575 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747619d-4443-4e6d-a705-a2d258a6586a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:23.570840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747619d-4443-4e6d-a705-a2d258a6586a admin admin] PATH_INFO: `/v3/users/f2236797f8264d579309a63c954f9d9d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:23.571975 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747619d-4443-4e6d-a705-a2d258a6586a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2236797f8264d579309a63c954f9d9d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:23.573859 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747619d-4443-4e6d-a705-a2d258a6586a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:23.594154 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:23.620364 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e747619d-4443-4e6d-a705-a2d258a6586a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2236797f8264d579309a63c954f9d9d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.621059 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e747619d-4443-4e6d-a705-a2d258a6586a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2236797f8264d579309a63c954f9d9d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.622313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e747619d-4443-4e6d-a705-a2d258a6586a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2236797f8264d579309a63c954f9d9d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.631733 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e747619d-4443-4e6d-a705-a2d258a6586a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2236797f8264d579309a63c954f9d9d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.639389 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e747619d-4443-4e6d-a705-a2d258a6586a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2236797f8264d579309a63c954f9d9d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.656217 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1313/2630] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:16:23 2022] DELETE /identity/v3/users/f2236797f8264d579309a63c954f9d9d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:16:23.828914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509345df-c1c1-4268-9aac-91a7a2fa7b32 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:23.830498 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-509345df-c1c1-4268-9aac-91a7a2fa7b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:23.846486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509345df-c1c1-4268-9aac-91a7a2fa7b32 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:23.865133 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:23.907056 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76029314-59e7-49b1-b4d7-7cc137017ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:23.907708 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76029314-59e7-49b1-b4d7-7cc137017ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:23.907987 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76029314-59e7-49b1-b4d7-7cc137017ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:23.908260 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76029314-59e7-49b1-b4d7-7cc137017ecd admin admin] PATH_INFO: `/v3/projects/5234ed3640d8454489827dac5c4def89` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:23.909388 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76029314-59e7-49b1-b4d7-7cc137017ecd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5234ed3640d8454489827dac5c4def89)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:23.911373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76029314-59e7-49b1-b4d7-7cc137017ecd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:23.960349 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-76029314-59e7-49b1-b4d7-7cc137017ecd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5234ed3640d8454489827dac5c4def89', 'request_id': 'req-76029314-59e7-49b1-b4d7-7cc137017ecd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.966912 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-76029314-59e7-49b1-b4d7-7cc137017ecd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5234ed3640d8454489827dac5c4def89', 'request_id': 'req-76029314-59e7-49b1-b4d7-7cc137017ecd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.973043 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-76029314-59e7-49b1-b4d7-7cc137017ecd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5234ed3640d8454489827dac5c4def89', 'request_id': 'req-76029314-59e7-49b1-b4d7-7cc137017ecd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.986505 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-76029314-59e7-49b1-b4d7-7cc137017ecd admin admin] The token cache is being invalidate because project 5234ed3640d8454489827dac5c4def89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:16:23.986792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-76029314-59e7-49b1-b4d7-7cc137017ecd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.987413 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-76029314-59e7-49b1-b4d7-7cc137017ecd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:23.989096 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1318/2631] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:16:23 2022] DELETE /identity/v3/projects/5234ed3640d8454489827dac5c4def89 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:16:23.993905 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312734f6-5a2b-4ad4-ba12-246930d982d2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:23.994196 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312734f6-5a2b-4ad4-ba12-246930d982d2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:23.994500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312734f6-5a2b-4ad4-ba12-246930d982d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:24.014869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-312734f6-5a2b-4ad4-ba12-246930d982d2 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:16:24.016127 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-312734f6-5a2b-4ad4-ba12-246930d982d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:24.076006 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1314/2632] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:16:24.083517 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcf303-9f6e-40be-bc0d-f2b840987628 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:24.083801 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcf303-9f6e-40be-bc0d-f2b840987628 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:24.084073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcf303-9f6e-40be-bc0d-f2b840987628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:24.104169 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4ebcf303-9f6e-40be-bc0d-f2b840987628 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:16:24.105332 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4ebcf303-9f6e-40be-bc0d-f2b840987628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:24.113861 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1319/2633] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:16:24.118130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312734f6-5a2b-4ad4-ba12-246930d982d2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:24.127857 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312734f6-5a2b-4ad4-ba12-246930d982d2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:24.132394 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82733510-119e-4dc5-8eac-db1b46bdf422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:24.132978 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82733510-119e-4dc5-8eac-db1b46bdf422 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:24.133254 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82733510-119e-4dc5-8eac-db1b46bdf422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:24.133520 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82733510-119e-4dc5-8eac-db1b46bdf422 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:24.134153 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82733510-119e-4dc5-8eac-db1b46bdf422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:16:24.134451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82733510-119e-4dc5-8eac-db1b46bdf422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:24.136123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82733510-119e-4dc5-8eac-db1b46bdf422 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:24.147309 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1315/2634] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:16:24.151355 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcf303-9f6e-40be-bc0d-f2b840987628 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:24.160669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcf303-9f6e-40be-bc0d-f2b840987628 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:24.165213 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca78ff-d491-4b98-8dfb-df2f7c3ce27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:24.165785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca78ff-d491-4b98-8dfb-df2f7c3ce27b admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:24.166057 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca78ff-d491-4b98-8dfb-df2f7c3ce27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:24.166318 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca78ff-d491-4b98-8dfb-df2f7c3ce27b admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:24.166916 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca78ff-d491-4b98-8dfb-df2f7c3ce27b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:24.169381 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca78ff-d491-4b98-8dfb-df2f7c3ce27b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:24.196211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1320/2635] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:16:24 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:16:24.201274 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82733510-119e-4dc5-8eac-db1b46bdf422 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:24.211062 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82733510-119e-4dc5-8eac-db1b46bdf422 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:24.266340 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feca2ba-fc75-4dc7-bba8-46b176bac742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:24.266985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feca2ba-fc75-4dc7-bba8-46b176bac742 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:24.267296 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feca2ba-fc75-4dc7-bba8-46b176bac742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:24.267564 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feca2ba-fc75-4dc7-bba8-46b176bac742 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:24.268176 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feca2ba-fc75-4dc7-bba8-46b176bac742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:24.270046 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feca2ba-fc75-4dc7-bba8-46b176bac742 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:24.289815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1316/2636] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:16:24 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:16:24.294568 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca78ff-d491-4b98-8dfb-df2f7c3ce27b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:24.304698 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca78ff-d491-4b98-8dfb-df2f7c3ce27b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:24.309694 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c75ff9-60d3-4abc-a6e1-6325812637b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:24.310110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c75ff9-60d3-4abc-a6e1-6325812637b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:24.310386 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c75ff9-60d3-4abc-a6e1-6325812637b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:24.310658 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c75ff9-60d3-4abc-a6e1-6325812637b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:24.311322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c75ff9-60d3-4abc-a6e1-6325812637b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:24.312887 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c75ff9-60d3-4abc-a6e1-6325812637b0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:24.322846 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1321/2637] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:16:24.327411 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feca2ba-fc75-4dc7-bba8-46b176bac742 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:24.337025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feca2ba-fc75-4dc7-bba8-46b176bac742 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:24.342214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea5838-c6e1-4b32-83e7-ce15937f4c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:24.342790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea5838-c6e1-4b32-83e7-ce15937f4c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:24.343068 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea5838-c6e1-4b32-83e7-ce15937f4c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:24.343389 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea5838-c6e1-4b32-83e7-ce15937f4c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:24.344129 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea5838-c6e1-4b32-83e7-ce15937f4c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:24.345682 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea5838-c6e1-4b32-83e7-ce15937f4c15 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:24.355926 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1317/2638] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:16:24.359991 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c75ff9-60d3-4abc-a6e1-6325812637b0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:24.369644 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c75ff9-60d3-4abc-a6e1-6325812637b0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:24.374785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680222d4-14c1-43c7-accb-9ee3ad331935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:24.375548 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680222d4-14c1-43c7-accb-9ee3ad331935 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:24.375906 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680222d4-14c1-43c7-accb-9ee3ad331935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:24.376224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680222d4-14c1-43c7-accb-9ee3ad331935 admin admin] PATH_INFO: `/v3/projects/0b1445e893714b7e8146fecc0ec4f470/users/a2ab25a7c0a44d71959cc63d658e1b86/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:24.391189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680222d4-14c1-43c7-accb-9ee3ad331935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1445e893714b7e8146fecc0ec4f470, user_id=a2ab25a7c0a44d71959cc63d658e1b86, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:24.393819 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680222d4-14c1-43c7-accb-9ee3ad331935 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:24.406420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1322/2639] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:16:24 2022] PUT /identity/v3/projects/0b1445e893714b7e8146fecc0ec4f470/users/a2ab25a7c0a44d71959cc63d658e1b86/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:16:24.469949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15209c9b-acee-49fd-a2d6-9d5651d266db None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:24.470227 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15209c9b-acee-49fd-a2d6-9d5651d266db None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:24.470494 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15209c9b-acee-49fd-a2d6-9d5651d266db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:24.478480 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:24.499372 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-15209c9b-acee-49fd-a2d6-9d5651d266db None None] MFA Rules not processed for user `a2ab25a7c0a44d71959cc63d658e1b86`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:16:24.500562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-15209c9b-acee-49fd-a2d6-9d5651d266db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:24.561753 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1318/2640] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:16:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:16:24.566225 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680222d4-14c1-43c7-accb-9ee3ad331935 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:24.613484 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:24.629440 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680222d4-14c1-43c7-accb-9ee3ad331935 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:24.634189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8bfba-5e23-47ef-ae43-d246f48ce264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:24.634793 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8bfba-5e23-47ef-ae43-d246f48ce264 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:24.635073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8bfba-5e23-47ef-ae43-d246f48ce264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:24.635375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8bfba-5e23-47ef-ae43-d246f48ce264 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:24.636000 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8bfba-5e23-47ef-ae43-d246f48ce264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:24.638371 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8bfba-5e23-47ef-ae43-d246f48ce264 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:24.664325 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1323/2641] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:16:24 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:16:24.668603 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15209c9b-acee-49fd-a2d6-9d5651d266db None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:24.679026 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15209c9b-acee-49fd-a2d6-9d5651d266db None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:24.734652 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eb717-7a8d-46c1-aebd-98a37b5e0d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:24.735283 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eb717-7a8d-46c1-aebd-98a37b5e0d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:24.735557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eb717-7a8d-46c1-aebd-98a37b5e0d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:24.735825 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eb717-7a8d-46c1-aebd-98a37b5e0d5c admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:24.736437 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eb717-7a8d-46c1-aebd-98a37b5e0d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:24.738316 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eb717-7a8d-46c1-aebd-98a37b5e0d5c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:24.758906 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1319/2642] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:16:24 2022] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:16:24.763693 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8bfba-5e23-47ef-ae43-d246f48ce264 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:24.773715 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8bfba-5e23-47ef-ae43-d246f48ce264 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:24.779358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ac9a3-96b1-4f2e-a8e6-ae0f50b6cd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:24.779946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ac9a3-96b1-4f2e-a8e6-ae0f50b6cd03 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:24.780221 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ac9a3-96b1-4f2e-a8e6-ae0f50b6cd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:24.780486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ac9a3-96b1-4f2e-a8e6-ae0f50b6cd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:24.781121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ac9a3-96b1-4f2e-a8e6-ae0f50b6cd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:24.782681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ac9a3-96b1-4f2e-a8e6-ae0f50b6cd03 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:24.794975 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1324/2643] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:16:24.799277 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eb717-7a8d-46c1-aebd-98a37b5e0d5c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:24.808985 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eb717-7a8d-46c1-aebd-98a37b5e0d5c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:24.813877 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a910d0-9977-4ba9-b90c-68a26f4b1787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:24.814546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a910d0-9977-4ba9-b90c-68a26f4b1787 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:24.814844 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a910d0-9977-4ba9-b90c-68a26f4b1787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:24.815137 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a910d0-9977-4ba9-b90c-68a26f4b1787 admin admin] PATH_INFO: `/v3/projects/ef78bb64ab03420193cf783ce70dab34/users/cbb416904a3f4a8da380650923725096/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:24.829945 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a910d0-9977-4ba9-b90c-68a26f4b1787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef78bb64ab03420193cf783ce70dab34, user_id=cbb416904a3f4a8da380650923725096, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:24.832616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a910d0-9977-4ba9-b90c-68a26f4b1787 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:24.845699 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1320/2644] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:16:24 2022] PUT /identity/v3/projects/ef78bb64ab03420193cf783ce70dab34/users/cbb416904a3f4a8da380650923725096/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:16:24.849540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ac9a3-96b1-4f2e-a8e6-ae0f50b6cd03 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:24.860050 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ac9a3-96b1-4f2e-a8e6-ae0f50b6cd03 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:24.914532 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95113e-1a45-4c15-8342-1ad03226f368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:24.915053 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95113e-1a45-4c15-8342-1ad03226f368 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:24.915359 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95113e-1a45-4c15-8342-1ad03226f368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:24.915629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95113e-1a45-4c15-8342-1ad03226f368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:24.916257 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95113e-1a45-4c15-8342-1ad03226f368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:24.917819 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95113e-1a45-4c15-8342-1ad03226f368 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:24.927462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1325/2645] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:16:24.931627 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a910d0-9977-4ba9-b90c-68a26f4b1787 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:24.942408 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a910d0-9977-4ba9-b90c-68a26f4b1787 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:24.947240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbcb32-cbc3-40cf-b022-fbc7989b3d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:24.947875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbcb32-cbc3-40cf-b022-fbc7989b3d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:24.948146 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbcb32-cbc3-40cf-b022-fbc7989b3d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:24.948412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbcb32-cbc3-40cf-b022-fbc7989b3d34 admin admin] PATH_INFO: `/v3/projects/ef78bb64ab03420193cf783ce70dab34/users/cbb416904a3f4a8da380650923725096/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:24.950525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbcb32-cbc3-40cf-b022-fbc7989b3d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef78bb64ab03420193cf783ce70dab34, user_id=cbb416904a3f4a8da380650923725096, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:24.953138 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbcb32-cbc3-40cf-b022-fbc7989b3d34 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:24.962912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1321/2646] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:16:24 2022] PUT /identity/v3/projects/ef78bb64ab03420193cf783ce70dab34/users/cbb416904a3f4a8da380650923725096/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:16:24.973500 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aca17-ef34-4147-ad69-019794b82e0b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:24.973781 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aca17-ef34-4147-ad69-019794b82e0b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:24.974050 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aca17-ef34-4147-ad69-019794b82e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:25.002315 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b05aca17-ef34-4147-ad69-019794b82e0b None None] MFA Rules not processed for user `cbb416904a3f4a8da380650923725096`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:16:25.003534 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b05aca17-ef34-4147-ad69-019794b82e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:25.068347 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1326/2647] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:16:24 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:16:25.080667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbcb32-cbc3-40cf-b022-fbc7989b3d34 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:25.082387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-00dbcb32-cbc3-40cf-b022-fbc7989b3d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:25.134631 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:25.140211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbcb32-cbc3-40cf-b022-fbc7989b3d34 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:25.144483 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bcf03-e7c1-4190-9e06-f8ad46d20217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:25.145095 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bcf03-e7c1-4190-9e06-f8ad46d20217 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:25.145372 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bcf03-e7c1-4190-9e06-f8ad46d20217 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:25.145640 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bcf03-e7c1-4190-9e06-f8ad46d20217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:25.200655 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bcf03-e7c1-4190-9e06-f8ad46d20217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:25.202150 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bcf03-e7c1-4190-9e06-f8ad46d20217 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:25.210751 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1322/2648] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:16:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:16:29.410542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aca17-ef34-4147-ad69-019794b82e0b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:29.412057 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b05aca17-ef34-4147-ad69-019794b82e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:29.424817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aca17-ef34-4147-ad69-019794b82e0b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:29.428401 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597e3c9-14fd-4725-a589-4b45ae6c6071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:29.429035 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597e3c9-14fd-4725-a589-4b45ae6c6071 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:29.429311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597e3c9-14fd-4725-a589-4b45ae6c6071 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:29.429577 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597e3c9-14fd-4725-a589-4b45ae6c6071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:29.443336 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597e3c9-14fd-4725-a589-4b45ae6c6071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:29.445017 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597e3c9-14fd-4725-a589-4b45ae6c6071 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:29.455153 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1327/2649] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:16:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:16:34.326170 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bcf03-e7c1-4190-9e06-f8ad46d20217 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:34.387509 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bcf03-e7c1-4190-9e06-f8ad46d20217 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:34.392223 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7cf3a-5cea-4b24-bfcb-070a5d1d0b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:34.392842 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7cf3a-5cea-4b24-bfcb-070a5d1d0b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:34.393117 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7cf3a-5cea-4b24-bfcb-070a5d1d0b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:34.393407 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7cf3a-5cea-4b24-bfcb-070a5d1d0b12 admin admin] PATH_INFO: `/v3/users/a2ab25a7c0a44d71959cc63d658e1b86` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:34.394497 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7cf3a-5cea-4b24-bfcb-070a5d1d0b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ab25a7c0a44d71959cc63d658e1b86)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:34.396451 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7cf3a-5cea-4b24-bfcb-070a5d1d0b12 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:34.442014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5fd7cf3a-5cea-4b24-bfcb-070a5d1d0b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ab25a7c0a44d71959cc63d658e1b86'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:34.442655 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5fd7cf3a-5cea-4b24-bfcb-070a5d1d0b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ab25a7c0a44d71959cc63d658e1b86'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:34.443284 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5fd7cf3a-5cea-4b24-bfcb-070a5d1d0b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ab25a7c0a44d71959cc63d658e1b86'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:34.450381 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5fd7cf3a-5cea-4b24-bfcb-070a5d1d0b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ab25a7c0a44d71959cc63d658e1b86'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:34.458186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5fd7cf3a-5cea-4b24-bfcb-070a5d1d0b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ab25a7c0a44d71959cc63d658e1b86'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:34.475274 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1323/2650] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:16:34 2022] DELETE /identity/v3/users/a2ab25a7c0a44d71959cc63d658e1b86 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:16:34.479730 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a91da1-b82c-4df2-b0f5-90144ce9589a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:34.480206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a91da1-b82c-4df2-b0f5-90144ce9589a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:34.480310 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a91da1-b82c-4df2-b0f5-90144ce9589a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:34.500058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a3a91da1-b82c-4df2-b0f5-90144ce9589a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:16:34.501240 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a3a91da1-b82c-4df2-b0f5-90144ce9589a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:34.525575 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:34.560716 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1328/2651] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:16:34.570884 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7cf3a-5cea-4b24-bfcb-070a5d1d0b12 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:34.572327 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5fd7cf3a-5cea-4b24-bfcb-070a5d1d0b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:34.594041 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:34.631969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7cf3a-5cea-4b24-bfcb-070a5d1d0b12 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:34.635742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f55a35-71b8-426b-91a9-d6a114820374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:34.636351 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f55a35-71b8-426b-91a9-d6a114820374 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:34.636627 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f55a35-71b8-426b-91a9-d6a114820374 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:34.636900 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f55a35-71b8-426b-91a9-d6a114820374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:34.646791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f55a35-71b8-426b-91a9-d6a114820374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:34.648257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f55a35-71b8-426b-91a9-d6a114820374 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:34.657675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1324/2652] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:16:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:16:34.923731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a91da1-b82c-4df2-b0f5-90144ce9589a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:34.925235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a3a91da1-b82c-4df2-b0f5-90144ce9589a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:34.937819 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a91da1-b82c-4df2-b0f5-90144ce9589a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:34.942325 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a853a-80d6-49ba-9490-b035862cc315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:34.942964 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a853a-80d6-49ba-9490-b035862cc315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:34.943250 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a853a-80d6-49ba-9490-b035862cc315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:34.943575 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a853a-80d6-49ba-9490-b035862cc315 admin admin] PATH_INFO: `/v3/projects/0b1445e893714b7e8146fecc0ec4f470` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:34.945803 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a853a-80d6-49ba-9490-b035862cc315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1445e893714b7e8146fecc0ec4f470)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:34.947911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a853a-80d6-49ba-9490-b035862cc315 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:34.994116 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-263a853a-80d6-49ba-9490-b035862cc315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1445e893714b7e8146fecc0ec4f470', 'request_id': 'req-263a853a-80d6-49ba-9490-b035862cc315'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:35.000020 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-263a853a-80d6-49ba-9490-b035862cc315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1445e893714b7e8146fecc0ec4f470', 'request_id': 'req-263a853a-80d6-49ba-9490-b035862cc315'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:35.006242 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-263a853a-80d6-49ba-9490-b035862cc315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1445e893714b7e8146fecc0ec4f470', 'request_id': 'req-263a853a-80d6-49ba-9490-b035862cc315'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:35.018728 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-263a853a-80d6-49ba-9490-b035862cc315 admin admin] The token cache is being invalidate because project 0b1445e893714b7e8146fecc0ec4f470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:16:35.019009 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-263a853a-80d6-49ba-9490-b035862cc315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:35.019684 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-263a853a-80d6-49ba-9490-b035862cc315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:35.021148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1329/2653] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:16:34 2022] DELETE /identity/v3/projects/0b1445e893714b7e8146fecc0ec4f470 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:16:35.025112 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f55a35-71b8-426b-91a9-d6a114820374 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:35.034755 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f55a35-71b8-426b-91a9-d6a114820374 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:35.089616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92d94d-4684-43d2-88ac-fd1a12259f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:35.090232 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92d94d-4684-43d2-88ac-fd1a12259f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:35.090505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92d94d-4684-43d2-88ac-fd1a12259f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:35.090776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92d94d-4684-43d2-88ac-fd1a12259f39 admin admin] PATH_INFO: `/v3/users/cbb416904a3f4a8da380650923725096` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:35.091902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92d94d-4684-43d2-88ac-fd1a12259f39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbb416904a3f4a8da380650923725096)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:35.094119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92d94d-4684-43d2-88ac-fd1a12259f39 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:35.137461 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6a92d94d-4684-43d2-88ac-fd1a12259f39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbb416904a3f4a8da380650923725096'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:35.138090 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6a92d94d-4684-43d2-88ac-fd1a12259f39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbb416904a3f4a8da380650923725096'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:35.138678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6a92d94d-4684-43d2-88ac-fd1a12259f39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbb416904a3f4a8da380650923725096'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:35.145326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6a92d94d-4684-43d2-88ac-fd1a12259f39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbb416904a3f4a8da380650923725096'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:35.151588 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6a92d94d-4684-43d2-88ac-fd1a12259f39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbb416904a3f4a8da380650923725096'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:35.168987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1325/2654] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:16:35 2022] DELETE /identity/v3/users/cbb416904a3f4a8da380650923725096 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:16:35.439478 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a853a-80d6-49ba-9490-b035862cc315 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:35.441012 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-263a853a-80d6-49ba-9490-b035862cc315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:35.454151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a853a-80d6-49ba-9490-b035862cc315 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:35.511789 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472d1d8-9f60-42d1-b720-026f16923863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:35.512423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472d1d8-9f60-42d1-b720-026f16923863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:35.512738 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472d1d8-9f60-42d1-b720-026f16923863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:35.513006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472d1d8-9f60-42d1-b720-026f16923863 admin admin] PATH_INFO: `/v3/projects/ef78bb64ab03420193cf783ce70dab34` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:35.514110 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472d1d8-9f60-42d1-b720-026f16923863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef78bb64ab03420193cf783ce70dab34)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:35.516548 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472d1d8-9f60-42d1-b720-026f16923863 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:35.563693 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e472d1d8-9f60-42d1-b720-026f16923863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef78bb64ab03420193cf783ce70dab34', 'request_id': 'req-e472d1d8-9f60-42d1-b720-026f16923863'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:35.567404 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:35.569966 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e472d1d8-9f60-42d1-b720-026f16923863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef78bb64ab03420193cf783ce70dab34', 'request_id': 'req-e472d1d8-9f60-42d1-b720-026f16923863'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:35.576743 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e472d1d8-9f60-42d1-b720-026f16923863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef78bb64ab03420193cf783ce70dab34', 'request_id': 'req-e472d1d8-9f60-42d1-b720-026f16923863'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:35.589741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e472d1d8-9f60-42d1-b720-026f16923863 admin admin] The token cache is being invalidate because project ef78bb64ab03420193cf783ce70dab34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:16:35.590023 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e472d1d8-9f60-42d1-b720-026f16923863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:35.590665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e472d1d8-9f60-42d1-b720-026f16923863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:35.592176 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1330/2655] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:16:35 2022] DELETE /identity/v3/projects/ef78bb64ab03420193cf783ce70dab34 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:16:35.598710 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63461e-db93-4902-819d-8630d1055083 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:35.599262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63461e-db93-4902-819d-8630d1055083 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:35.599262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63461e-db93-4902-819d-8630d1055083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:35.619174 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ee63461e-db93-4902-819d-8630d1055083 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:16:35.620466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ee63461e-db93-4902-819d-8630d1055083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:35.660214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:35.685062 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1326/2656] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:16:35.695409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a6e0c-babf-4f91-8ae8-eb236513c05f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:35.696056 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a6e0c-babf-4f91-8ae8-eb236513c05f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:35.696328 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a6e0c-babf-4f91-8ae8-eb236513c05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:35.719521 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2e8a6e0c-babf-4f91-8ae8-eb236513c05f None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:16:35.720978 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2e8a6e0c-babf-4f91-8ae8-eb236513c05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:35.729891 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1331/2657] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:16:35.734262 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63461e-db93-4902-819d-8630d1055083 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:35.744242 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63461e-db93-4902-819d-8630d1055083 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:35.748892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b075b-c823-4691-8f2b-4624e5e62b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:35.749616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b075b-c823-4691-8f2b-4624e5e62b3c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:35.749898 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b075b-c823-4691-8f2b-4624e5e62b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:35.750174 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b075b-c823-4691-8f2b-4624e5e62b3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:35.750815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b075b-c823-4691-8f2b-4624e5e62b3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:16:35.751149 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b075b-c823-4691-8f2b-4624e5e62b3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:35.752764 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b075b-c823-4691-8f2b-4624e5e62b3c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:35.765753 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1327/2658] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:16:35.770753 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a6e0c-babf-4f91-8ae8-eb236513c05f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:35.779770 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a6e0c-babf-4f91-8ae8-eb236513c05f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:35.786539 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92279f56-cdba-423b-b8fd-218b71f5cda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:35.787172 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92279f56-cdba-423b-b8fd-218b71f5cda4 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:35.787454 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92279f56-cdba-423b-b8fd-218b71f5cda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:35.787726 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92279f56-cdba-423b-b8fd-218b71f5cda4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:35.788346 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92279f56-cdba-423b-b8fd-218b71f5cda4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:35.790234 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92279f56-cdba-423b-b8fd-218b71f5cda4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:35.818106 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1332/2659] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:16:35 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:16:35.822474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b075b-c823-4691-8f2b-4624e5e62b3c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:35.832940 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b075b-c823-4691-8f2b-4624e5e62b3c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:35.897551 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87165010-e9df-4373-bc18-792b5c72551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:35.898464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87165010-e9df-4373-bc18-792b5c72551e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:35.898844 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87165010-e9df-4373-bc18-792b5c72551e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:35.899256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87165010-e9df-4373-bc18-792b5c72551e admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:35.900880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87165010-e9df-4373-bc18-792b5c72551e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:35.903573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87165010-e9df-4373-bc18-792b5c72551e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:35.926792 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1328/2660] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:16:35 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:16:35.931272 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92279f56-cdba-423b-b8fd-218b71f5cda4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:35.948894 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92279f56-cdba-423b-b8fd-218b71f5cda4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:35.954389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac264984-847d-48ad-8d47-2c88131828ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:35.955003 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac264984-847d-48ad-8d47-2c88131828ab admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:35.955319 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac264984-847d-48ad-8d47-2c88131828ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:35.955595 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac264984-847d-48ad-8d47-2c88131828ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:35.956302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac264984-847d-48ad-8d47-2c88131828ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:35.958024 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac264984-847d-48ad-8d47-2c88131828ab admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:35.969369 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1333/2661] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:16:35.973462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87165010-e9df-4373-bc18-792b5c72551e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:35.984292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87165010-e9df-4373-bc18-792b5c72551e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:35.989337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19eeda9-5595-4a8a-848f-7453893b533b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:35.989949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19eeda9-5595-4a8a-848f-7453893b533b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:35.990247 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19eeda9-5595-4a8a-848f-7453893b533b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:35.990511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19eeda9-5595-4a8a-848f-7453893b533b admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:35.991185 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19eeda9-5595-4a8a-848f-7453893b533b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:35.992766 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19eeda9-5595-4a8a-848f-7453893b533b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:36.004102 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1329/2662] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:16:36.010198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac264984-847d-48ad-8d47-2c88131828ab admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:36.021145 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac264984-847d-48ad-8d47-2c88131828ab admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:36.025828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a87d55-fcea-45a4-8219-d8410258a386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:36.026472 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a87d55-fcea-45a4-8219-d8410258a386 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:36.026753 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a87d55-fcea-45a4-8219-d8410258a386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:36.027122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a87d55-fcea-45a4-8219-d8410258a386 admin admin] PATH_INFO: `/v3/projects/3938bb6e0826424ab042ae5db9768eec/users/37fa521c9e414a4485105e461ef28768/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:36.042591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a87d55-fcea-45a4-8219-d8410258a386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3938bb6e0826424ab042ae5db9768eec, user_id=37fa521c9e414a4485105e461ef28768, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:36.045237 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a87d55-fcea-45a4-8219-d8410258a386 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:36.064078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1334/2663] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:16:36 2022] PUT /identity/v3/projects/3938bb6e0826424ab042ae5db9768eec/users/37fa521c9e414a4485105e461ef28768/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:16:36.075324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788b146-aad8-4912-8a8f-e8401a4dadcb None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:36.075606 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788b146-aad8-4912-8a8f-e8401a4dadcb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:36.075877 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788b146-aad8-4912-8a8f-e8401a4dadcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:36.102779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7788b146-aad8-4912-8a8f-e8401a4dadcb None None] MFA Rules not processed for user `37fa521c9e414a4485105e461ef28768`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:16:36.104003 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7788b146-aad8-4912-8a8f-e8401a4dadcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:36.165441 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1330/2664] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:16:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:16:36.176918 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a87d55-fcea-45a4-8219-d8410258a386 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:36.178590 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-51a87d55-fcea-45a4-8219-d8410258a386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:36.235360 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a87d55-fcea-45a4-8219-d8410258a386 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:36.238921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0902530-3131-44f5-bb23-80eb3a43f121 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:36.239542 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0902530-3131-44f5-bb23-80eb3a43f121 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:36.239816 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0902530-3131-44f5-bb23-80eb3a43f121 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:36.240082 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0902530-3131-44f5-bb23-80eb3a43f121 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:36.247991 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0902530-3131-44f5-bb23-80eb3a43f121 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:36.250000 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0902530-3131-44f5-bb23-80eb3a43f121 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:36.258576 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1335/2665] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:16:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:16:36.278422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788b146-aad8-4912-8a8f-e8401a4dadcb None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:36.320464 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:36.343054 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788b146-aad8-4912-8a8f-e8401a4dadcb None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:36.348139 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9f593-3084-4765-96bb-46531dc5e765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:36.348763 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9f593-3084-4765-96bb-46531dc5e765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:36.349039 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9f593-3084-4765-96bb-46531dc5e765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:36.349310 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9f593-3084-4765-96bb-46531dc5e765 admin admin] PATH_INFO: `/v3/users/37fa521c9e414a4485105e461ef28768` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:36.350423 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9f593-3084-4765-96bb-46531dc5e765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37fa521c9e414a4485105e461ef28768)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:36.352361 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9f593-3084-4765-96bb-46531dc5e765 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:36.401157 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41c9f593-3084-4765-96bb-46531dc5e765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37fa521c9e414a4485105e461ef28768'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:36.401820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41c9f593-3084-4765-96bb-46531dc5e765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37fa521c9e414a4485105e461ef28768'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:36.402442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41c9f593-3084-4765-96bb-46531dc5e765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37fa521c9e414a4485105e461ef28768'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:36.409615 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41c9f593-3084-4765-96bb-46531dc5e765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37fa521c9e414a4485105e461ef28768'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:36.416141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41c9f593-3084-4765-96bb-46531dc5e765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37fa521c9e414a4485105e461ef28768'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:36.433631 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1331/2666] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:16:36 2022] DELETE /identity/v3/users/37fa521c9e414a4485105e461ef28768 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:16:36.438900 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d850074-c340-4f75-8672-65e734baeee8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:36.439214 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d850074-c340-4f75-8672-65e734baeee8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:36.439491 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d850074-c340-4f75-8672-65e734baeee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:36.458449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7d850074-c340-4f75-8672-65e734baeee8 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:16:36.459662 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7d850074-c340-4f75-8672-65e734baeee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:36.517787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1336/2667] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:16:36.527250 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9f593-3084-4765-96bb-46531dc5e765 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:36.528644 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-41c9f593-3084-4765-96bb-46531dc5e765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:36.585432 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9f593-3084-4765-96bb-46531dc5e765 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:36.589010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd5589-db73-474a-b33c-5165c895a69c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:36.589604 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd5589-db73-474a-b33c-5165c895a69c service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:36.589877 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd5589-db73-474a-b33c-5165c895a69c service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:36.590144 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd5589-db73-474a-b33c-5165c895a69c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:36.599522 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd5589-db73-474a-b33c-5165c895a69c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:36.600909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd5589-db73-474a-b33c-5165c895a69c service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:36.610670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1332/2668] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:16:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:16:36.888175 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d850074-c340-4f75-8672-65e734baeee8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:36.889643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7d850074-c340-4f75-8672-65e734baeee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:36.901483 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d850074-c340-4f75-8672-65e734baeee8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:36.906824 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7240f2c-5f18-4097-a574-678281f8dc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:36.907546 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7240f2c-5f18-4097-a574-678281f8dc47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:36.907822 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7240f2c-5f18-4097-a574-678281f8dc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:36.908093 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7240f2c-5f18-4097-a574-678281f8dc47 admin admin] PATH_INFO: `/v3/projects/3938bb6e0826424ab042ae5db9768eec` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:36.909214 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7240f2c-5f18-4097-a574-678281f8dc47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3938bb6e0826424ab042ae5db9768eec)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:36.911113 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7240f2c-5f18-4097-a574-678281f8dc47 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:36.929049 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:36.959886 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d7240f2c-5f18-4097-a574-678281f8dc47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3938bb6e0826424ab042ae5db9768eec', 'request_id': 'req-d7240f2c-5f18-4097-a574-678281f8dc47'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:36.965157 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d7240f2c-5f18-4097-a574-678281f8dc47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3938bb6e0826424ab042ae5db9768eec', 'request_id': 'req-d7240f2c-5f18-4097-a574-678281f8dc47'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:36.972206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d7240f2c-5f18-4097-a574-678281f8dc47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3938bb6e0826424ab042ae5db9768eec', 'request_id': 'req-d7240f2c-5f18-4097-a574-678281f8dc47'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:36.984940 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d7240f2c-5f18-4097-a574-678281f8dc47 admin admin] The token cache is being invalidate because project 3938bb6e0826424ab042ae5db9768eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:16:36.985220 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d7240f2c-5f18-4097-a574-678281f8dc47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:36.985834 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d7240f2c-5f18-4097-a574-678281f8dc47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:36.987383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1337/2669] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:16:36 2022] DELETE /identity/v3/projects/3938bb6e0826424ab042ae5db9768eec => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:16:39.126336 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd5589-db73-474a-b33c-5165c895a69c service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:39.127823 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-65cd5589-db73-474a-b33c-5165c895a69c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:39.138746 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd5589-db73-474a-b33c-5165c895a69c service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:39.184918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53023f4-b18e-48dc-8efd-4755464b6a41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:39.185499 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53023f4-b18e-48dc-8efd-4755464b6a41 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:39.185770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53023f4-b18e-48dc-8efd-4755464b6a41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:39.186035 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53023f4-b18e-48dc-8efd-4755464b6a41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:39.188589 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a53023f4-b18e-48dc-8efd-4755464b6a41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:39.200931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:39.249803 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53023f4-b18e-48dc-8efd-4755464b6a41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:39.251317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53023f4-b18e-48dc-8efd-4755464b6a41 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:39.260184 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1333/2670] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:16:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:16:44.361191 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7240f2c-5f18-4097-a574-678281f8dc47 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:44.362616 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d7240f2c-5f18-4097-a574-678281f8dc47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:44.375394 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7240f2c-5f18-4097-a574-678281f8dc47 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:44.380216 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a47e0e-9eb2-4386-890d-3795a16616ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:44.380831 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a47e0e-9eb2-4386-890d-3795a16616ce service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:44.381100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a47e0e-9eb2-4386-890d-3795a16616ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:44.381372 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a47e0e-9eb2-4386-890d-3795a16616ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:44.383134 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-42a47e0e-9eb2-4386-890d-3795a16616ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:44.445582 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a47e0e-9eb2-4386-890d-3795a16616ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:44.447003 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a47e0e-9eb2-4386-890d-3795a16616ce service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:44.457998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1338/2671] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:16:49.256079 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=21 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:51.036802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53023f4-b18e-48dc-8efd-4755464b6a41 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:51.038263 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a53023f4-b18e-48dc-8efd-4755464b6a41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:51.054540 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53023f4-b18e-48dc-8efd-4755464b6a41 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:51.059333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4be63-35bd-4250-862a-fbe2cb22e7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:51.059969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4be63-35bd-4250-862a-fbe2cb22e7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:51.060390 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4be63-35bd-4250-862a-fbe2cb22e7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:51.060579 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4be63-35bd-4250-862a-fbe2cb22e7e9 admin admin] PATH_INFO: `/v3/users/7e0a49cccc7c49f385fdfe774fec90fc` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:51.061776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4be63-35bd-4250-862a-fbe2cb22e7e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e0a49cccc7c49f385fdfe774fec90fc)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:51.065848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4be63-35bd-4250-862a-fbe2cb22e7e9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:51.113460 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-08b4be63-35bd-4250-862a-fbe2cb22e7e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e0a49cccc7c49f385fdfe774fec90fc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:51.114113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-08b4be63-35bd-4250-862a-fbe2cb22e7e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e0a49cccc7c49f385fdfe774fec90fc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:51.114763 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-08b4be63-35bd-4250-862a-fbe2cb22e7e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e0a49cccc7c49f385fdfe774fec90fc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:51.122051 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-08b4be63-35bd-4250-862a-fbe2cb22e7e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e0a49cccc7c49f385fdfe774fec90fc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:51.130943 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-08b4be63-35bd-4250-862a-fbe2cb22e7e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e0a49cccc7c49f385fdfe774fec90fc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:51.149317 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1334/2672] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:16:51 2022] DELETE /identity/v3/users/7e0a49cccc7c49f385fdfe774fec90fc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:16:51.319560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a47e0e-9eb2-4386-890d-3795a16616ce service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:51.331150 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a47e0e-9eb2-4386-890d-3795a16616ce service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:51.392117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926465d-02ec-46ff-a025-5805bc36928a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:51.392739 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926465d-02ec-46ff-a025-5805bc36928a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:51.393017 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926465d-02ec-46ff-a025-5805bc36928a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:51.393285 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926465d-02ec-46ff-a025-5805bc36928a admin admin] PATH_INFO: `/v3/projects/798515aa210647d8adcdb2cfb2bc8ede` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:51.394397 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926465d-02ec-46ff-a025-5805bc36928a admin admin] RBAC: Authorizing `identity:delete_project(project_id=798515aa210647d8adcdb2cfb2bc8ede)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:51.396328 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926465d-02ec-46ff-a025-5805bc36928a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:51.437672 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:51.444730 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d926465d-02ec-46ff-a025-5805bc36928a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '798515aa210647d8adcdb2cfb2bc8ede', 'request_id': 'req-d926465d-02ec-46ff-a025-5805bc36928a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:51.450380 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d926465d-02ec-46ff-a025-5805bc36928a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '798515aa210647d8adcdb2cfb2bc8ede', 'request_id': 'req-d926465d-02ec-46ff-a025-5805bc36928a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:51.456692 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d926465d-02ec-46ff-a025-5805bc36928a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '798515aa210647d8adcdb2cfb2bc8ede', 'request_id': 'req-d926465d-02ec-46ff-a025-5805bc36928a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:51.470600 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d926465d-02ec-46ff-a025-5805bc36928a admin admin] The token cache is being invalidate because project 798515aa210647d8adcdb2cfb2bc8ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:16:51.470886 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d926465d-02ec-46ff-a025-5805bc36928a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:51.471533 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d926465d-02ec-46ff-a025-5805bc36928a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:51.473014 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1339/2673] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:16:51 2022] DELETE /identity/v3/projects/798515aa210647d8adcdb2cfb2bc8ede => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:16:51.477035 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4be63-35bd-4250-862a-fbe2cb22e7e9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:51.478460 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-08b4be63-35bd-4250-862a-fbe2cb22e7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:51.492003 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4be63-35bd-4250-862a-fbe2cb22e7e9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:51.547918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef8b5c-3bf5-441d-9ac6-11a76992cac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:51.548534 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef8b5c-3bf5-441d-9ac6-11a76992cac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:51.548807 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef8b5c-3bf5-441d-9ac6-11a76992cac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:51.549071 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef8b5c-3bf5-441d-9ac6-11a76992cac4 admin admin] PATH_INFO: `/v3/users/40bc5c1813774dbd843778b02de1c492` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:51.550170 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef8b5c-3bf5-441d-9ac6-11a76992cac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40bc5c1813774dbd843778b02de1c492)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:51.552116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef8b5c-3bf5-441d-9ac6-11a76992cac4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:51.598759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-07ef8b5c-3bf5-441d-9ac6-11a76992cac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40bc5c1813774dbd843778b02de1c492'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:51.599426 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-07ef8b5c-3bf5-441d-9ac6-11a76992cac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40bc5c1813774dbd843778b02de1c492'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:51.600031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-07ef8b5c-3bf5-441d-9ac6-11a76992cac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40bc5c1813774dbd843778b02de1c492'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:51.606998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-07ef8b5c-3bf5-441d-9ac6-11a76992cac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40bc5c1813774dbd843778b02de1c492'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:51.619558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-07ef8b5c-3bf5-441d-9ac6-11a76992cac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40bc5c1813774dbd843778b02de1c492'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:51.631286 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:51.643305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1335/2674] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:16:51 2022] DELETE /identity/v3/users/40bc5c1813774dbd843778b02de1c492 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:16:51.856031 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926465d-02ec-46ff-a025-5805bc36928a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:51.857583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d926465d-02ec-46ff-a025-5805bc36928a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:51.873349 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926465d-02ec-46ff-a025-5805bc36928a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:51.941913 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6774ac-c00f-43f2-9fcb-cf7463ef3a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:51.942456 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6774ac-c00f-43f2-9fcb-cf7463ef3a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:51.942727 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6774ac-c00f-43f2-9fcb-cf7463ef3a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:51.942995 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6774ac-c00f-43f2-9fcb-cf7463ef3a61 admin admin] PATH_INFO: `/v3/projects/1f0e7f10dd7948bba36f42bc02a500d8` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:51.944379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6774ac-c00f-43f2-9fcb-cf7463ef3a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f0e7f10dd7948bba36f42bc02a500d8)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:51.946239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6774ac-c00f-43f2-9fcb-cf7463ef3a61 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:51.995877 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6c6774ac-c00f-43f2-9fcb-cf7463ef3a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f0e7f10dd7948bba36f42bc02a500d8', 'request_id': 'req-6c6774ac-c00f-43f2-9fcb-cf7463ef3a61'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:52.001539 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6c6774ac-c00f-43f2-9fcb-cf7463ef3a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f0e7f10dd7948bba36f42bc02a500d8', 'request_id': 'req-6c6774ac-c00f-43f2-9fcb-cf7463ef3a61'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:52.007985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6c6774ac-c00f-43f2-9fcb-cf7463ef3a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f0e7f10dd7948bba36f42bc02a500d8', 'request_id': 'req-6c6774ac-c00f-43f2-9fcb-cf7463ef3a61'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:52.022529 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6c6774ac-c00f-43f2-9fcb-cf7463ef3a61 admin admin] The token cache is being invalidate because project 1f0e7f10dd7948bba36f42bc02a500d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:16:52.022973 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6c6774ac-c00f-43f2-9fcb-cf7463ef3a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:52.023648 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6c6774ac-c00f-43f2-9fcb-cf7463ef3a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:16:52.025159 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1340/2675] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:16:51 2022] DELETE /identity/v3/projects/1f0e7f10dd7948bba36f42bc02a500d8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:16:53.234554 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bc309-5ccd-4a80-b351-09034e4dc897 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:53.234992 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bc309-5ccd-4a80-b351-09034e4dc897 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:53.235140 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bc309-5ccd-4a80-b351-09034e4dc897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:53.263826 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5c1bc309-5ccd-4a80-b351-09034e4dc897 None None] MFA Rules not processed for user `664e4353726c42c9bfb80b1701d35aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:16:53.265727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5c1bc309-5ccd-4a80-b351-09034e4dc897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:53.349512 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1336/2676] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Aug 9 07:16:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:16:53.400470 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6774ac-c00f-43f2-9fcb-cf7463ef3a61 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:16:53.401891 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6c6774ac-c00f-43f2-9fcb-cf7463ef3a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:16:53.466106 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:53.511559 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6774ac-c00f-43f2-9fcb-cf7463ef3a61 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:16:53.517206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd806a2a-ce9c-4c1a-b714-d742bc4e8f75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f19a17424c44eea58efb957246cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:16:53.517807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd806a2a-ce9c-4c1a-b714-d742bc4e8f75 service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:16:53.518083 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd806a2a-ce9c-4c1a-b714-d742bc4e8f75 service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:16:53.518349 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd806a2a-ce9c-4c1a-b714-d742bc4e8f75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:16:53.527062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd806a2a-ce9c-4c1a-b714-d742bc4e8f75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:16:53.528633 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd806a2a-ce9c-4c1a-b714-d742bc4e8f75 service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:16:53.537676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1341/2677] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Aug 9 07:16:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 07:17:03.347491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=44,keystone:DELETE=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:17:03.544574 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=16 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:17:11.964557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573162a-891b-445d-88a7-19b2d0f6fb84 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:11.965489 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573162a-891b-445d-88a7-19b2d0f6fb84 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:11.965764 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573162a-891b-445d-88a7-19b2d0f6fb84 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:11.967692 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1337/2678] 10.222.0.40 () {54 vars in 921 bytes} [Tue Aug 9 07:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:17:11.973746 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c62a46-b6f0-425c-bf95-6a6c7889a879 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:11.974226 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c62a46-b6f0-425c-bf95-6a6c7889a879 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:11.974444 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c62a46-b6f0-425c-bf95-6a6c7889a879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:12.025950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-55c62a46-b6f0-425c-bf95-6a6c7889a879 None None] MFA Rules not processed for user `6e949d9666be44a0b6122d510168c7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:17:12.027161 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-55c62a46-b6f0-425c-bf95-6a6c7889a879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:12.105981 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1342/2679] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Aug 9 07:17:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:17:12.117751 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573162a-891b-445d-88a7-19b2d0f6fb84 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:17:12.119472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c573162a-891b-445d-88a7-19b2d0f6fb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:12.176471 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573162a-891b-445d-88a7-19b2d0f6fb84 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:17:12.180021 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614f7cd-4a49-4354-964f-161d846eb4d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44c764958784616b8bdbf59e5692ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:17:12.180612 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614f7cd-4a49-4354-964f-161d846eb4d9 service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:12.180891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614f7cd-4a49-4354-964f-161d846eb4d9 service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:12.181164 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614f7cd-4a49-4354-964f-161d846eb4d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:12.190982 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614f7cd-4a49-4354-964f-161d846eb4d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:17:12.192431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614f7cd-4a49-4354-964f-161d846eb4d9 service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:17:12.203353 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1338/2680] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:17:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:17:12.272707 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586eef74-16ee-47db-af03-ad7e124e9935 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:12.272989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586eef74-16ee-47db-af03-ad7e124e9935 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:12.273285 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586eef74-16ee-47db-af03-ad7e124e9935 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:12.274650 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1343/2681] 10.222.0.40 () {54 vars in 921 bytes} [Tue Aug 9 07:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:17:12.280800 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b67fc-5f9d-498a-a1d9-1aa2ccc0014f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:12.281100 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b67fc-5f9d-498a-a1d9-1aa2ccc0014f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:12.281405 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b67fc-5f9d-498a-a1d9-1aa2ccc0014f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:12.314837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-611b67fc-5f9d-498a-a1d9-1aa2ccc0014f None None] MFA Rules not processed for user `8d75da9360ef490f910fabc3920c8ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:17:12.316341 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-611b67fc-5f9d-498a-a1d9-1aa2ccc0014f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:12.384560 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1339/2682] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Aug 9 07:17:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:17:12.396990 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586eef74-16ee-47db-af03-ad7e124e9935 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:17:12.398732 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-586eef74-16ee-47db-af03-ad7e124e9935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:12.412078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586eef74-16ee-47db-af03-ad7e124e9935 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:17:12.415807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07a975-e4a1-4f41-89ab-63c980e32afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:17:12.416462 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07a975-e4a1-4f41-89ab-63c980e32afe service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:12.416769 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07a975-e4a1-4f41-89ab-63c980e32afe service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:12.417104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07a975-e4a1-4f41-89ab-63c980e32afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:12.424742 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07a975-e4a1-4f41-89ab-63c980e32afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:17:12.426132 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07a975-e4a1-4f41-89ab-63c980e32afe service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:17:12.434013 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1344/2683] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:17:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:17:12.518793 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67c619-e42c-4aeb-bc31-6537ca72613e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:12.519057 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67c619-e42c-4aeb-bc31-6537ca72613e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:12.519366 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67c619-e42c-4aeb-bc31-6537ca72613e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:12.520702 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1340/2684] 10.222.0.40 () {54 vars in 921 bytes} [Tue Aug 9 07:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 07:17:12.525576 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941e4da-3696-4a3b-93e3-cbdfaa125a72 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:12.525859 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941e4da-3696-4a3b-93e3-cbdfaa125a72 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:12.526130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941e4da-3696-4a3b-93e3-cbdfaa125a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:12.546473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3941e4da-3696-4a3b-93e3-cbdfaa125a72 None None] MFA Rules not processed for user `6e949d9666be44a0b6122d510168c7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:17:12.548438 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3941e4da-3696-4a3b-93e3-cbdfaa125a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:12.558718 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1345/2685] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Aug 9 07:17:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:17:12.569843 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67c619-e42c-4aeb-bc31-6537ca72613e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:17:12.571624 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1e67c619-e42c-4aeb-bc31-6537ca72613e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:12.585178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67c619-e42c-4aeb-bc31-6537ca72613e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:17:12.588652 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e661e0-4d26-42bd-9299-62584e872aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:17:12.589237 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e661e0-4d26-42bd-9299-62584e872aea service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:12.589512 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e661e0-4d26-42bd-9299-62584e872aea service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:12.589783 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e661e0-4d26-42bd-9299-62584e872aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:12.600291 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e661e0-4d26-42bd-9299-62584e872aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:17:12.601696 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e661e0-4d26-42bd-9299-62584e872aea service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:17:12.612356 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1341/2686] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:17:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:17:14.297046 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c28d6a-8946-4239-8faf-0adf38091b09 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:14.297558 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c28d6a-8946-4239-8faf-0adf38091b09 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:14.297707 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c28d6a-8946-4239-8faf-0adf38091b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:14.319674 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-73c28d6a-8946-4239-8faf-0adf38091b09 None None] MFA Rules not processed for user `664e4353726c42c9bfb80b1701d35aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:17:14.320872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-73c28d6a-8946-4239-8faf-0adf38091b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:14.329376 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1346/2687] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Aug 9 07:17:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:17:14.341422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e661e0-4d26-42bd-9299-62584e872aea service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:17:14.353224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e661e0-4d26-42bd-9299-62584e872aea service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:17:14.358318 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b308d48-5f04-424e-997e-677e655ea6c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f19a17424c44eea58efb957246cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:17:14.358989 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b308d48-5f04-424e-997e-677e655ea6c5 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:14.359412 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b308d48-5f04-424e-997e-677e655ea6c5 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:14.359753 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b308d48-5f04-424e-997e-677e655ea6c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:14.374361 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b308d48-5f04-424e-997e-677e655ea6c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:17:14.376077 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b308d48-5f04-424e-997e-677e655ea6c5 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:17:14.386020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1342/2688] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Aug 9 07:17:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 07:17:14.686823 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c28d6a-8946-4239-8faf-0adf38091b09 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:17:14.696610 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c28d6a-8946-4239-8faf-0adf38091b09 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:17:14.700359 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b5291-a90f-461f-99fe-05f4b6a93652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:17:14.701340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b5291-a90f-461f-99fe-05f4b6a93652 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:14.701688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b5291-a90f-461f-99fe-05f4b6a93652 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:14.702026 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b5291-a90f-461f-99fe-05f4b6a93652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:14.703907 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-156b5291-a90f-461f-99fe-05f4b6a93652 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:14.806296 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b5291-a90f-461f-99fe-05f4b6a93652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:17:14.807879 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b5291-a90f-461f-99fe-05f4b6a93652 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:17:14.820455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:17:14.842816 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1347/2689] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:17:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:17:18.886789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b308d48-5f04-424e-997e-677e655ea6c5 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:17:18.887292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9b308d48-5f04-424e-997e-677e655ea6c5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:18.916834 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b308d48-5f04-424e-997e-677e655ea6c5 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:17:18.924972 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9283c-a40c-44c1-aa30-21dbf817f7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:17:18.925888 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9283c-a40c-44c1-aa30-21dbf817f7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:18.926233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9283c-a40c-44c1-aa30-21dbf817f7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:18.926577 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9283c-a40c-44c1-aa30-21dbf817f7a1 admin admin] PATH_INFO: `/v3/users/4c652bdbf6fb432eb25b6be62b5b5077` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:18.927815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9283c-a40c-44c1-aa30-21dbf817f7a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c652bdbf6fb432eb25b6be62b5b5077)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:17:18.930215 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9283c-a40c-44c1-aa30-21dbf817f7a1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:17:19.008894 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f7e9283c-a40c-44c1-aa30-21dbf817f7a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c652bdbf6fb432eb25b6be62b5b5077'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:17:19.010279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f7e9283c-a40c-44c1-aa30-21dbf817f7a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c652bdbf6fb432eb25b6be62b5b5077'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:17:19.011113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f7e9283c-a40c-44c1-aa30-21dbf817f7a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c652bdbf6fb432eb25b6be62b5b5077'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:17:19.033360 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f7e9283c-a40c-44c1-aa30-21dbf817f7a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c652bdbf6fb432eb25b6be62b5b5077'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:17:19.046445 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:17:19.052032 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f7e9283c-a40c-44c1-aa30-21dbf817f7a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c652bdbf6fb432eb25b6be62b5b5077'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:17:19.077326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1343/2690] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:17:18 2022] DELETE /identity/v3/users/4c652bdbf6fb432eb25b6be62b5b5077 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:17:19.297339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b5291-a90f-461f-99fe-05f4b6a93652 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:17:19.313433 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b5291-a90f-461f-99fe-05f4b6a93652 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:17:19.396252 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf0c48-d465-4167-852a-d72298f4eb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:17:19.397051 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf0c48-d465-4167-852a-d72298f4eb38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:19.397449 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf0c48-d465-4167-852a-d72298f4eb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:19.397822 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf0c48-d465-4167-852a-d72298f4eb38 admin admin] PATH_INFO: `/v3/projects/f58cec8f7a8e4f9d9fa0af4eac9540f6` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:19.399049 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf0c48-d465-4167-852a-d72298f4eb38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f58cec8f7a8e4f9d9fa0af4eac9540f6)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:17:19.401002 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf0c48-d465-4167-852a-d72298f4eb38 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:17:19.457793 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6ebf0c48-d465-4167-852a-d72298f4eb38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f58cec8f7a8e4f9d9fa0af4eac9540f6', 'request_id': 'req-6ebf0c48-d465-4167-852a-d72298f4eb38'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:17:19.467059 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6ebf0c48-d465-4167-852a-d72298f4eb38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f58cec8f7a8e4f9d9fa0af4eac9540f6', 'request_id': 'req-6ebf0c48-d465-4167-852a-d72298f4eb38'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:17:19.475149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6ebf0c48-d465-4167-852a-d72298f4eb38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f58cec8f7a8e4f9d9fa0af4eac9540f6', 'request_id': 'req-6ebf0c48-d465-4167-852a-d72298f4eb38'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:17:19.508986 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6ebf0c48-d465-4167-852a-d72298f4eb38 admin admin] The token cache is being invalidate because project f58cec8f7a8e4f9d9fa0af4eac9540f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:17:19.509375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6ebf0c48-d465-4167-852a-d72298f4eb38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:17:19.511701 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6ebf0c48-d465-4167-852a-d72298f4eb38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:17:19.516828 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1348/2691] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:17:19 2022] DELETE /identity/v3/projects/f58cec8f7a8e4f9d9fa0af4eac9540f6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:17:19.522376 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef01bc0-de54-46a4-bd07-36e9cefe0673 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:19.522692 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef01bc0-de54-46a4-bd07-36e9cefe0673 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:19.523066 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef01bc0-de54-46a4-bd07-36e9cefe0673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:19.617377 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9ef01bc0-de54-46a4-bd07-36e9cefe0673 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:17:19.623292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9ef01bc0-de54-46a4-bd07-36e9cefe0673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:19.726123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1344/2692] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:17:19.728252 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2dd3f-fc97-4137-aa62-9739439831b9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:19.728546 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2dd3f-fc97-4137-aa62-9739439831b9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:19.728844 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2dd3f-fc97-4137-aa62-9739439831b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:19.750066 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-dff2dd3f-fc97-4137-aa62-9739439831b9 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:17:19.751344 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-dff2dd3f-fc97-4137-aa62-9739439831b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:19.759445 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1349/2693] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:17:19.764245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef01bc0-de54-46a4-bd07-36e9cefe0673 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:17:19.774491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef01bc0-de54-46a4-bd07-36e9cefe0673 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:17:19.779717 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46889e-a969-4131-a4ea-cdcb57246456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:17:19.780321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46889e-a969-4131-a4ea-cdcb57246456 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:19.780594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46889e-a969-4131-a4ea-cdcb57246456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:19.780864 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46889e-a969-4131-a4ea-cdcb57246456 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:19.781504 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46889e-a969-4131-a4ea-cdcb57246456 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:17:19.781805 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46889e-a969-4131-a4ea-cdcb57246456 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:17:19.783427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46889e-a969-4131-a4ea-cdcb57246456 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:17:19.797204 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1345/2694] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 07:17:19.801655 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2dd3f-fc97-4137-aa62-9739439831b9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:17:19.812718 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2dd3f-fc97-4137-aa62-9739439831b9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:17:19.818992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588310e9-0456-4d09-b51f-5a482b9e262c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:17:19.819957 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588310e9-0456-4d09-b51f-5a482b9e262c admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:19.820346 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588310e9-0456-4d09-b51f-5a482b9e262c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:19.821023 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588310e9-0456-4d09-b51f-5a482b9e262c admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:19.821849 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588310e9-0456-4d09-b51f-5a482b9e262c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:17:19.824078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588310e9-0456-4d09-b51f-5a482b9e262c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:17:19.853501 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1350/2695] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:17:19 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:17:19.858348 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46889e-a969-4131-a4ea-cdcb57246456 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:17:19.868842 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46889e-a969-4131-a4ea-cdcb57246456 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:17:19.931078 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a9048-24a1-4471-8ddc-6f65c9d0cbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:17:19.931778 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a9048-24a1-4471-8ddc-6f65c9d0cbc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:19.931994 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a9048-24a1-4471-8ddc-6f65c9d0cbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:19.932397 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a9048-24a1-4471-8ddc-6f65c9d0cbc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:19.933038 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a9048-24a1-4471-8ddc-6f65c9d0cbc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:17:19.936699 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a9048-24a1-4471-8ddc-6f65c9d0cbc6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:17:19.971816 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1346/2696] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:17:19 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:17:19.975001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588310e9-0456-4d09-b51f-5a482b9e262c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:17:19.986519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588310e9-0456-4d09-b51f-5a482b9e262c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:17:19.991460 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823d881-07b4-4312-b11a-2d38d6cc10a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:17:19.992136 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823d881-07b4-4312-b11a-2d38d6cc10a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:19.992483 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823d881-07b4-4312-b11a-2d38d6cc10a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:19.992813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823d881-07b4-4312-b11a-2d38d6cc10a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:19.993548 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823d881-07b4-4312-b11a-2d38d6cc10a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:17:19.995197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823d881-07b4-4312-b11a-2d38d6cc10a7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:17:20.005433 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1351/2697] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:17:20.009568 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a9048-24a1-4471-8ddc-6f65c9d0cbc6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:17:20.019794 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a9048-24a1-4471-8ddc-6f65c9d0cbc6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:17:20.024457 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054e9c2-f933-45a3-b498-5ee01cadd087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:17:20.025060 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054e9c2-f933-45a3-b498-5ee01cadd087 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:20.025332 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054e9c2-f933-45a3-b498-5ee01cadd087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:20.025600 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054e9c2-f933-45a3-b498-5ee01cadd087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:20.026240 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054e9c2-f933-45a3-b498-5ee01cadd087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:17:20.027874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054e9c2-f933-45a3-b498-5ee01cadd087 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:17:20.039953 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1347/2698] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:17:20.043870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823d881-07b4-4312-b11a-2d38d6cc10a7 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:17:20.056398 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823d881-07b4-4312-b11a-2d38d6cc10a7 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:17:20.061317 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2745c67-79c4-416d-a2d5-da2c1dbf87b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:17:20.061971 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2745c67-79c4-416d-a2d5-da2c1dbf87b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:20.062268 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2745c67-79c4-416d-a2d5-da2c1dbf87b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:20.062540 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2745c67-79c4-416d-a2d5-da2c1dbf87b2 admin admin] PATH_INFO: `/v3/projects/1d9e7b23be474a17a8054e5d4bf8c90a/users/ff988a4b381b4f039a8d990164e575e7/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:20.081971 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2745c67-79c4-416d-a2d5-da2c1dbf87b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9e7b23be474a17a8054e5d4bf8c90a, user_id=ff988a4b381b4f039a8d990164e575e7, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:17:20.084647 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2745c67-79c4-416d-a2d5-da2c1dbf87b2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:17:20.102027 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1352/2699] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:17:20 2022] PUT /identity/v3/projects/1d9e7b23be474a17a8054e5d4bf8c90a/users/ff988a4b381b4f039a8d990164e575e7/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:17:20.107349 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca1c83-5c8f-4768-a94a-805dd15ffc57 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:20.107665 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca1c83-5c8f-4768-a94a-805dd15ffc57 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:20.108146 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca1c83-5c8f-4768-a94a-805dd15ffc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:20.127613 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-16ca1c83-5c8f-4768-a94a-805dd15ffc57 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:17:20.128817 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-16ca1c83-5c8f-4768-a94a-805dd15ffc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:20.145493 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:17:20.202045 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1348/2700] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:17:20.211758 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2745c67-79c4-416d-a2d5-da2c1dbf87b2 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:17:20.213858 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c2745c67-79c4-416d-a2d5-da2c1dbf87b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:20.237611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:17:20.286374 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2745c67-79c4-416d-a2d5-da2c1dbf87b2 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:17:20.290360 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e2761-b7ac-439b-b854-af29713c1300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:17:20.290961 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e2761-b7ac-439b-b854-af29713c1300 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:20.291299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e2761-b7ac-439b-b854-af29713c1300 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:20.291574 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e2761-b7ac-439b-b854-af29713c1300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:20.301737 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e2761-b7ac-439b-b854-af29713c1300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:17:20.303180 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e2761-b7ac-439b-b854-af29713c1300 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:17:20.313792 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1353/2701] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:17:24.936634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60ed47-f9d8-40e7-a401-e90ff638b91a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:24.937178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60ed47-f9d8-40e7-a401-e90ff638b91a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:24.937292 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60ed47-f9d8-40e7-a401-e90ff638b91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:24.967169 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ea60ed47-f9d8-40e7-a401-e90ff638b91a None None] MFA Rules not processed for user `ff988a4b381b4f039a8d990164e575e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:17:24.968378 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ea60ed47-f9d8-40e7-a401-e90ff638b91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:25.049742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1349/2702] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:17:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:17:25.064089 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e2761-b7ac-439b-b854-af29713c1300 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:17:25.065556 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fe4e2761-b7ac-439b-b854-af29713c1300 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:25.141606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e2761-b7ac-439b-b854-af29713c1300 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:17:25.147064 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6db21-b416-4cb6-a54f-61635a450488 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:17:25.147712 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6db21-b416-4cb6-a54f-61635a450488 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:25.147990 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6db21-b416-4cb6-a54f-61635a450488 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:25.148262 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6db21-b416-4cb6-a54f-61635a450488 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:25.156812 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6db21-b416-4cb6-a54f-61635a450488 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:17:25.158365 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6db21-b416-4cb6-a54f-61635a450488 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:17:25.167078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1354/2703] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:17:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:17:26.549618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d282d9-ae74-4bbd-93af-13ff0d50ca24 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:26.550099 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d282d9-ae74-4bbd-93af-13ff0d50ca24 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:26.550296 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d282d9-ae74-4bbd-93af-13ff0d50ca24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:26.568990 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a5d282d9-ae74-4bbd-93af-13ff0d50ca24 None None] MFA Rules not processed for user `ff988a4b381b4f039a8d990164e575e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:17:26.570201 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a5d282d9-ae74-4bbd-93af-13ff0d50ca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:26.578303 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1350/2704] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:17:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:17:28.082802 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6db21-b416-4cb6-a54f-61635a450488 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:17:28.084271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c4c6db21-b416-4cb6-a54f-61635a450488 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:28.173084 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6db21-b416-4cb6-a54f-61635a450488 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:17:28.177922 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84b634-21e4-4565-9730-4a73802c8388 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07d2ee351e734fd09938cea9be3bb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:17:28.178519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84b634-21e4-4565-9730-4a73802c8388 service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:28.178794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84b634-21e4-4565-9730-4a73802c8388 service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:28.179062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84b634-21e4-4565-9730-4a73802c8388 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:28.180805 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-be84b634-21e4-4565-9730-4a73802c8388 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:28.193311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84b634-21e4-4565-9730-4a73802c8388 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:17:28.194787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84b634-21e4-4565-9730-4a73802c8388 service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:17:28.204887 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1355/2705] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:17:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:17:35.059597 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92c7c8-ea4b-4172-b21c-94e400b656f5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:35.060083 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92c7c8-ea4b-4172-b21c-94e400b656f5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:35.060187 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92c7c8-ea4b-4172-b21c-94e400b656f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:35.079407 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6f92c7c8-ea4b-4172-b21c-94e400b656f5 None None] MFA Rules not processed for user `664e4353726c42c9bfb80b1701d35aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:17:35.080593 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6f92c7c8-ea4b-4172-b21c-94e400b656f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:35.134273 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1351/2706] 10.222.0.40 () {58 vars in 967 bytes} [Tue Aug 9 07:17:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:17:35.148242 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84b634-21e4-4565-9730-4a73802c8388 service placement] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:17:35.149672 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-be84b634-21e4-4565-9730-4a73802c8388 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:17:35.169686 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:17:35.219233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84b634-21e4-4565-9730-4a73802c8388 service placement] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:17:35.224199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2d6e8-a8e2-4d50-b8ff-f5dea5b21aac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f19a17424c44eea58efb957246cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:17:35.224796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2d6e8-a8e2-4d50-b8ff-f5dea5b21aac service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:17:35.225072 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2d6e8-a8e2-4d50-b8ff-f5dea5b21aac service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:17:35.225343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2d6e8-a8e2-4d50-b8ff-f5dea5b21aac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:17:35.233434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2d6e8-a8e2-4d50-b8ff-f5dea5b21aac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:17:35.234989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2d6e8-a8e2-4d50-b8ff-f5dea5b21aac service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:17:35.242841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1356/2707] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Aug 9 07:17:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 07:17:45.127749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=77 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:17:45.239708 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=24 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:18:39.568324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92c7c8-ea4b-4172-b21c-94e400b656f5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:39.569700 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6f92c7c8-ea4b-4172-b21c-94e400b656f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:39.581959 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92c7c8-ea4b-4172-b21c-94e400b656f5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:39.586062 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21165805-1854-450c-90d3-a36e3f5b9a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:39.586680 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21165805-1854-450c-90d3-a36e3f5b9a11 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:39.586973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21165805-1854-450c-90d3-a36e3f5b9a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:39.587275 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21165805-1854-450c-90d3-a36e3f5b9a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:39.588947 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-21165805-1854-450c-90d3-a36e3f5b9a11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:39.602229 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21165805-1854-450c-90d3-a36e3f5b9a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:39.603680 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21165805-1854-450c-90d3-a36e3f5b9a11 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:39.613414 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1352/2708] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:18:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:18:42.493471 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2d6e8-a8e2-4d50-b8ff-f5dea5b21aac service swift] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:42.494950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6ed2d6e8-a8e2-4d50-b8ff-f5dea5b21aac service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:42.509127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2d6e8-a8e2-4d50-b8ff-f5dea5b21aac service swift] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:42.514322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94183c0-3cd9-4622-b5bf-d5ddcb8b254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:42.514941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94183c0-3cd9-4622-b5bf-d5ddcb8b254e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:42.515264 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94183c0-3cd9-4622-b5bf-d5ddcb8b254e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:42.515538 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94183c0-3cd9-4622-b5bf-d5ddcb8b254e admin admin] PATH_INFO: `/v3/users/6cead1e7fb98489fbe122f9bff8a63b1` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:42.516660 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94183c0-3cd9-4622-b5bf-d5ddcb8b254e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cead1e7fb98489fbe122f9bff8a63b1)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:42.518557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94183c0-3cd9-4622-b5bf-d5ddcb8b254e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:42.565211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d94183c0-3cd9-4622-b5bf-d5ddcb8b254e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cead1e7fb98489fbe122f9bff8a63b1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:42.572537 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d94183c0-3cd9-4622-b5bf-d5ddcb8b254e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cead1e7fb98489fbe122f9bff8a63b1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:42.573177 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d94183c0-3cd9-4622-b5bf-d5ddcb8b254e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cead1e7fb98489fbe122f9bff8a63b1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:42.586079 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d94183c0-3cd9-4622-b5bf-d5ddcb8b254e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cead1e7fb98489fbe122f9bff8a63b1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:42.593386 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d94183c0-3cd9-4622-b5bf-d5ddcb8b254e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cead1e7fb98489fbe122f9bff8a63b1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:42.599287 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1357/2709] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:18:42 2022] DELETE /identity/v3/users/6cead1e7fb98489fbe122f9bff8a63b1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:18:42.776084 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21165805-1854-450c-90d3-a36e3f5b9a11 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:42.790931 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21165805-1854-450c-90d3-a36e3f5b9a11 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:42.851186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdde55f-1016-4bfc-b0fd-d8a60de7b6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:42.851810 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdde55f-1016-4bfc-b0fd-d8a60de7b6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:42.852090 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdde55f-1016-4bfc-b0fd-d8a60de7b6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:42.852369 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdde55f-1016-4bfc-b0fd-d8a60de7b6b3 admin admin] PATH_INFO: `/v3/projects/eb1015d1c9e145e4a43ec2d5456bbf47` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:42.853476 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdde55f-1016-4bfc-b0fd-d8a60de7b6b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1015d1c9e145e4a43ec2d5456bbf47)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:42.855414 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdde55f-1016-4bfc-b0fd-d8a60de7b6b3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:42.900124 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0bdde55f-1016-4bfc-b0fd-d8a60de7b6b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1015d1c9e145e4a43ec2d5456bbf47', 'request_id': 'req-0bdde55f-1016-4bfc-b0fd-d8a60de7b6b3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:42.906654 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0bdde55f-1016-4bfc-b0fd-d8a60de7b6b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1015d1c9e145e4a43ec2d5456bbf47', 'request_id': 'req-0bdde55f-1016-4bfc-b0fd-d8a60de7b6b3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:42.912102 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0bdde55f-1016-4bfc-b0fd-d8a60de7b6b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1015d1c9e145e4a43ec2d5456bbf47', 'request_id': 'req-0bdde55f-1016-4bfc-b0fd-d8a60de7b6b3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:42.923744 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0bdde55f-1016-4bfc-b0fd-d8a60de7b6b3 admin admin] The token cache is being invalidate because project eb1015d1c9e145e4a43ec2d5456bbf47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:18:42.924031 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0bdde55f-1016-4bfc-b0fd-d8a60de7b6b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:42.924644 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0bdde55f-1016-4bfc-b0fd-d8a60de7b6b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:42.926095 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1353/2710] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:18:42 2022] DELETE /identity/v3/projects/eb1015d1c9e145e4a43ec2d5456bbf47 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:18:42.931198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72397e-67c2-4a10-bcb1-e33435e1f511 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:42.931488 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72397e-67c2-4a10-bcb1-e33435e1f511 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:42.931760 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72397e-67c2-4a10-bcb1-e33435e1f511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:42.952405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5e72397e-67c2-4a10-bcb1-e33435e1f511 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:18:42.953527 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5e72397e-67c2-4a10-bcb1-e33435e1f511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:43.011218 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1358/2711] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:18:43.020396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98628c6-0522-4055-89a2-9e8e748ddfb1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:43.020679 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98628c6-0522-4055-89a2-9e8e748ddfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:43.020955 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98628c6-0522-4055-89a2-9e8e748ddfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:43.041178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a98628c6-0522-4055-89a2-9e8e748ddfb1 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:18:43.042371 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a98628c6-0522-4055-89a2-9e8e748ddfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:43.050749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1354/2712] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:18:43.054638 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72397e-67c2-4a10-bcb1-e33435e1f511 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:43.065951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72397e-67c2-4a10-bcb1-e33435e1f511 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:43.074032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faaa76c-fc0a-49cb-bba4-2e34ae73a6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:43.074636 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaa76c-fc0a-49cb-bba4-2e34ae73a6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:43.074911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaa76c-fc0a-49cb-bba4-2e34ae73a6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:43.075215 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaa76c-fc0a-49cb-bba4-2e34ae73a6d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:43.076614 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faaa76c-fc0a-49cb-bba4-2e34ae73a6d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:18:43.076919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faaa76c-fc0a-49cb-bba4-2e34ae73a6d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:43.078486 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faaa76c-fc0a-49cb-bba4-2e34ae73a6d3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:43.090061 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1359/2713] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:18:43.094696 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98628c6-0522-4055-89a2-9e8e748ddfb1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:43.104777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98628c6-0522-4055-89a2-9e8e748ddfb1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:43.109529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcb002-7dfe-42d7-a116-cceb84418af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:43.110128 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcb002-7dfe-42d7-a116-cceb84418af0 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:43.110429 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcb002-7dfe-42d7-a116-cceb84418af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:43.110709 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcb002-7dfe-42d7-a116-cceb84418af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:43.111395 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcb002-7dfe-42d7-a116-cceb84418af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:43.113270 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcb002-7dfe-42d7-a116-cceb84418af0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:43.141586 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1355/2714] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:18:43 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:18:43.146436 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faaa76c-fc0a-49cb-bba4-2e34ae73a6d3 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:43.155572 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faaa76c-fc0a-49cb-bba4-2e34ae73a6d3 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:43.212227 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84a828-515f-441c-8d87-2f1c959ae44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:43.212750 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84a828-515f-441c-8d87-2f1c959ae44c admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:43.213024 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84a828-515f-441c-8d87-2f1c959ae44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:43.213291 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84a828-515f-441c-8d87-2f1c959ae44c admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:43.213937 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84a828-515f-441c-8d87-2f1c959ae44c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:43.215959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84a828-515f-441c-8d87-2f1c959ae44c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:43.223691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:18:43.238393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1360/2715] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:18:43 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:18:43.242636 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcb002-7dfe-42d7-a116-cceb84418af0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:43.253696 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcb002-7dfe-42d7-a116-cceb84418af0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:43.258309 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a65021-5508-4c41-aaa1-28fc755d1502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:43.258899 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a65021-5508-4c41-aaa1-28fc755d1502 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:43.259211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a65021-5508-4c41-aaa1-28fc755d1502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:43.259480 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a65021-5508-4c41-aaa1-28fc755d1502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:43.260115 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a65021-5508-4c41-aaa1-28fc755d1502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:43.261716 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a65021-5508-4c41-aaa1-28fc755d1502 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:43.273135 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1356/2716] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:18:43.277069 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84a828-515f-441c-8d87-2f1c959ae44c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:43.287045 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84a828-515f-441c-8d87-2f1c959ae44c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:43.291834 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88432c-c56a-4f2d-b367-58246c89a631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:43.292459 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88432c-c56a-4f2d-b367-58246c89a631 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:43.292738 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88432c-c56a-4f2d-b367-58246c89a631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:43.293006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88432c-c56a-4f2d-b367-58246c89a631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:43.293641 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88432c-c56a-4f2d-b367-58246c89a631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:43.295919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88432c-c56a-4f2d-b367-58246c89a631 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:43.306638 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1361/2717] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:18:43.311649 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a65021-5508-4c41-aaa1-28fc755d1502 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:43.321604 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a65021-5508-4c41-aaa1-28fc755d1502 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:43.326442 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e922d58-006f-406b-8eb2-2a4d4568aa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:43.327074 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e922d58-006f-406b-8eb2-2a4d4568aa0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:43.327392 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e922d58-006f-406b-8eb2-2a4d4568aa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:43.327667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e922d58-006f-406b-8eb2-2a4d4568aa0c admin admin] PATH_INFO: `/v3/projects/af39c37f052147c28f22cd544359a3c3/users/79c556eb2c2b4238a873452a557b769d/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:43.341894 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e922d58-006f-406b-8eb2-2a4d4568aa0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=af39c37f052147c28f22cd544359a3c3, user_id=79c556eb2c2b4238a873452a557b769d, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:43.344557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e922d58-006f-406b-8eb2-2a4d4568aa0c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:43.357158 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1357/2718] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:18:43 2022] PUT /identity/v3/projects/af39c37f052147c28f22cd544359a3c3/users/79c556eb2c2b4238a873452a557b769d/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:18:43.367351 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d039f-33bd-4d15-a043-10979c01b72f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:43.367630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d039f-33bd-4d15-a043-10979c01b72f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:43.367898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d039f-33bd-4d15-a043-10979c01b72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:43.395722 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-715d039f-33bd-4d15-a043-10979c01b72f None None] MFA Rules not processed for user `79c556eb2c2b4238a873452a557b769d`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:18:43.396911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-715d039f-33bd-4d15-a043-10979c01b72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:43.458877 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1362/2719] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:18:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:18:43.463404 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e922d58-006f-406b-8eb2-2a4d4568aa0c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:43.476796 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:18:43.526801 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e922d58-006f-406b-8eb2-2a4d4568aa0c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:43.531435 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6335e-f4f0-49d7-b099-64f3d2331955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:43.532025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6335e-f4f0-49d7-b099-64f3d2331955 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:43.532299 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6335e-f4f0-49d7-b099-64f3d2331955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:43.532567 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6335e-f4f0-49d7-b099-64f3d2331955 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:43.533179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6335e-f4f0-49d7-b099-64f3d2331955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:43.535106 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6335e-f4f0-49d7-b099-64f3d2331955 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:43.561470 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1358/2720] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:18:43 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:18:43.565505 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d039f-33bd-4d15-a043-10979c01b72f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:43.576141 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d039f-33bd-4d15-a043-10979c01b72f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:43.631143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536debf-905f-4b63-897d-93298c52352d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:43.631761 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536debf-905f-4b63-897d-93298c52352d admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:43.632037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536debf-905f-4b63-897d-93298c52352d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:43.632305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536debf-905f-4b63-897d-93298c52352d admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:43.632919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536debf-905f-4b63-897d-93298c52352d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:43.634804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536debf-905f-4b63-897d-93298c52352d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:43.656052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1363/2721] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:18:43 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:18:43.660103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6335e-f4f0-49d7-b099-64f3d2331955 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:43.670539 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6335e-f4f0-49d7-b099-64f3d2331955 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:43.675263 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9ebbc-a68f-49c6-9537-99dc6b548062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:43.675854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9ebbc-a68f-49c6-9537-99dc6b548062 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:43.676130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9ebbc-a68f-49c6-9537-99dc6b548062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:43.676402 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9ebbc-a68f-49c6-9537-99dc6b548062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:43.677032 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9ebbc-a68f-49c6-9537-99dc6b548062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:43.678615 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9ebbc-a68f-49c6-9537-99dc6b548062 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:43.689436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1359/2722] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:18:43.693746 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536debf-905f-4b63-897d-93298c52352d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:43.704046 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536debf-905f-4b63-897d-93298c52352d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:43.708564 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a525cee-28a2-4d7c-9569-24db3f4eec48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:43.709195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a525cee-28a2-4d7c-9569-24db3f4eec48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:43.709467 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a525cee-28a2-4d7c-9569-24db3f4eec48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:43.709733 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a525cee-28a2-4d7c-9569-24db3f4eec48 admin admin] PATH_INFO: `/v3/projects/160f3abe40c34b1a8fa15f41ec3d0a62/users/f10bed1069fd4184b597b29e76f5cde5/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:43.724192 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a525cee-28a2-4d7c-9569-24db3f4eec48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=160f3abe40c34b1a8fa15f41ec3d0a62, user_id=f10bed1069fd4184b597b29e76f5cde5, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:43.726789 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a525cee-28a2-4d7c-9569-24db3f4eec48 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:43.740749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1364/2723] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:18:43 2022] PUT /identity/v3/projects/160f3abe40c34b1a8fa15f41ec3d0a62/users/f10bed1069fd4184b597b29e76f5cde5/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:18:43.744663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9ebbc-a68f-49c6-9537-99dc6b548062 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:43.755279 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9ebbc-a68f-49c6-9537-99dc6b548062 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:43.809790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d8709-c867-409e-bdfc-f47c637cdf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:43.810513 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d8709-c867-409e-bdfc-f47c637cdf6c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:43.810790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d8709-c867-409e-bdfc-f47c637cdf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:43.811061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d8709-c867-409e-bdfc-f47c637cdf6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:43.811704 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d8709-c867-409e-bdfc-f47c637cdf6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:43.813293 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d8709-c867-409e-bdfc-f47c637cdf6c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:43.822871 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1360/2724] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:18:43.827247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a525cee-28a2-4d7c-9569-24db3f4eec48 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:43.837091 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a525cee-28a2-4d7c-9569-24db3f4eec48 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:43.842252 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95484f-05fd-486f-938a-fcce316bfc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:43.842883 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95484f-05fd-486f-938a-fcce316bfc96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:43.843188 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95484f-05fd-486f-938a-fcce316bfc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:43.843458 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95484f-05fd-486f-938a-fcce316bfc96 admin admin] PATH_INFO: `/v3/projects/160f3abe40c34b1a8fa15f41ec3d0a62/users/f10bed1069fd4184b597b29e76f5cde5/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:43.845357 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95484f-05fd-486f-938a-fcce316bfc96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=160f3abe40c34b1a8fa15f41ec3d0a62, user_id=f10bed1069fd4184b597b29e76f5cde5, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:43.847972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95484f-05fd-486f-938a-fcce316bfc96 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:43.858369 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1365/2725] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:18:43 2022] PUT /identity/v3/projects/160f3abe40c34b1a8fa15f41ec3d0a62/users/f10bed1069fd4184b597b29e76f5cde5/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:18:43.869891 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdf2e3-17d8-4463-a224-804f6694d34d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:43.870179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdf2e3-17d8-4463-a224-804f6694d34d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:43.870453 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdf2e3-17d8-4463-a224-804f6694d34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:43.897645 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f8bdf2e3-17d8-4463-a224-804f6694d34d None None] MFA Rules not processed for user `f10bed1069fd4184b597b29e76f5cde5`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:18:43.898829 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f8bdf2e3-17d8-4463-a224-804f6694d34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:43.965861 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1361/2726] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:18:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:18:43.977643 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95484f-05fd-486f-938a-fcce316bfc96 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:43.979288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bd95484f-05fd-486f-938a-fcce316bfc96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:44.002915 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:18:44.058232 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95484f-05fd-486f-938a-fcce316bfc96 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:44.062018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b6a8b-3aed-450d-8ff8-0066c5e030b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:44.062612 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b6a8b-3aed-450d-8ff8-0066c5e030b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:44.062890 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b6a8b-3aed-450d-8ff8-0066c5e030b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:44.063203 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b6a8b-3aed-450d-8ff8-0066c5e030b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:44.072707 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b6a8b-3aed-450d-8ff8-0066c5e030b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:44.074121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b6a8b-3aed-450d-8ff8-0066c5e030b3 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:44.083851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1366/2727] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:18:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:18:44.160382 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdf2e3-17d8-4463-a224-804f6694d34d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:44.170287 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdf2e3-17d8-4463-a224-804f6694d34d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:44.173811 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0209c9-c5d4-4a09-a2d3-ab92c1fa497f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:44.174395 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0209c9-c5d4-4a09-a2d3-ab92c1fa497f service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:44.174672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0209c9-c5d4-4a09-a2d3-ab92c1fa497f service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:44.175178 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0209c9-c5d4-4a09-a2d3-ab92c1fa497f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:44.180474 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:18:44.233745 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0209c9-c5d4-4a09-a2d3-ab92c1fa497f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:44.235132 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0209c9-c5d4-4a09-a2d3-ab92c1fa497f service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:44.243866 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1362/2728] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:18:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:18:51.224689 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b6a8b-3aed-450d-8ff8-0066c5e030b3 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:51.286310 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b6a8b-3aed-450d-8ff8-0066c5e030b3 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:51.290800 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53789406-0a3c-4a46-ad6a-1e19cfdd704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:51.291459 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53789406-0a3c-4a46-ad6a-1e19cfdd704f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:51.291736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53789406-0a3c-4a46-ad6a-1e19cfdd704f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:51.292007 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53789406-0a3c-4a46-ad6a-1e19cfdd704f admin admin] PATH_INFO: `/v3/users/79c556eb2c2b4238a873452a557b769d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:51.293106 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53789406-0a3c-4a46-ad6a-1e19cfdd704f admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c556eb2c2b4238a873452a557b769d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:51.295037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53789406-0a3c-4a46-ad6a-1e19cfdd704f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:51.341797 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-53789406-0a3c-4a46-ad6a-1e19cfdd704f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c556eb2c2b4238a873452a557b769d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:51.349283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-53789406-0a3c-4a46-ad6a-1e19cfdd704f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c556eb2c2b4238a873452a557b769d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:51.349905 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-53789406-0a3c-4a46-ad6a-1e19cfdd704f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c556eb2c2b4238a873452a557b769d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:51.361956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-53789406-0a3c-4a46-ad6a-1e19cfdd704f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c556eb2c2b4238a873452a557b769d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:51.368807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-53789406-0a3c-4a46-ad6a-1e19cfdd704f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c556eb2c2b4238a873452a557b769d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:51.375177 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1367/2729] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:18:51 2022] DELETE /identity/v3/users/79c556eb2c2b4238a873452a557b769d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:18:51.379582 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c16861-0afc-4a3b-b582-2cf1877dad18 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:51.380082 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c16861-0afc-4a3b-b582-2cf1877dad18 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:51.380195 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c16861-0afc-4a3b-b582-2cf1877dad18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:51.399881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-85c16861-0afc-4a3b-b582-2cf1877dad18 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:18:51.401080 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-85c16861-0afc-4a3b-b582-2cf1877dad18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:51.459019 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1363/2730] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:18:51.469359 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53789406-0a3c-4a46-ad6a-1e19cfdd704f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:51.470778 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-53789406-0a3c-4a46-ad6a-1e19cfdd704f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:51.496879 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:18:51.528704 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53789406-0a3c-4a46-ad6a-1e19cfdd704f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:51.532300 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298673bf-9c15-4ba1-b83e-d0c41b853579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:51.532895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298673bf-9c15-4ba1-b83e-d0c41b853579 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:51.533166 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298673bf-9c15-4ba1-b83e-d0c41b853579 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:51.533427 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298673bf-9c15-4ba1-b83e-d0c41b853579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:51.542035 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298673bf-9c15-4ba1-b83e-d0c41b853579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:51.543465 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298673bf-9c15-4ba1-b83e-d0c41b853579 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:51.553461 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1368/2731] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:18:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:18:51.833268 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c16861-0afc-4a3b-b582-2cf1877dad18 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:51.834664 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-85c16861-0afc-4a3b-b582-2cf1877dad18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:51.848143 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c16861-0afc-4a3b-b582-2cf1877dad18 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:51.852912 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fc7f1-e2b8-44da-96b2-48c34741f626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:51.853586 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fc7f1-e2b8-44da-96b2-48c34741f626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:51.853859 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fc7f1-e2b8-44da-96b2-48c34741f626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:51.854189 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fc7f1-e2b8-44da-96b2-48c34741f626 admin admin] PATH_INFO: `/v3/projects/af39c37f052147c28f22cd544359a3c3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:51.855888 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fc7f1-e2b8-44da-96b2-48c34741f626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af39c37f052147c28f22cd544359a3c3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:51.857769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fc7f1-e2b8-44da-96b2-48c34741f626 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:51.903697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4b1fc7f1-e2b8-44da-96b2-48c34741f626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af39c37f052147c28f22cd544359a3c3', 'request_id': 'req-4b1fc7f1-e2b8-44da-96b2-48c34741f626'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:51.910199 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4b1fc7f1-e2b8-44da-96b2-48c34741f626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af39c37f052147c28f22cd544359a3c3', 'request_id': 'req-4b1fc7f1-e2b8-44da-96b2-48c34741f626'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:51.915680 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4b1fc7f1-e2b8-44da-96b2-48c34741f626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af39c37f052147c28f22cd544359a3c3', 'request_id': 'req-4b1fc7f1-e2b8-44da-96b2-48c34741f626'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:51.928452 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4b1fc7f1-e2b8-44da-96b2-48c34741f626 admin admin] The token cache is being invalidate because project af39c37f052147c28f22cd544359a3c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:18:51.928735 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4b1fc7f1-e2b8-44da-96b2-48c34741f626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:51.929333 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4b1fc7f1-e2b8-44da-96b2-48c34741f626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:51.930815 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1364/2732] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:18:51 2022] DELETE /identity/v3/projects/af39c37f052147c28f22cd544359a3c3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:18:51.934845 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298673bf-9c15-4ba1-b83e-d0c41b853579 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:51.944814 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298673bf-9c15-4ba1-b83e-d0c41b853579 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:52.001571 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9461c-3b90-4297-a0b8-6dae07695f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:52.002194 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9461c-3b90-4297-a0b8-6dae07695f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:52.002473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9461c-3b90-4297-a0b8-6dae07695f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:52.002745 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9461c-3b90-4297-a0b8-6dae07695f69 admin admin] PATH_INFO: `/v3/users/f10bed1069fd4184b597b29e76f5cde5` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:52.003895 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9461c-3b90-4297-a0b8-6dae07695f69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f10bed1069fd4184b597b29e76f5cde5)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:52.005786 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9461c-3b90-4297-a0b8-6dae07695f69 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:52.050037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-afa9461c-3b90-4297-a0b8-6dae07695f69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f10bed1069fd4184b597b29e76f5cde5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:52.056511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-afa9461c-3b90-4297-a0b8-6dae07695f69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f10bed1069fd4184b597b29e76f5cde5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:52.057259 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-afa9461c-3b90-4297-a0b8-6dae07695f69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f10bed1069fd4184b597b29e76f5cde5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:52.069805 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-afa9461c-3b90-4297-a0b8-6dae07695f69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f10bed1069fd4184b597b29e76f5cde5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:52.076646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-afa9461c-3b90-4297-a0b8-6dae07695f69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f10bed1069fd4184b597b29e76f5cde5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:52.082544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1369/2733] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:18:51 2022] DELETE /identity/v3/users/f10bed1069fd4184b597b29e76f5cde5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:18:52.351880 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fc7f1-e2b8-44da-96b2-48c34741f626 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:52.353596 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4b1fc7f1-e2b8-44da-96b2-48c34741f626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:52.368065 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fc7f1-e2b8-44da-96b2-48c34741f626 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:52.400268 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:18:52.429642 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36f383-bbc8-4978-9cd1-c3c63ed15fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:52.430257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36f383-bbc8-4978-9cd1-c3c63ed15fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:52.430528 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36f383-bbc8-4978-9cd1-c3c63ed15fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:52.430791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36f383-bbc8-4978-9cd1-c3c63ed15fa3 admin admin] PATH_INFO: `/v3/projects/160f3abe40c34b1a8fa15f41ec3d0a62` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:52.432027 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36f383-bbc8-4978-9cd1-c3c63ed15fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=160f3abe40c34b1a8fa15f41ec3d0a62)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:52.433897 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36f383-bbc8-4978-9cd1-c3c63ed15fa3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:52.480347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6b36f383-bbc8-4978-9cd1-c3c63ed15fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '160f3abe40c34b1a8fa15f41ec3d0a62', 'request_id': 'req-6b36f383-bbc8-4978-9cd1-c3c63ed15fa3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:52.486720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6b36f383-bbc8-4978-9cd1-c3c63ed15fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '160f3abe40c34b1a8fa15f41ec3d0a62', 'request_id': 'req-6b36f383-bbc8-4978-9cd1-c3c63ed15fa3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:52.492224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6b36f383-bbc8-4978-9cd1-c3c63ed15fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '160f3abe40c34b1a8fa15f41ec3d0a62', 'request_id': 'req-6b36f383-bbc8-4978-9cd1-c3c63ed15fa3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:52.503909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6b36f383-bbc8-4978-9cd1-c3c63ed15fa3 admin admin] The token cache is being invalidate because project 160f3abe40c34b1a8fa15f41ec3d0a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:18:52.504193 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6b36f383-bbc8-4978-9cd1-c3c63ed15fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:52.504801 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6b36f383-bbc8-4978-9cd1-c3c63ed15fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:52.506278 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1365/2734] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:18:52 2022] DELETE /identity/v3/projects/160f3abe40c34b1a8fa15f41ec3d0a62 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:18:52.512190 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96d0c5-6f4b-4597-8bd6-a9f2b4932924 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:52.512680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96d0c5-6f4b-4597-8bd6-a9f2b4932924 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:52.512780 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96d0c5-6f4b-4597-8bd6-a9f2b4932924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:52.532789 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9a96d0c5-6f4b-4597-8bd6-a9f2b4932924 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:18:52.533981 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9a96d0c5-6f4b-4597-8bd6-a9f2b4932924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:52.573083 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:18:52.593656 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1370/2735] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:18:52.601460 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905e971-ebb5-42bd-812f-196ad7008812 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:52.601697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905e971-ebb5-42bd-812f-196ad7008812 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:52.601965 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905e971-ebb5-42bd-812f-196ad7008812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:52.621813 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5905e971-ebb5-42bd-812f-196ad7008812 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:18:52.622996 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5905e971-ebb5-42bd-812f-196ad7008812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:52.631536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1366/2736] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:18:52.635804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96d0c5-6f4b-4597-8bd6-a9f2b4932924 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:52.645737 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96d0c5-6f4b-4597-8bd6-a9f2b4932924 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:52.650258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ab3af-7f65-42e4-91c5-cb8f21746631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:52.650848 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ab3af-7f65-42e4-91c5-cb8f21746631 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:52.651151 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ab3af-7f65-42e4-91c5-cb8f21746631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:52.651421 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ab3af-7f65-42e4-91c5-cb8f21746631 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:52.652091 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ab3af-7f65-42e4-91c5-cb8f21746631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:18:52.652390 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ab3af-7f65-42e4-91c5-cb8f21746631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:52.653946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ab3af-7f65-42e4-91c5-cb8f21746631 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:52.665680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1371/2737] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:18:52.670024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905e971-ebb5-42bd-812f-196ad7008812 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:52.679747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905e971-ebb5-42bd-812f-196ad7008812 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:52.684272 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814d027-8171-48da-b0f9-0b4e6da20bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:52.684851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814d027-8171-48da-b0f9-0b4e6da20bba admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:52.685121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814d027-8171-48da-b0f9-0b4e6da20bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:52.685385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814d027-8171-48da-b0f9-0b4e6da20bba admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:52.685998 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814d027-8171-48da-b0f9-0b4e6da20bba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:52.688004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814d027-8171-48da-b0f9-0b4e6da20bba admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:52.729165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1367/2738] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:18:52 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:18:52.734645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ab3af-7f65-42e4-91c5-cb8f21746631 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:52.744777 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ab3af-7f65-42e4-91c5-cb8f21746631 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:52.799889 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1908cf5-1efc-4b33-a9c6-5b0677e082e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:52.800489 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1908cf5-1efc-4b33-a9c6-5b0677e082e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:52.800766 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1908cf5-1efc-4b33-a9c6-5b0677e082e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:52.801037 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1908cf5-1efc-4b33-a9c6-5b0677e082e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:52.801645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1908cf5-1efc-4b33-a9c6-5b0677e082e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:52.803559 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1908cf5-1efc-4b33-a9c6-5b0677e082e1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:52.823968 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1372/2739] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:18:52 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:18:52.828775 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814d027-8171-48da-b0f9-0b4e6da20bba admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:52.839357 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814d027-8171-48da-b0f9-0b4e6da20bba admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:52.844484 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5d8a9-8d72-4116-a1f2-a83b5dc974dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:52.845065 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5d8a9-8d72-4116-a1f2-a83b5dc974dc admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:52.845337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5d8a9-8d72-4116-a1f2-a83b5dc974dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:52.845600 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5d8a9-8d72-4116-a1f2-a83b5dc974dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:52.846225 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5d8a9-8d72-4116-a1f2-a83b5dc974dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:52.847823 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5d8a9-8d72-4116-a1f2-a83b5dc974dc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:52.857443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1368/2740] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:18:52.861939 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1908cf5-1efc-4b33-a9c6-5b0677e082e1 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:52.871592 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1908cf5-1efc-4b33-a9c6-5b0677e082e1 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:52.876595 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f1adb-68d0-4de5-bcaf-cf8cedee3402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:52.877177 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f1adb-68d0-4de5-bcaf-cf8cedee3402 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:52.877456 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f1adb-68d0-4de5-bcaf-cf8cedee3402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:52.877729 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f1adb-68d0-4de5-bcaf-cf8cedee3402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:52.878362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f1adb-68d0-4de5-bcaf-cf8cedee3402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:52.879998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f1adb-68d0-4de5-bcaf-cf8cedee3402 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:52.890458 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1373/2741] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:18:52.894417 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5d8a9-8d72-4116-a1f2-a83b5dc974dc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:52.904075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5d8a9-8d72-4116-a1f2-a83b5dc974dc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:52.909254 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e6da0-0f26-4d8a-8ee8-745f37216e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:52.909878 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e6da0-0f26-4d8a-8ee8-745f37216e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:52.910155 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e6da0-0f26-4d8a-8ee8-745f37216e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:52.910426 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e6da0-0f26-4d8a-8ee8-745f37216e3e admin admin] PATH_INFO: `/v3/projects/10608e79d5554791b14bed414df8e01f/users/2b376e7078e042ebbb42818c8f5f8404/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:52.925234 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e6da0-0f26-4d8a-8ee8-745f37216e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=10608e79d5554791b14bed414df8e01f, user_id=2b376e7078e042ebbb42818c8f5f8404, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:52.927907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e6da0-0f26-4d8a-8ee8-745f37216e3e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:52.940529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1369/2742] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:18:52 2022] PUT /identity/v3/projects/10608e79d5554791b14bed414df8e01f/users/2b376e7078e042ebbb42818c8f5f8404/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:18:52.951583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112249a-7287-4e11-96b8-e1f5576f9059 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:52.952017 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112249a-7287-4e11-96b8-e1f5576f9059 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:52.952263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112249a-7287-4e11-96b8-e1f5576f9059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:52.979011 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4112249a-7287-4e11-96b8-e1f5576f9059 None None] MFA Rules not processed for user `2b376e7078e042ebbb42818c8f5f8404`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:18:52.980238 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4112249a-7287-4e11-96b8-e1f5576f9059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:53.041973 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1374/2743] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:18:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:18:53.046430 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e6da0-0f26-4d8a-8ee8-745f37216e3e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:53.094493 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:18:53.109745 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e6da0-0f26-4d8a-8ee8-745f37216e3e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:53.114454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b196d-b892-4d15-9d5f-b52e9e486c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:53.115058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b196d-b892-4d15-9d5f-b52e9e486c2d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:53.115371 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b196d-b892-4d15-9d5f-b52e9e486c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:53.115643 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b196d-b892-4d15-9d5f-b52e9e486c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:53.116272 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b196d-b892-4d15-9d5f-b52e9e486c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:53.118154 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b196d-b892-4d15-9d5f-b52e9e486c2d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:53.144648 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1370/2744] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:18:53 2022] POST /identity/v3/projects => generated 391 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:18:53.148925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112249a-7287-4e11-96b8-e1f5576f9059 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:53.160487 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112249a-7287-4e11-96b8-e1f5576f9059 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:53.197598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:18:53.217129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca8f96-618f-4993-adfa-070f9388c201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:53.218469 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca8f96-618f-4993-adfa-070f9388c201 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:53.218683 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca8f96-618f-4993-adfa-070f9388c201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:53.218927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca8f96-618f-4993-adfa-070f9388c201 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:53.219576 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca8f96-618f-4993-adfa-070f9388c201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:53.221473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca8f96-618f-4993-adfa-070f9388c201 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:53.241475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1375/2745] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:18:53 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:18:53.245508 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b196d-b892-4d15-9d5f-b52e9e486c2d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:53.255902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b196d-b892-4d15-9d5f-b52e9e486c2d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:53.260527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a094146-caab-46e8-96b4-db5c95d004d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:53.261120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a094146-caab-46e8-96b4-db5c95d004d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:53.261399 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a094146-caab-46e8-96b4-db5c95d004d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:53.261672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a094146-caab-46e8-96b4-db5c95d004d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:53.262341 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a094146-caab-46e8-96b4-db5c95d004d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:53.263960 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a094146-caab-46e8-96b4-db5c95d004d7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:53.274777 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1371/2746] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:18:53.278958 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca8f96-618f-4993-adfa-070f9388c201 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:53.289375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca8f96-618f-4993-adfa-070f9388c201 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:53.293998 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f32469-f3d4-4a61-896c-d83e300a956d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:53.294634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f32469-f3d4-4a61-896c-d83e300a956d admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:53.294914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f32469-f3d4-4a61-896c-d83e300a956d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:53.295229 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f32469-f3d4-4a61-896c-d83e300a956d admin admin] PATH_INFO: `/v3/projects/d8ae699b7de84822a57c1150f8d3640e/users/1181f4323a5e4eb5822f8900eb41155e/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:53.310632 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f32469-f3d4-4a61-896c-d83e300a956d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ae699b7de84822a57c1150f8d3640e, user_id=1181f4323a5e4eb5822f8900eb41155e, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:53.314393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f32469-f3d4-4a61-896c-d83e300a956d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:53.327393 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1376/2747] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:18:53 2022] PUT /identity/v3/projects/d8ae699b7de84822a57c1150f8d3640e/users/1181f4323a5e4eb5822f8900eb41155e/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:18:53.331387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a094146-caab-46e8-96b4-db5c95d004d7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:53.341398 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a094146-caab-46e8-96b4-db5c95d004d7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:53.397347 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8673fd7-4b05-42a0-8c56-3ecbdd28d39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:53.397879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8673fd7-4b05-42a0-8c56-3ecbdd28d39e admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:53.398157 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8673fd7-4b05-42a0-8c56-3ecbdd28d39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:53.398431 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8673fd7-4b05-42a0-8c56-3ecbdd28d39e admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:53.399061 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8673fd7-4b05-42a0-8c56-3ecbdd28d39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:53.400670 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8673fd7-4b05-42a0-8c56-3ecbdd28d39e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:53.410723 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1372/2748] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:18:53.415109 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f32469-f3d4-4a61-896c-d83e300a956d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:53.426246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f32469-f3d4-4a61-896c-d83e300a956d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:53.430839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae15656-ed3e-479f-9d54-e16635f613e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:53.431514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae15656-ed3e-479f-9d54-e16635f613e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:53.431797 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae15656-ed3e-479f-9d54-e16635f613e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:53.432070 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae15656-ed3e-479f-9d54-e16635f613e9 admin admin] PATH_INFO: `/v3/projects/d8ae699b7de84822a57c1150f8d3640e/users/1181f4323a5e4eb5822f8900eb41155e/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:53.433977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae15656-ed3e-479f-9d54-e16635f613e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ae699b7de84822a57c1150f8d3640e, user_id=1181f4323a5e4eb5822f8900eb41155e, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:53.437150 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae15656-ed3e-479f-9d54-e16635f613e9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:53.447247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1377/2749] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:18:53 2022] PUT /identity/v3/projects/d8ae699b7de84822a57c1150f8d3640e/users/1181f4323a5e4eb5822f8900eb41155e/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:18:53.459131 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8469c-635f-4ce8-9612-2b885b1143ae None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:53.459418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8469c-635f-4ce8-9612-2b885b1143ae None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:53.459695 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8469c-635f-4ce8-9612-2b885b1143ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:53.487868 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b2c8469c-635f-4ce8-9612-2b885b1143ae None None] MFA Rules not processed for user `1181f4323a5e4eb5822f8900eb41155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:18:53.489069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b2c8469c-635f-4ce8-9612-2b885b1143ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:53.555169 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1373/2750] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:18:53 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:18:53.567195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae15656-ed3e-479f-9d54-e16635f613e9 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:53.568927 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7ae15656-ed3e-479f-9d54-e16635f613e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:53.626949 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae15656-ed3e-479f-9d54-e16635f613e9 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:53.630649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916dc4f-16a6-4c81-9b08-75e923184718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:53.631282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916dc4f-16a6-4c81-9b08-75e923184718 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:53.631561 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916dc4f-16a6-4c81-9b08-75e923184718 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:53.631829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916dc4f-16a6-4c81-9b08-75e923184718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:53.645094 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916dc4f-16a6-4c81-9b08-75e923184718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:53.646552 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916dc4f-16a6-4c81-9b08-75e923184718 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:53.656965 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1378/2751] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:18:53 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:18:53.703163 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8469c-635f-4ce8-9612-2b885b1143ae None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:53.704529 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b2c8469c-635f-4ce8-9612-2b885b1143ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:53.716255 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8469c-635f-4ce8-9612-2b885b1143ae None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:53.720366 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7398bb2-b28c-4eda-9884-f232bf4c840c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:53.720957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7398bb2-b28c-4eda-9884-f232bf4c840c service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:53.721232 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7398bb2-b28c-4eda-9884-f232bf4c840c service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:53.721502 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7398bb2-b28c-4eda-9884-f232bf4c840c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:53.762517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:18:53.778694 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7398bb2-b28c-4eda-9884-f232bf4c840c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:53.780742 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7398bb2-b28c-4eda-9884-f232bf4c840c service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:53.789515 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1374/2752] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:18:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:18:56.993777 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916dc4f-16a6-4c81-9b08-75e923184718 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:57.002757 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916dc4f-16a6-4c81-9b08-75e923184718 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:57.006668 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cdc1a-261f-42a4-a076-c33ab8079524 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:57.007239 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cdc1a-261f-42a4-a076-c33ab8079524 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:57.007503 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cdc1a-261f-42a4-a076-c33ab8079524 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:57.007766 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cdc1a-261f-42a4-a076-c33ab8079524 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:57.009481 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cb8cdc1a-261f-42a4-a076-c33ab8079524 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:57.088445 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7398bb2-b28c-4eda-9884-f232bf4c840c service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:57.088936 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cdc1a-261f-42a4-a076-c33ab8079524 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:57.090250 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cdc1a-261f-42a4-a076-c33ab8079524 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:57.102272 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1379/2753] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:18:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:18:57.151909 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7398bb2-b28c-4eda-9884-f232bf4c840c service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:57.157751 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a974879-b2de-49e7-a553-45d350e8596d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:57.158377 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a974879-b2de-49e7-a553-45d350e8596d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:57.158652 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a974879-b2de-49e7-a553-45d350e8596d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:57.158920 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a974879-b2de-49e7-a553-45d350e8596d admin admin] PATH_INFO: `/v3/users/2b376e7078e042ebbb42818c8f5f8404` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:57.160069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a974879-b2de-49e7-a553-45d350e8596d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b376e7078e042ebbb42818c8f5f8404)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:57.162067 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a974879-b2de-49e7-a553-45d350e8596d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:57.211993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0a974879-b2de-49e7-a553-45d350e8596d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b376e7078e042ebbb42818c8f5f8404'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:57.212664 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0a974879-b2de-49e7-a553-45d350e8596d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b376e7078e042ebbb42818c8f5f8404'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:57.213288 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0a974879-b2de-49e7-a553-45d350e8596d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b376e7078e042ebbb42818c8f5f8404'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:57.221171 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0a974879-b2de-49e7-a553-45d350e8596d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b376e7078e042ebbb42818c8f5f8404'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:57.229065 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0a974879-b2de-49e7-a553-45d350e8596d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b376e7078e042ebbb42818c8f5f8404'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:57.247713 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1375/2754] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:18:57 2022] DELETE /identity/v3/users/2b376e7078e042ebbb42818c8f5f8404 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:18:57.252079 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b92f72-7728-467d-8f38-20c3cf706b60 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:57.252566 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b92f72-7728-467d-8f38-20c3cf706b60 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:57.252919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b92f72-7728-467d-8f38-20c3cf706b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:57.272377 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-49b92f72-7728-467d-8f38-20c3cf706b60 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:18:57.273418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-49b92f72-7728-467d-8f38-20c3cf706b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:57.287106 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:18:57.337120 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1380/2755] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:18:57.347848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a974879-b2de-49e7-a553-45d350e8596d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:57.349597 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0a974879-b2de-49e7-a553-45d350e8596d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:57.418088 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a974879-b2de-49e7-a553-45d350e8596d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:57.422610 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c1d82-6437-448b-b073-168af9f68dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:57.423250 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c1d82-6437-448b-b073-168af9f68dbe service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:57.423525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c1d82-6437-448b-b073-168af9f68dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:57.423792 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c1d82-6437-448b-b073-168af9f68dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:57.432982 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c1d82-6437-448b-b073-168af9f68dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:57.434542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c1d82-6437-448b-b073-168af9f68dbe service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:57.444589 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1376/2756] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:18:57.725127 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b92f72-7728-467d-8f38-20c3cf706b60 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:57.726603 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-49b92f72-7728-467d-8f38-20c3cf706b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:57.740100 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b92f72-7728-467d-8f38-20c3cf706b60 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:57.744588 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e734-d62e-4390-8da4-01207377bb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:57.745207 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e734-d62e-4390-8da4-01207377bb95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:57.745482 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e734-d62e-4390-8da4-01207377bb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:57.745749 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e734-d62e-4390-8da4-01207377bb95 admin admin] PATH_INFO: `/v3/projects/10608e79d5554791b14bed414df8e01f` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:57.746908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0e734-d62e-4390-8da4-01207377bb95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10608e79d5554791b14bed414df8e01f)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:57.749738 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0e734-d62e-4390-8da4-01207377bb95 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:57.796511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4ad0e734-d62e-4390-8da4-01207377bb95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10608e79d5554791b14bed414df8e01f', 'request_id': 'req-4ad0e734-d62e-4390-8da4-01207377bb95'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:57.801993 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4ad0e734-d62e-4390-8da4-01207377bb95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10608e79d5554791b14bed414df8e01f', 'request_id': 'req-4ad0e734-d62e-4390-8da4-01207377bb95'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:57.807889 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4ad0e734-d62e-4390-8da4-01207377bb95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10608e79d5554791b14bed414df8e01f', 'request_id': 'req-4ad0e734-d62e-4390-8da4-01207377bb95'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:57.819924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4ad0e734-d62e-4390-8da4-01207377bb95 admin admin] The token cache is being invalidate because project 10608e79d5554791b14bed414df8e01f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:18:57.820204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4ad0e734-d62e-4390-8da4-01207377bb95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:57.820804 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4ad0e734-d62e-4390-8da4-01207377bb95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:57.822258 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1381/2757] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:18:57 2022] DELETE /identity/v3/projects/10608e79d5554791b14bed414df8e01f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:18:57.826296 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c1d82-6437-448b-b073-168af9f68dbe service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:57.833281 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:18:57.837219 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c1d82-6437-448b-b073-168af9f68dbe service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:57.894008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb812d5-299f-43f1-9136-088f9a500ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:57.894656 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb812d5-299f-43f1-9136-088f9a500ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:57.894958 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb812d5-299f-43f1-9136-088f9a500ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:57.895231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb812d5-299f-43f1-9136-088f9a500ebf admin admin] PATH_INFO: `/v3/users/1181f4323a5e4eb5822f8900eb41155e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:57.896346 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb812d5-299f-43f1-9136-088f9a500ebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1181f4323a5e4eb5822f8900eb41155e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:57.898233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb812d5-299f-43f1-9136-088f9a500ebf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:57.943045 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-efb812d5-299f-43f1-9136-088f9a500ebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1181f4323a5e4eb5822f8900eb41155e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:57.943634 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-efb812d5-299f-43f1-9136-088f9a500ebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1181f4323a5e4eb5822f8900eb41155e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:57.944251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-efb812d5-299f-43f1-9136-088f9a500ebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1181f4323a5e4eb5822f8900eb41155e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:57.951050 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-efb812d5-299f-43f1-9136-088f9a500ebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1181f4323a5e4eb5822f8900eb41155e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:57.959579 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-efb812d5-299f-43f1-9136-088f9a500ebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1181f4323a5e4eb5822f8900eb41155e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:57.977392 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1377/2758] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:18:57 2022] DELETE /identity/v3/users/1181f4323a5e4eb5822f8900eb41155e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:18:58.253209 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e734-d62e-4390-8da4-01207377bb95 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:58.254670 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4ad0e734-d62e-4390-8da4-01207377bb95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:58.270920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e734-d62e-4390-8da4-01207377bb95 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:58.329013 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b4024-3604-43c0-a7a3-a9b397e5f641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:58.329638 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b4024-3604-43c0-a7a3-a9b397e5f641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:58.329941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b4024-3604-43c0-a7a3-a9b397e5f641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:58.330206 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b4024-3604-43c0-a7a3-a9b397e5f641 admin admin] PATH_INFO: `/v3/projects/d8ae699b7de84822a57c1150f8d3640e` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:58.331333 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b4024-3604-43c0-a7a3-a9b397e5f641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ae699b7de84822a57c1150f8d3640e)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:58.333205 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b4024-3604-43c0-a7a3-a9b397e5f641 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:58.375147 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:18:58.378183 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-458b4024-3604-43c0-a7a3-a9b397e5f641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ae699b7de84822a57c1150f8d3640e', 'request_id': 'req-458b4024-3604-43c0-a7a3-a9b397e5f641'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:58.384247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-458b4024-3604-43c0-a7a3-a9b397e5f641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ae699b7de84822a57c1150f8d3640e', 'request_id': 'req-458b4024-3604-43c0-a7a3-a9b397e5f641'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:58.391742 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-458b4024-3604-43c0-a7a3-a9b397e5f641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ae699b7de84822a57c1150f8d3640e', 'request_id': 'req-458b4024-3604-43c0-a7a3-a9b397e5f641'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:58.403724 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-458b4024-3604-43c0-a7a3-a9b397e5f641 admin admin] The token cache is being invalidate because project d8ae699b7de84822a57c1150f8d3640e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:18:58.404008 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-458b4024-3604-43c0-a7a3-a9b397e5f641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:58.404629 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-458b4024-3604-43c0-a7a3-a9b397e5f641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:18:58.406717 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1382/2759] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:18:58 2022] DELETE /identity/v3/projects/d8ae699b7de84822a57c1150f8d3640e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:18:58.412640 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17483a-925b-4fd3-98b3-660ca1b59ff5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:58.413134 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17483a-925b-4fd3-98b3-660ca1b59ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:58.413622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17483a-925b-4fd3-98b3-660ca1b59ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:58.433313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ec17483a-925b-4fd3-98b3-660ca1b59ff5 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:18:58.434512 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ec17483a-925b-4fd3-98b3-660ca1b59ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:58.493867 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1378/2760] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:18:58.501793 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097988d-766c-4ccd-987f-9ed069d7dec2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:58.502077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097988d-766c-4ccd-987f-9ed069d7dec2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:58.502348 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097988d-766c-4ccd-987f-9ed069d7dec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:58.523518 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0097988d-766c-4ccd-987f-9ed069d7dec2 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:18:58.524723 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0097988d-766c-4ccd-987f-9ed069d7dec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:58.535615 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1383/2761] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:18:58.539730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17483a-925b-4fd3-98b3-660ca1b59ff5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:58.550266 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17483a-925b-4fd3-98b3-660ca1b59ff5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:58.555095 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2934b72-2013-4065-83f2-daab51bbd534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:58.556330 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2934b72-2013-4065-83f2-daab51bbd534 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:58.556612 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2934b72-2013-4065-83f2-daab51bbd534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:58.556881 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2934b72-2013-4065-83f2-daab51bbd534 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:58.557605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2934b72-2013-4065-83f2-daab51bbd534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:18:58.557877 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2934b72-2013-4065-83f2-daab51bbd534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:58.559482 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2934b72-2013-4065-83f2-daab51bbd534 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:58.571953 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1379/2762] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:18:58.576311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097988d-766c-4ccd-987f-9ed069d7dec2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:58.586209 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097988d-766c-4ccd-987f-9ed069d7dec2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:58.591373 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2fee0-516b-46fb-b1f4-5c034d3f0b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:58.592024 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2fee0-516b-46fb-b1f4-5c034d3f0b33 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:58.592401 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2fee0-516b-46fb-b1f4-5c034d3f0b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:58.593237 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2fee0-516b-46fb-b1f4-5c034d3f0b33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:58.593885 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2fee0-516b-46fb-b1f4-5c034d3f0b33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:58.595775 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2fee0-516b-46fb-b1f4-5c034d3f0b33 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:58.625569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1384/2763] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:18:58 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:18:58.630665 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2934b72-2013-4065-83f2-daab51bbd534 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:58.641706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2934b72-2013-4065-83f2-daab51bbd534 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:58.649814 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:18:58.702179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbde43d-5500-4176-a6b2-5033f806bad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:58.702804 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbde43d-5500-4176-a6b2-5033f806bad4 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:58.703073 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbde43d-5500-4176-a6b2-5033f806bad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:58.703424 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbde43d-5500-4176-a6b2-5033f806bad4 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:58.703984 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbde43d-5500-4176-a6b2-5033f806bad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:58.705886 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbde43d-5500-4176-a6b2-5033f806bad4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:58.726711 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1380/2764] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:18:58 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:18:58.730803 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2fee0-516b-46fb-b1f4-5c034d3f0b33 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:58.741489 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2fee0-516b-46fb-b1f4-5c034d3f0b33 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:58.745934 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de9c71-0448-4a12-98f1-187af9450562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:58.746516 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de9c71-0448-4a12-98f1-187af9450562 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:58.746787 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de9c71-0448-4a12-98f1-187af9450562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:58.747052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de9c71-0448-4a12-98f1-187af9450562 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:58.747709 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de9c71-0448-4a12-98f1-187af9450562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:58.749320 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de9c71-0448-4a12-98f1-187af9450562 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:58.759067 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1385/2765] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:18:58.762887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbde43d-5500-4176-a6b2-5033f806bad4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:58.773122 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbde43d-5500-4176-a6b2-5033f806bad4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:58.777776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574416d-4547-48af-a4c7-2afa4bf0269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:58.778398 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574416d-4547-48af-a4c7-2afa4bf0269e admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:58.778678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574416d-4547-48af-a4c7-2afa4bf0269e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:58.778948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574416d-4547-48af-a4c7-2afa4bf0269e admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:58.779623 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574416d-4547-48af-a4c7-2afa4bf0269e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:58.781747 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574416d-4547-48af-a4c7-2afa4bf0269e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:58.792134 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1381/2766] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:18:58.796195 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de9c71-0448-4a12-98f1-187af9450562 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:58.805950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de9c71-0448-4a12-98f1-187af9450562 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:58.810527 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74f20e-9e38-4f42-a75b-b0fb168fd59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:58.811680 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74f20e-9e38-4f42-a75b-b0fb168fd59a admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:58.812016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74f20e-9e38-4f42-a75b-b0fb168fd59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:58.812293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74f20e-9e38-4f42-a75b-b0fb168fd59a admin admin] PATH_INFO: `/v3/projects/ae53156284564fcc8bdbf54b2201e3f7/users/ff7c6a7a535e46f18d1fc5d60bc90488/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:58.826685 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74f20e-9e38-4f42-a75b-b0fb168fd59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae53156284564fcc8bdbf54b2201e3f7, user_id=ff7c6a7a535e46f18d1fc5d60bc90488, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:58.829898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74f20e-9e38-4f42-a75b-b0fb168fd59a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:58.842623 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1386/2767] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:18:58 2022] PUT /identity/v3/projects/ae53156284564fcc8bdbf54b2201e3f7/users/ff7c6a7a535e46f18d1fc5d60bc90488/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:18:58.853887 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2faa8-5852-449b-86e3-9441e8f5ca1c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:58.854172 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2faa8-5852-449b-86e3-9441e8f5ca1c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:58.854441 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2faa8-5852-449b-86e3-9441e8f5ca1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:58.881845 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-42f2faa8-5852-449b-86e3-9441e8f5ca1c None None] MFA Rules not processed for user `ff7c6a7a535e46f18d1fc5d60bc90488`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:18:58.883024 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-42f2faa8-5852-449b-86e3-9441e8f5ca1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:58.946725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1382/2768] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:18:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:18:58.951280 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74f20e-9e38-4f42-a75b-b0fb168fd59a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:59.011322 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74f20e-9e38-4f42-a75b-b0fb168fd59a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:59.015909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5872746-cb2b-48cf-80fe-5be46acf8166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:59.016496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5872746-cb2b-48cf-80fe-5be46acf8166 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:59.016768 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5872746-cb2b-48cf-80fe-5be46acf8166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:59.017035 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5872746-cb2b-48cf-80fe-5be46acf8166 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:59.017648 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5872746-cb2b-48cf-80fe-5be46acf8166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:59.019541 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5872746-cb2b-48cf-80fe-5be46acf8166 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:59.046840 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1387/2769] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:18:58 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:18:59.050703 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2faa8-5852-449b-86e3-9441e8f5ca1c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:59.062193 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2faa8-5852-449b-86e3-9441e8f5ca1c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:59.117171 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a700582-6228-4707-8e8a-dc1651d53e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:59.117773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700582-6228-4707-8e8a-dc1651d53e19 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:59.118055 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700582-6228-4707-8e8a-dc1651d53e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:59.118330 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700582-6228-4707-8e8a-dc1651d53e19 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:59.118941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a700582-6228-4707-8e8a-dc1651d53e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:59.120883 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a700582-6228-4707-8e8a-dc1651d53e19 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:59.141562 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1383/2770] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:18:59 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:18:59.146327 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5872746-cb2b-48cf-80fe-5be46acf8166 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:59.156489 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5872746-cb2b-48cf-80fe-5be46acf8166 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:59.161416 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d9ac2-2bce-4b27-af4a-61b63c456d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:59.162006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d9ac2-2bce-4b27-af4a-61b63c456d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:59.162310 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d9ac2-2bce-4b27-af4a-61b63c456d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:59.162579 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d9ac2-2bce-4b27-af4a-61b63c456d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:59.163243 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d9ac2-2bce-4b27-af4a-61b63c456d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:59.164796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d9ac2-2bce-4b27-af4a-61b63c456d4c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:59.176851 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1388/2771] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:18:59.180820 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a700582-6228-4707-8e8a-dc1651d53e19 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:59.191101 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a700582-6228-4707-8e8a-dc1651d53e19 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:59.195956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c52e68-5083-4578-8473-bf40169da47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:59.196543 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c52e68-5083-4578-8473-bf40169da47f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:59.196817 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c52e68-5083-4578-8473-bf40169da47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:59.197089 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c52e68-5083-4578-8473-bf40169da47f admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:59.197717 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c52e68-5083-4578-8473-bf40169da47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:59.199313 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c52e68-5083-4578-8473-bf40169da47f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:59.201289 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:18:59.210300 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1384/2772] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:18:59.214096 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d9ac2-2bce-4b27-af4a-61b63c456d4c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:59.223932 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d9ac2-2bce-4b27-af4a-61b63c456d4c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:59.228421 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9c05b-3653-46d4-9b01-d028fb774c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:59.229052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9c05b-3653-46d4-9b01-d028fb774c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:59.229326 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9c05b-3653-46d4-9b01-d028fb774c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:59.229594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9c05b-3653-46d4-9b01-d028fb774c91 admin admin] PATH_INFO: `/v3/projects/59af731c38d1482fb44631617ad9dcce/users/0115105f01df40f2a951d1b8f75adb38/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:59.244193 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9c05b-3653-46d4-9b01-d028fb774c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59af731c38d1482fb44631617ad9dcce, user_id=0115105f01df40f2a951d1b8f75adb38, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:59.246780 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9c05b-3653-46d4-9b01-d028fb774c91 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:59.260256 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1389/2773] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:18:59 2022] PUT /identity/v3/projects/59af731c38d1482fb44631617ad9dcce/users/0115105f01df40f2a951d1b8f75adb38/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:18:59.271307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9ec9d-794f-4f77-8fd1-1277cb606f25 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:59.271595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9ec9d-794f-4f77-8fd1-1277cb606f25 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:59.271946 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9ec9d-794f-4f77-8fd1-1277cb606f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:59.301929 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-dbc9ec9d-794f-4f77-8fd1-1277cb606f25 None None] MFA Rules not processed for user `0115105f01df40f2a951d1b8f75adb38`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:18:59.303322 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dbc9ec9d-794f-4f77-8fd1-1277cb606f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:59.372383 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1385/2774] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:18:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:18:59.376946 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9c05b-3653-46d4-9b01-d028fb774c91 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:59.398618 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:18:59.444879 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9c05b-3653-46d4-9b01-d028fb774c91 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:59.449551 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac87dc-0106-43fc-827a-7e5219fc221a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:59.450148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac87dc-0106-43fc-827a-7e5219fc221a admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:59.450422 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac87dc-0106-43fc-827a-7e5219fc221a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:59.450691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac87dc-0106-43fc-827a-7e5219fc221a admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:59.451339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac87dc-0106-43fc-827a-7e5219fc221a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:59.454040 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac87dc-0106-43fc-827a-7e5219fc221a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:59.482496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1390/2775] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:18:59 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:18:59.487115 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9ec9d-794f-4f77-8fd1-1277cb606f25 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:59.498154 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9ec9d-794f-4f77-8fd1-1277cb606f25 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:59.560594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14274992-a55a-4a05-adf4-ded998c91ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:59.561892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14274992-a55a-4a05-adf4-ded998c91ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:59.562181 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14274992-a55a-4a05-adf4-ded998c91ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:59.562454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14274992-a55a-4a05-adf4-ded998c91ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:59.563120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14274992-a55a-4a05-adf4-ded998c91ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:59.565081 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14274992-a55a-4a05-adf4-ded998c91ff5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:59.586597 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1386/2776] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:18:59 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:18:59.590570 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac87dc-0106-43fc-827a-7e5219fc221a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:59.602259 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac87dc-0106-43fc-827a-7e5219fc221a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:59.606861 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c81acb-7175-4b12-b1af-f18bab9789e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:59.607591 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c81acb-7175-4b12-b1af-f18bab9789e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:59.608714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c81acb-7175-4b12-b1af-f18bab9789e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:59.608972 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c81acb-7175-4b12-b1af-f18bab9789e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:59.609611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c81acb-7175-4b12-b1af-f18bab9789e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:59.611200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c81acb-7175-4b12-b1af-f18bab9789e4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:59.622257 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1391/2777] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:18:59.627610 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14274992-a55a-4a05-adf4-ded998c91ff5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:59.638123 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14274992-a55a-4a05-adf4-ded998c91ff5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:59.643658 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef083452-5581-43b4-a84e-be7e84753cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:59.644307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef083452-5581-43b4-a84e-be7e84753cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:59.644582 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef083452-5581-43b4-a84e-be7e84753cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:59.644850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef083452-5581-43b4-a84e-be7e84753cfd admin admin] PATH_INFO: `/v3/projects/d102ae2d26be4515bb2dcbd622e0fc3f/users/2de84b724c9d47e9865269ad414c7b93/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:59.667036 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef083452-5581-43b4-a84e-be7e84753cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d102ae2d26be4515bb2dcbd622e0fc3f, user_id=2de84b724c9d47e9865269ad414c7b93, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:59.669854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef083452-5581-43b4-a84e-be7e84753cfd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:59.684638 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1387/2778] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:18:59 2022] PUT /identity/v3/projects/d102ae2d26be4515bb2dcbd622e0fc3f/users/2de84b724c9d47e9865269ad414c7b93/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:18:59.689086 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c81acb-7175-4b12-b1af-f18bab9789e4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:59.699149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c81acb-7175-4b12-b1af-f18bab9789e4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:59.758531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66e782-067b-45cf-9a60-b0459da1be87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:59.759191 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66e782-067b-45cf-9a60-b0459da1be87 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:59.759468 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66e782-067b-45cf-9a60-b0459da1be87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:59.759733 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66e782-067b-45cf-9a60-b0459da1be87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:59.760362 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66e782-067b-45cf-9a60-b0459da1be87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:59.762343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66e782-067b-45cf-9a60-b0459da1be87 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:59.772372 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1392/2779] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:18:59.777207 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef083452-5581-43b4-a84e-be7e84753cfd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:59.788229 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef083452-5581-43b4-a84e-be7e84753cfd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:18:59.802875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded828c-ff34-47f4-9d7a-f98d002db324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:18:59.803605 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded828c-ff34-47f4-9d7a-f98d002db324 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:59.803879 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded828c-ff34-47f4-9d7a-f98d002db324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:59.804151 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded828c-ff34-47f4-9d7a-f98d002db324 admin admin] PATH_INFO: `/v3/projects/d102ae2d26be4515bb2dcbd622e0fc3f/users/2de84b724c9d47e9865269ad414c7b93/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:59.806088 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded828c-ff34-47f4-9d7a-f98d002db324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d102ae2d26be4515bb2dcbd622e0fc3f, user_id=2de84b724c9d47e9865269ad414c7b93, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:18:59.808739 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded828c-ff34-47f4-9d7a-f98d002db324 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:18:59.821029 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1388/2780] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:18:59 2022] PUT /identity/v3/projects/d102ae2d26be4515bb2dcbd622e0fc3f/users/2de84b724c9d47e9865269ad414c7b93/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:18:59.832196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e26c6-ae37-4c74-a027-b57877b934e1 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:18:59.832483 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e26c6-ae37-4c74-a027-b57877b934e1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:18:59.832756 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e26c6-ae37-4c74-a027-b57877b934e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:18:59.860171 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-656e26c6-ae37-4c74-a027-b57877b934e1 None None] MFA Rules not processed for user `2de84b724c9d47e9865269ad414c7b93`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:18:59.861541 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-656e26c6-ae37-4c74-a027-b57877b934e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:59.935994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1393/2781] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:18:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:18:59.948809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded828c-ff34-47f4-9d7a-f98d002db324 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:18:59.950845 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7ded828c-ff34-47f4-9d7a-f98d002db324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:18:59.995630 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:00.012152 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded828c-ff34-47f4-9d7a-f98d002db324 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:00.016131 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d919d9f-9b68-4e65-b61c-637693a89189 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:00.016925 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d919d9f-9b68-4e65-b61c-637693a89189 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:00.017209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d919d9f-9b68-4e65-b61c-637693a89189 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:00.017477 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d919d9f-9b68-4e65-b61c-637693a89189 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:00.082387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d919d9f-9b68-4e65-b61c-637693a89189 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:00.083869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d919d9f-9b68-4e65-b61c-637693a89189 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:00.093566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1389/2782] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:18:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:19:01.074261 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb21c1-7ec2-4c7b-a449-32f602051063 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:01.074753 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb21c1-7ec2-4c7b-a449-32f602051063 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:01.074871 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb21c1-7ec2-4c7b-a449-32f602051063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:01.094047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8cbb21c1-7ec2-4c7b-a449-32f602051063 None None] MFA Rules not processed for user `ff988a4b381b4f039a8d990164e575e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:19:01.095328 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8cbb21c1-7ec2-4c7b-a449-32f602051063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:01.104046 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:01.149103 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1394/2783] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:19:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:19:01.607478 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d919d9f-9b68-4e65-b61c-637693a89189 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:01.609018 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1d919d9f-9b68-4e65-b61c-637693a89189 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:01.620691 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d919d9f-9b68-4e65-b61c-637693a89189 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:01.625032 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e00828-5adb-4b0e-a136-296e52ee6116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:01.625830 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e00828-5adb-4b0e-a136-296e52ee6116 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:01.626175 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e00828-5adb-4b0e-a136-296e52ee6116 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:01.626448 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e00828-5adb-4b0e-a136-296e52ee6116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:01.688260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e00828-5adb-4b0e-a136-296e52ee6116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:01.689679 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e00828-5adb-4b0e-a136-296e52ee6116 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:01.699706 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1390/2784] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:19:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:19:01.804345 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb21c1-7ec2-4c7b-a449-32f602051063 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:01.805739 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8cbb21c1-7ec2-4c7b-a449-32f602051063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:01.884897 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb21c1-7ec2-4c7b-a449-32f602051063 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:01.888575 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368829a-916b-4cf3-873a-08767eda0365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:01.889238 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368829a-916b-4cf3-873a-08767eda0365 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:01.889798 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368829a-916b-4cf3-873a-08767eda0365 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:01.890114 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368829a-916b-4cf3-873a-08767eda0365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:01.891964 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c368829a-916b-4cf3-873a-08767eda0365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:01.984434 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368829a-916b-4cf3-873a-08767eda0365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:01.986416 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368829a-916b-4cf3-873a-08767eda0365 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:02.007537 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1395/2785] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:19:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:19:02.305997 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e00828-5adb-4b0e-a136-296e52ee6116 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:02.315343 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e00828-5adb-4b0e-a136-296e52ee6116 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:02.319191 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db8634-e812-4130-a577-a614111af418 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:02.319778 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db8634-e812-4130-a577-a614111af418 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:02.320052 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db8634-e812-4130-a577-a614111af418 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:02.320318 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db8634-e812-4130-a577-a614111af418 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:02.329686 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db8634-e812-4130-a577-a614111af418 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:02.331102 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db8634-e812-4130-a577-a614111af418 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:02.340370 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1391/2786] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:19:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:19:06.267525 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368829a-916b-4cf3-873a-08767eda0365 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:06.327525 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368829a-916b-4cf3-873a-08767eda0365 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:06.332059 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ca028-ae2b-427f-a839-408674d0b92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:06.332666 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ca028-ae2b-427f-a839-408674d0b92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:06.332942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ca028-ae2b-427f-a839-408674d0b92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:06.333204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ca028-ae2b-427f-a839-408674d0b92d admin admin] PATH_INFO: `/v3/users/ff7c6a7a535e46f18d1fc5d60bc90488` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:06.334302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ca028-ae2b-427f-a839-408674d0b92d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff7c6a7a535e46f18d1fc5d60bc90488)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:06.336194 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ca028-ae2b-427f-a839-408674d0b92d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:06.338436 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:06.381944 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-330ca028-ae2b-427f-a839-408674d0b92d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff7c6a7a535e46f18d1fc5d60bc90488'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:06.390261 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-330ca028-ae2b-427f-a839-408674d0b92d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff7c6a7a535e46f18d1fc5d60bc90488'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:06.391104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-330ca028-ae2b-427f-a839-408674d0b92d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff7c6a7a535e46f18d1fc5d60bc90488'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:06.403033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-330ca028-ae2b-427f-a839-408674d0b92d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff7c6a7a535e46f18d1fc5d60bc90488'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:06.409753 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-330ca028-ae2b-427f-a839-408674d0b92d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff7c6a7a535e46f18d1fc5d60bc90488'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:06.415606 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1396/2787] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:19:06 2022] DELETE /identity/v3/users/ff7c6a7a535e46f18d1fc5d60bc90488 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:19:06.420089 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ce29d-45a9-4040-8a3a-8773163a865a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:06.420566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ce29d-45a9-4040-8a3a-8773163a865a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:06.420681 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ce29d-45a9-4040-8a3a-8773163a865a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:06.439759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a32ce29d-45a9-4040-8a3a-8773163a865a None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:19:06.440943 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a32ce29d-45a9-4040-8a3a-8773163a865a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:06.498843 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1392/2788] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:19:06.508530 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ca028-ae2b-427f-a839-408674d0b92d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:06.509919 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-330ca028-ae2b-427f-a839-408674d0b92d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:06.566869 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ca028-ae2b-427f-a839-408674d0b92d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:06.570632 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c431f5-9b09-4142-8731-7bb66aafd714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:06.571267 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c431f5-9b09-4142-8731-7bb66aafd714 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:06.571547 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c431f5-9b09-4142-8731-7bb66aafd714 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:06.571829 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c431f5-9b09-4142-8731-7bb66aafd714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:06.581274 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c431f5-9b09-4142-8731-7bb66aafd714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:06.582689 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c431f5-9b09-4142-8731-7bb66aafd714 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:06.592353 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1397/2789] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:19:06.862743 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ce29d-45a9-4040-8a3a-8773163a865a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:06.864615 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a32ce29d-45a9-4040-8a3a-8773163a865a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:06.876896 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ce29d-45a9-4040-8a3a-8773163a865a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:06.881424 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e2f70-806c-4a5a-b3f3-7755af77b2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:06.882047 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e2f70-806c-4a5a-b3f3-7755af77b2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:06.882324 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e2f70-806c-4a5a-b3f3-7755af77b2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:06.882592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e2f70-806c-4a5a-b3f3-7755af77b2b1 admin admin] PATH_INFO: `/v3/projects/ae53156284564fcc8bdbf54b2201e3f7` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:06.883710 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e2f70-806c-4a5a-b3f3-7755af77b2b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae53156284564fcc8bdbf54b2201e3f7)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:06.885631 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e2f70-806c-4a5a-b3f3-7755af77b2b1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:06.901977 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:06.932969 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e95e2f70-806c-4a5a-b3f3-7755af77b2b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae53156284564fcc8bdbf54b2201e3f7', 'request_id': 'req-e95e2f70-806c-4a5a-b3f3-7755af77b2b1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:06.939285 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e95e2f70-806c-4a5a-b3f3-7755af77b2b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae53156284564fcc8bdbf54b2201e3f7', 'request_id': 'req-e95e2f70-806c-4a5a-b3f3-7755af77b2b1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:06.945035 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e95e2f70-806c-4a5a-b3f3-7755af77b2b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae53156284564fcc8bdbf54b2201e3f7', 'request_id': 'req-e95e2f70-806c-4a5a-b3f3-7755af77b2b1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:06.957112 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e95e2f70-806c-4a5a-b3f3-7755af77b2b1 admin admin] The token cache is being invalidate because project ae53156284564fcc8bdbf54b2201e3f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:19:06.957396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e95e2f70-806c-4a5a-b3f3-7755af77b2b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:06.957995 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e95e2f70-806c-4a5a-b3f3-7755af77b2b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:06.959583 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1393/2790] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:19:06 2022] DELETE /identity/v3/projects/ae53156284564fcc8bdbf54b2201e3f7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:19:06.963611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c431f5-9b09-4142-8731-7bb66aafd714 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:06.973813 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c431f5-9b09-4142-8731-7bb66aafd714 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:07.028058 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034cd99-2fd2-4e36-8414-f235dd73ed1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:07.028687 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034cd99-2fd2-4e36-8414-f235dd73ed1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:07.028966 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034cd99-2fd2-4e36-8414-f235dd73ed1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:07.029244 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034cd99-2fd2-4e36-8414-f235dd73ed1c admin admin] PATH_INFO: `/v3/users/0115105f01df40f2a951d1b8f75adb38` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:07.030898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034cd99-2fd2-4e36-8414-f235dd73ed1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0115105f01df40f2a951d1b8f75adb38)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:07.032822 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034cd99-2fd2-4e36-8414-f235dd73ed1c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:07.060920 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:07.082660 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9034cd99-2fd2-4e36-8414-f235dd73ed1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0115105f01df40f2a951d1b8f75adb38'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:07.090119 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9034cd99-2fd2-4e36-8414-f235dd73ed1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0115105f01df40f2a951d1b8f75adb38'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:07.090735 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9034cd99-2fd2-4e36-8414-f235dd73ed1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0115105f01df40f2a951d1b8f75adb38'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:07.104463 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9034cd99-2fd2-4e36-8414-f235dd73ed1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0115105f01df40f2a951d1b8f75adb38'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:07.112691 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9034cd99-2fd2-4e36-8414-f235dd73ed1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0115105f01df40f2a951d1b8f75adb38'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:07.123771 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1398/2791] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:19:06 2022] DELETE /identity/v3/users/0115105f01df40f2a951d1b8f75adb38 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:19:07.585023 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e2f70-806c-4a5a-b3f3-7755af77b2b1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:07.586980 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e95e2f70-806c-4a5a-b3f3-7755af77b2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:07.600651 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e2f70-806c-4a5a-b3f3-7755af77b2b1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:07.672306 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f384f-2970-46c5-b7f9-34577d2f6888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:07.672967 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f384f-2970-46c5-b7f9-34577d2f6888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:07.673242 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f384f-2970-46c5-b7f9-34577d2f6888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:07.673532 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f384f-2970-46c5-b7f9-34577d2f6888 admin admin] PATH_INFO: `/v3/projects/59af731c38d1482fb44631617ad9dcce` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:07.674671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f384f-2970-46c5-b7f9-34577d2f6888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59af731c38d1482fb44631617ad9dcce)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:07.676607 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f384f-2970-46c5-b7f9-34577d2f6888 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:07.722713 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ae5f384f-2970-46c5-b7f9-34577d2f6888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59af731c38d1482fb44631617ad9dcce', 'request_id': 'req-ae5f384f-2970-46c5-b7f9-34577d2f6888'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:07.728659 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ae5f384f-2970-46c5-b7f9-34577d2f6888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59af731c38d1482fb44631617ad9dcce', 'request_id': 'req-ae5f384f-2970-46c5-b7f9-34577d2f6888'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:07.734650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ae5f384f-2970-46c5-b7f9-34577d2f6888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59af731c38d1482fb44631617ad9dcce', 'request_id': 'req-ae5f384f-2970-46c5-b7f9-34577d2f6888'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:07.747058 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ae5f384f-2970-46c5-b7f9-34577d2f6888 admin admin] The token cache is being invalidate because project 59af731c38d1482fb44631617ad9dcce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:19:07.747472 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ae5f384f-2970-46c5-b7f9-34577d2f6888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:07.748079 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ae5f384f-2970-46c5-b7f9-34577d2f6888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:07.749760 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1394/2792] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:19:07 2022] DELETE /identity/v3/projects/59af731c38d1482fb44631617ad9dcce => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:19:07.755306 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034cd99-2fd2-4e36-8414-f235dd73ed1c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:07.756773 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9034cd99-2fd2-4e36-8414-f235dd73ed1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:07.769521 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034cd99-2fd2-4e36-8414-f235dd73ed1c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:07.827015 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eb4e0-7c55-42d8-ab9e-17b62f5c08e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:07.827673 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eb4e0-7c55-42d8-ab9e-17b62f5c08e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:07.827948 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eb4e0-7c55-42d8-ab9e-17b62f5c08e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:07.828205 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eb4e0-7c55-42d8-ab9e-17b62f5c08e4 admin admin] PATH_INFO: `/v3/users/2de84b724c9d47e9865269ad414c7b93` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:07.829310 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eb4e0-7c55-42d8-ab9e-17b62f5c08e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de84b724c9d47e9865269ad414c7b93)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:07.831204 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eb4e0-7c55-42d8-ab9e-17b62f5c08e4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:07.882994 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-026eb4e0-7c55-42d8-ab9e-17b62f5c08e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de84b724c9d47e9865269ad414c7b93'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:07.891414 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-026eb4e0-7c55-42d8-ab9e-17b62f5c08e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de84b724c9d47e9865269ad414c7b93'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:07.892053 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-026eb4e0-7c55-42d8-ab9e-17b62f5c08e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de84b724c9d47e9865269ad414c7b93'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:07.908731 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-026eb4e0-7c55-42d8-ab9e-17b62f5c08e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de84b724c9d47e9865269ad414c7b93'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:07.917432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-026eb4e0-7c55-42d8-ab9e-17b62f5c08e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de84b724c9d47e9865269ad414c7b93'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:07.928402 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1399/2793] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:19:07 2022] DELETE /identity/v3/users/2de84b724c9d47e9865269ad414c7b93 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:19:08.200017 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f384f-2970-46c5-b7f9-34577d2f6888 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:08.201792 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ae5f384f-2970-46c5-b7f9-34577d2f6888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:08.216592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f384f-2970-46c5-b7f9-34577d2f6888 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:08.250837 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:08.279259 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e0423-3fe8-443d-8faa-d80b15928ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:08.280099 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e0423-3fe8-443d-8faa-d80b15928ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:08.280377 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e0423-3fe8-443d-8faa-d80b15928ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:08.280651 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e0423-3fe8-443d-8faa-d80b15928ac8 admin admin] PATH_INFO: `/v3/projects/d102ae2d26be4515bb2dcbd622e0fc3f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:08.281770 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e0423-3fe8-443d-8faa-d80b15928ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d102ae2d26be4515bb2dcbd622e0fc3f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:08.283774 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e0423-3fe8-443d-8faa-d80b15928ac8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:08.331728 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eb7e0423-3fe8-443d-8faa-d80b15928ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd102ae2d26be4515bb2dcbd622e0fc3f', 'request_id': 'req-eb7e0423-3fe8-443d-8faa-d80b15928ac8'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:08.338110 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eb7e0423-3fe8-443d-8faa-d80b15928ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd102ae2d26be4515bb2dcbd622e0fc3f', 'request_id': 'req-eb7e0423-3fe8-443d-8faa-d80b15928ac8'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:08.343618 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eb7e0423-3fe8-443d-8faa-d80b15928ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd102ae2d26be4515bb2dcbd622e0fc3f', 'request_id': 'req-eb7e0423-3fe8-443d-8faa-d80b15928ac8'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:08.355762 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eb7e0423-3fe8-443d-8faa-d80b15928ac8 admin admin] The token cache is being invalidate because project d102ae2d26be4515bb2dcbd622e0fc3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:19:08.356043 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eb7e0423-3fe8-443d-8faa-d80b15928ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:08.356656 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eb7e0423-3fe8-443d-8faa-d80b15928ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:08.358600 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1395/2794] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:19:08 2022] DELETE /identity/v3/projects/d102ae2d26be4515bb2dcbd622e0fc3f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:19:08.363616 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06cbd4-e7e4-4ee0-9aa5-ccea9c3d6ce3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:08.363904 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06cbd4-e7e4-4ee0-9aa5-ccea9c3d6ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:08.364179 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06cbd4-e7e4-4ee0-9aa5-ccea9c3d6ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:08.384668 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2d06cbd4-e7e4-4ee0-9aa5-ccea9c3d6ce3 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:19:08.385912 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2d06cbd4-e7e4-4ee0-9aa5-ccea9c3d6ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:08.404287 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:08.448985 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1400/2795] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:19:08.457769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17449a29-4e49-4186-8048-d1251351cd9e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:08.458048 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17449a29-4e49-4186-8048-d1251351cd9e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:08.458321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17449a29-4e49-4186-8048-d1251351cd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:08.477918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-17449a29-4e49-4186-8048-d1251351cd9e None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:19:08.479113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-17449a29-4e49-4186-8048-d1251351cd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:08.487447 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1396/2796] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:19:08.491564 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06cbd4-e7e4-4ee0-9aa5-ccea9c3d6ce3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:08.501200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06cbd4-e7e4-4ee0-9aa5-ccea9c3d6ce3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:08.505768 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d5a98-12a6-4a53-ba44-45cec0ca1e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:08.506343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d5a98-12a6-4a53-ba44-45cec0ca1e7d admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:08.506616 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d5a98-12a6-4a53-ba44-45cec0ca1e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:08.506883 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d5a98-12a6-4a53-ba44-45cec0ca1e7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:08.507551 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d5a98-12a6-4a53-ba44-45cec0ca1e7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:19:08.507847 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d5a98-12a6-4a53-ba44-45cec0ca1e7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:08.509395 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d5a98-12a6-4a53-ba44-45cec0ca1e7d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:08.520671 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1401/2797] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:19:08.524809 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17449a29-4e49-4186-8048-d1251351cd9e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:08.534937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17449a29-4e49-4186-8048-d1251351cd9e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:08.539596 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c883f-3c62-44b7-9459-4c21e0b0b7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:08.540187 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c883f-3c62-44b7-9459-4c21e0b0b7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:08.540462 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c883f-3c62-44b7-9459-4c21e0b0b7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:08.540731 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c883f-3c62-44b7-9459-4c21e0b0b7c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:08.541344 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c883f-3c62-44b7-9459-4c21e0b0b7c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:08.543253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c883f-3c62-44b7-9459-4c21e0b0b7c6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:08.572528 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1397/2798] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:19:08 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:19:08.577949 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d5a98-12a6-4a53-ba44-45cec0ca1e7d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:08.587768 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d5a98-12a6-4a53-ba44-45cec0ca1e7d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:08.644049 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d3917-02c6-422f-93d1-27f2695e891d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:08.644676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d3917-02c6-422f-93d1-27f2695e891d admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:08.644950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d3917-02c6-422f-93d1-27f2695e891d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:08.645216 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d3917-02c6-422f-93d1-27f2695e891d admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:08.645837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d3917-02c6-422f-93d1-27f2695e891d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:08.647769 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d3917-02c6-422f-93d1-27f2695e891d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:08.668647 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1402/2799] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:19:08 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:19:08.673380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c883f-3c62-44b7-9459-4c21e0b0b7c6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:08.683465 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c883f-3c62-44b7-9459-4c21e0b0b7c6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:08.688537 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990f681-875d-4885-b473-68c4e6a82878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:08.689119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990f681-875d-4885-b473-68c4e6a82878 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:08.689391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990f681-875d-4885-b473-68c4e6a82878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:08.689663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990f681-875d-4885-b473-68c4e6a82878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:08.690289 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990f681-875d-4885-b473-68c4e6a82878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:08.692161 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990f681-875d-4885-b473-68c4e6a82878 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:08.702297 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1398/2800] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:19:08.706165 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d3917-02c6-422f-93d1-27f2695e891d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:08.715807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d3917-02c6-422f-93d1-27f2695e891d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:08.720663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ec01a-f15f-42a1-987e-a2e6bf5c3e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:08.721288 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ec01a-f15f-42a1-987e-a2e6bf5c3e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:08.721569 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ec01a-f15f-42a1-987e-a2e6bf5c3e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:08.721845 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ec01a-f15f-42a1-987e-a2e6bf5c3e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:08.722485 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ec01a-f15f-42a1-987e-a2e6bf5c3e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:08.724105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ec01a-f15f-42a1-987e-a2e6bf5c3e03 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:08.734690 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1403/2801] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:19:08.738663 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990f681-875d-4885-b473-68c4e6a82878 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:08.748999 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990f681-875d-4885-b473-68c4e6a82878 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:08.753677 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfe9c2-ad4d-40be-bf30-556243307329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:08.754307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfe9c2-ad4d-40be-bf30-556243307329 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:08.754581 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfe9c2-ad4d-40be-bf30-556243307329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:08.754852 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfe9c2-ad4d-40be-bf30-556243307329 admin admin] PATH_INFO: `/v3/projects/37f0029d275a48dba375fabf3ae03bd9/users/a20ab5321231420dbf2c26d36b53c587/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:08.769439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfe9c2-ad4d-40be-bf30-556243307329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f0029d275a48dba375fabf3ae03bd9, user_id=a20ab5321231420dbf2c26d36b53c587, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:08.772081 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfe9c2-ad4d-40be-bf30-556243307329 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:08.785307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1399/2802] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:19:08 2022] PUT /identity/v3/projects/37f0029d275a48dba375fabf3ae03bd9/users/a20ab5321231420dbf2c26d36b53c587/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:19:08.795929 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1930a-10a8-404b-bbbe-71d4bff8a925 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:08.796405 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1930a-10a8-404b-bbbe-71d4bff8a925 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:08.796526 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1930a-10a8-404b-bbbe-71d4bff8a925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:08.824075 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c6d1930a-10a8-404b-bbbe-71d4bff8a925 None None] MFA Rules not processed for user `a20ab5321231420dbf2c26d36b53c587`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:19:08.825293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c6d1930a-10a8-404b-bbbe-71d4bff8a925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:08.887958 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1404/2803] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:19:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:19:08.899518 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfe9c2-ad4d-40be-bf30-556243307329 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:08.901194 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0fdfe9c2-ad4d-40be-bf30-556243307329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:08.959725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfe9c2-ad4d-40be-bf30-556243307329 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:08.963342 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11c233-7860-4570-85ed-b7ff326c4fbb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44c764958784616b8bdbf59e5692ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:08.963942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11c233-7860-4570-85ed-b7ff326c4fbb service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:08.964223 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11c233-7860-4570-85ed-b7ff326c4fbb service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:08.964492 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11c233-7860-4570-85ed-b7ff326c4fbb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:08.974169 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11c233-7860-4570-85ed-b7ff326c4fbb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:08.975622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11c233-7860-4570-85ed-b7ff326c4fbb service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:08.985387 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1400/2804] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:19:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:19:18.885196 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:18.981126 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:34.739776 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1930a-10a8-404b-bbbe-71d4bff8a925 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:34.800294 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1930a-10a8-404b-bbbe-71d4bff8a925 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:34.805730 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c59776-ccd7-480b-9a47-cb6d903d6015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:34.806340 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c59776-ccd7-480b-9a47-cb6d903d6015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:34.806610 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c59776-ccd7-480b-9a47-cb6d903d6015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:34.806873 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c59776-ccd7-480b-9a47-cb6d903d6015 admin admin] PATH_INFO: `/v3/users/a20ab5321231420dbf2c26d36b53c587` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:34.808010 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c59776-ccd7-480b-9a47-cb6d903d6015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a20ab5321231420dbf2c26d36b53c587)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:34.809908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c59776-ccd7-480b-9a47-cb6d903d6015 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:34.858342 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e5c59776-ccd7-480b-9a47-cb6d903d6015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a20ab5321231420dbf2c26d36b53c587'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:34.865775 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e5c59776-ccd7-480b-9a47-cb6d903d6015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a20ab5321231420dbf2c26d36b53c587'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:34.866485 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e5c59776-ccd7-480b-9a47-cb6d903d6015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a20ab5321231420dbf2c26d36b53c587'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:34.877924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e5c59776-ccd7-480b-9a47-cb6d903d6015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a20ab5321231420dbf2c26d36b53c587'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:34.885268 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e5c59776-ccd7-480b-9a47-cb6d903d6015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a20ab5321231420dbf2c26d36b53c587'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:34.890909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1405/2805] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:19:34 2022] DELETE /identity/v3/users/a20ab5321231420dbf2c26d36b53c587 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:19:34.895465 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3957e-afba-47f8-95fd-32869031b67b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:34.895994 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3957e-afba-47f8-95fd-32869031b67b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:34.896116 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3957e-afba-47f8-95fd-32869031b67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:34.915597 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-17c3957e-afba-47f8-95fd-32869031b67b None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:19:34.916831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-17c3957e-afba-47f8-95fd-32869031b67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:34.973890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1401/2806] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:19:34.984162 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c59776-ccd7-480b-9a47-cb6d903d6015 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:34.985553 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e5c59776-ccd7-480b-9a47-cb6d903d6015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:35.041676 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c59776-ccd7-480b-9a47-cb6d903d6015 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:35.045265 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9256d1b-e670-4c3d-b36d-f31a61f39b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:35.045855 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9256d1b-e670-4c3d-b36d-f31a61f39b26 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:35.046130 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9256d1b-e670-4c3d-b36d-f31a61f39b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:35.046398 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9256d1b-e670-4c3d-b36d-f31a61f39b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:35.055252 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9256d1b-e670-4c3d-b36d-f31a61f39b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:35.056648 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9256d1b-e670-4c3d-b36d-f31a61f39b26 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:35.065706 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1406/2807] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:19:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:19:35.330920 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3957e-afba-47f8-95fd-32869031b67b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:35.332397 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-17c3957e-afba-47f8-95fd-32869031b67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:35.343964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3957e-afba-47f8-95fd-32869031b67b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:35.348585 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c43c1-afe5-493b-86d0-adb92a817a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:35.349209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c43c1-afe5-493b-86d0-adb92a817a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:35.349516 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c43c1-afe5-493b-86d0-adb92a817a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:35.349788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c43c1-afe5-493b-86d0-adb92a817a9a admin admin] PATH_INFO: `/v3/projects/37f0029d275a48dba375fabf3ae03bd9` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:35.352020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c43c1-afe5-493b-86d0-adb92a817a9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f0029d275a48dba375fabf3ae03bd9)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:35.354035 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c43c1-afe5-493b-86d0-adb92a817a9a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:35.401410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-590c43c1-afe5-493b-86d0-adb92a817a9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f0029d275a48dba375fabf3ae03bd9', 'request_id': 'req-590c43c1-afe5-493b-86d0-adb92a817a9a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:35.407349 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-590c43c1-afe5-493b-86d0-adb92a817a9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f0029d275a48dba375fabf3ae03bd9', 'request_id': 'req-590c43c1-afe5-493b-86d0-adb92a817a9a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:35.412769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-590c43c1-afe5-493b-86d0-adb92a817a9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f0029d275a48dba375fabf3ae03bd9', 'request_id': 'req-590c43c1-afe5-493b-86d0-adb92a817a9a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:35.425903 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-590c43c1-afe5-493b-86d0-adb92a817a9a admin admin] The token cache is being invalidate because project 37f0029d275a48dba375fabf3ae03bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:19:35.426184 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-590c43c1-afe5-493b-86d0-adb92a817a9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:35.426790 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-590c43c1-afe5-493b-86d0-adb92a817a9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:35.428311 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1402/2808] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:19:35 2022] DELETE /identity/v3/projects/37f0029d275a48dba375fabf3ae03bd9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:19:35.435052 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed040f-9711-444a-ae88-608e5e2b7261 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:35.437981 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed040f-9711-444a-ae88-608e5e2b7261 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:35.437981 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed040f-9711-444a-ae88-608e5e2b7261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:35.455112 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-14ed040f-9711-444a-ae88-608e5e2b7261 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:19:35.456309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-14ed040f-9711-444a-ae88-608e5e2b7261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:35.472963 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:35.517663 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1407/2809] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:19:35.526395 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d90b6-1698-42dc-82ea-67e49a3c1e9e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:35.526680 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d90b6-1698-42dc-82ea-67e49a3c1e9e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:35.526954 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d90b6-1698-42dc-82ea-67e49a3c1e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:35.546732 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-102d90b6-1698-42dc-82ea-67e49a3c1e9e None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:19:35.547960 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-102d90b6-1698-42dc-82ea-67e49a3c1e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:35.556350 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1403/2810] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:19:35.560406 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed040f-9711-444a-ae88-608e5e2b7261 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:35.570736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed040f-9711-444a-ae88-608e5e2b7261 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:35.575283 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6edc00-a3ed-49b2-81da-9b22bc9dece4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:35.575866 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6edc00-a3ed-49b2-81da-9b22bc9dece4 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:35.576143 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6edc00-a3ed-49b2-81da-9b22bc9dece4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:35.576410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6edc00-a3ed-49b2-81da-9b22bc9dece4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:35.577057 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6edc00-a3ed-49b2-81da-9b22bc9dece4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:19:35.577357 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6edc00-a3ed-49b2-81da-9b22bc9dece4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:35.578928 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6edc00-a3ed-49b2-81da-9b22bc9dece4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:35.591025 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1408/2811] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:19:35.595014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d90b6-1698-42dc-82ea-67e49a3c1e9e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:35.605016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d90b6-1698-42dc-82ea-67e49a3c1e9e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:35.609836 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78531a78-7b2d-4b6c-b1ee-f65899ac119a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:35.610418 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78531a78-7b2d-4b6c-b1ee-f65899ac119a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:35.610690 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78531a78-7b2d-4b6c-b1ee-f65899ac119a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:35.610956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78531a78-7b2d-4b6c-b1ee-f65899ac119a admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:35.611629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78531a78-7b2d-4b6c-b1ee-f65899ac119a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:35.613484 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78531a78-7b2d-4b6c-b1ee-f65899ac119a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:35.641382 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1404/2812] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:19:35 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:19:35.645450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6edc00-a3ed-49b2-81da-9b22bc9dece4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:35.656432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6edc00-a3ed-49b2-81da-9b22bc9dece4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:35.714018 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b52c1-f2dd-4fd3-9bd2-f31393f2248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:35.714623 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b52c1-f2dd-4fd3-9bd2-f31393f2248c admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:35.714896 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b52c1-f2dd-4fd3-9bd2-f31393f2248c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:35.715208 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b52c1-f2dd-4fd3-9bd2-f31393f2248c admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:35.715836 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b52c1-f2dd-4fd3-9bd2-f31393f2248c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:35.717720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b52c1-f2dd-4fd3-9bd2-f31393f2248c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:35.739639 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1409/2813] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:19:35 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:19:35.743828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78531a78-7b2d-4b6c-b1ee-f65899ac119a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:35.753893 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78531a78-7b2d-4b6c-b1ee-f65899ac119a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:35.758616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a0b11-17ec-4901-a1b8-5bd3f12bf077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:35.759243 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a0b11-17ec-4901-a1b8-5bd3f12bf077 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:35.759519 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a0b11-17ec-4901-a1b8-5bd3f12bf077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:35.759785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a0b11-17ec-4901-a1b8-5bd3f12bf077 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:35.760410 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a0b11-17ec-4901-a1b8-5bd3f12bf077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:35.761967 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a0b11-17ec-4901-a1b8-5bd3f12bf077 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:35.771468 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1405/2814] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:19:35.775807 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b52c1-f2dd-4fd3-9bd2-f31393f2248c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:35.785498 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b52c1-f2dd-4fd3-9bd2-f31393f2248c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:35.790800 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7021b6e-b6fc-4088-a976-ce6b09f3f121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:35.791414 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7021b6e-b6fc-4088-a976-ce6b09f3f121 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:35.791693 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7021b6e-b6fc-4088-a976-ce6b09f3f121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:35.791965 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7021b6e-b6fc-4088-a976-ce6b09f3f121 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:35.792601 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7021b6e-b6fc-4088-a976-ce6b09f3f121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:35.794154 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7021b6e-b6fc-4088-a976-ce6b09f3f121 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:35.804377 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1410/2815] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:19:35.808488 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a0b11-17ec-4901-a1b8-5bd3f12bf077 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:35.818716 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a0b11-17ec-4901-a1b8-5bd3f12bf077 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:35.823391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fe70e-a006-45ff-b135-17677fa8d073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:35.824027 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fe70e-a006-45ff-b135-17677fa8d073 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:35.824307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fe70e-a006-45ff-b135-17677fa8d073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:35.824589 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fe70e-a006-45ff-b135-17677fa8d073 admin admin] PATH_INFO: `/v3/projects/cc53d381895842dbb9d45291206ab579/users/5ca84146b1d7450cb3ab2f4675b3214a/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:35.840274 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fe70e-a006-45ff-b135-17677fa8d073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc53d381895842dbb9d45291206ab579, user_id=5ca84146b1d7450cb3ab2f4675b3214a, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:35.842877 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fe70e-a006-45ff-b135-17677fa8d073 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:35.856416 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1406/2816] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:19:35 2022] PUT /identity/v3/projects/cc53d381895842dbb9d45291206ab579/users/5ca84146b1d7450cb3ab2f4675b3214a/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:19:35.866635 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae41bee-12e0-41c3-855d-b4ea12c3dc67 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:35.866968 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae41bee-12e0-41c3-855d-b4ea12c3dc67 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:35.867279 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae41bee-12e0-41c3-855d-b4ea12c3dc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:35.894053 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7ae41bee-12e0-41c3-855d-b4ea12c3dc67 None None] MFA Rules not processed for user `5ca84146b1d7450cb3ab2f4675b3214a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:19:35.895460 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7ae41bee-12e0-41c3-855d-b4ea12c3dc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:35.958311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1411/2817] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:19:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:19:35.969986 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fe70e-a006-45ff-b135-17677fa8d073 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:35.971817 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-807fe70e-a006-45ff-b135-17677fa8d073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:35.993294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:36.030112 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fe70e-a006-45ff-b135-17677fa8d073 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:36.033718 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2af29f-ddba-4410-b83f-f063f6685856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:36.034315 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2af29f-ddba-4410-b83f-f063f6685856 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:36.034591 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2af29f-ddba-4410-b83f-f063f6685856 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:36.034890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2af29f-ddba-4410-b83f-f063f6685856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:36.043112 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2af29f-ddba-4410-b83f-f063f6685856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:36.044531 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2af29f-ddba-4410-b83f-f063f6685856 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:36.053101 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1407/2818] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:19:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:19:36.078423 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae41bee-12e0-41c3-855d-b4ea12c3dc67 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:36.101870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:36.144794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae41bee-12e0-41c3-855d-b4ea12c3dc67 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:36.149908 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60ccb4-d54e-4983-a33b-89b02f206816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:36.150523 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60ccb4-d54e-4983-a33b-89b02f206816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:36.150796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60ccb4-d54e-4983-a33b-89b02f206816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:36.151063 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60ccb4-d54e-4983-a33b-89b02f206816 admin admin] PATH_INFO: `/v3/users/5ca84146b1d7450cb3ab2f4675b3214a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:36.152200 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60ccb4-d54e-4983-a33b-89b02f206816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ca84146b1d7450cb3ab2f4675b3214a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:36.154073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60ccb4-d54e-4983-a33b-89b02f206816 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:36.198482 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4a60ccb4-d54e-4983-a33b-89b02f206816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ca84146b1d7450cb3ab2f4675b3214a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:36.206837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4a60ccb4-d54e-4983-a33b-89b02f206816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ca84146b1d7450cb3ab2f4675b3214a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:36.207482 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4a60ccb4-d54e-4983-a33b-89b02f206816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ca84146b1d7450cb3ab2f4675b3214a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:36.220189 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4a60ccb4-d54e-4983-a33b-89b02f206816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ca84146b1d7450cb3ab2f4675b3214a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:36.226897 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4a60ccb4-d54e-4983-a33b-89b02f206816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ca84146b1d7450cb3ab2f4675b3214a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:36.232881 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1412/2819] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:19:36 2022] DELETE /identity/v3/users/5ca84146b1d7450cb3ab2f4675b3214a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:19:36.237337 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b3723-a9c8-4b7b-955e-521b37064aae None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:36.237621 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b3723-a9c8-4b7b-955e-521b37064aae None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:36.237890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b3723-a9c8-4b7b-955e-521b37064aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:36.256181 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d97b3723-a9c8-4b7b-955e-521b37064aae None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:19:36.257854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d97b3723-a9c8-4b7b-955e-521b37064aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:36.314616 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1408/2820] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:19:36.324623 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60ccb4-d54e-4983-a33b-89b02f206816 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:36.326062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4a60ccb4-d54e-4983-a33b-89b02f206816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:36.381991 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60ccb4-d54e-4983-a33b-89b02f206816 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:36.385638 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57fee1-a4c5-4983-82cd-68009ec4c41b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:36.386233 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57fee1-a4c5-4983-82cd-68009ec4c41b service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:36.386511 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57fee1-a4c5-4983-82cd-68009ec4c41b service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:36.386781 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57fee1-a4c5-4983-82cd-68009ec4c41b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:36.396765 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57fee1-a4c5-4983-82cd-68009ec4c41b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:36.398702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57fee1-a4c5-4983-82cd-68009ec4c41b service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:36.408039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1413/2821] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:19:36.675483 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b3723-a9c8-4b7b-955e-521b37064aae None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:19:36.676903 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d97b3723-a9c8-4b7b-955e-521b37064aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:19:36.690335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b3723-a9c8-4b7b-955e-521b37064aae None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:19:36.696724 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d0066-1463-46f3-9080-5c26a62411e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:19:36.698258 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d0066-1463-46f3-9080-5c26a62411e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:19:36.698536 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d0066-1463-46f3-9080-5c26a62411e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:19:36.698807 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d0066-1463-46f3-9080-5c26a62411e0 admin admin] PATH_INFO: `/v3/projects/cc53d381895842dbb9d45291206ab579` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:19:36.700086 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d0066-1463-46f3-9080-5c26a62411e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc53d381895842dbb9d45291206ab579)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:19:36.702282 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d0066-1463-46f3-9080-5c26a62411e0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:19:36.750019 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-012d0066-1463-46f3-9080-5c26a62411e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc53d381895842dbb9d45291206ab579', 'request_id': 'req-012d0066-1463-46f3-9080-5c26a62411e0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:36.756075 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-012d0066-1463-46f3-9080-5c26a62411e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc53d381895842dbb9d45291206ab579', 'request_id': 'req-012d0066-1463-46f3-9080-5c26a62411e0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:36.762169 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-012d0066-1463-46f3-9080-5c26a62411e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc53d381895842dbb9d45291206ab579', 'request_id': 'req-012d0066-1463-46f3-9080-5c26a62411e0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:36.774918 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-012d0066-1463-46f3-9080-5c26a62411e0 admin admin] The token cache is being invalidate because project cc53d381895842dbb9d45291206ab579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:19:36.775254 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-012d0066-1463-46f3-9080-5c26a62411e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:36.775875 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-012d0066-1463-46f3-9080-5c26a62411e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:19:36.777345 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1409/2822] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:19:36 2022] DELETE /identity/v3/projects/cc53d381895842dbb9d45291206ab579 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:19:46.403959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:46.771232 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:20:06.122417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57fee1-a4c5-4983-82cd-68009ec4c41b service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:20:06.123925 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5c57fee1-a4c5-4983-82cd-68009ec4c41b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:20:06.135476 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57fee1-a4c5-4983-82cd-68009ec4c41b service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:20:06.185959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8831cdf-7ba6-4738-9a51-380cdd79f0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:20:06.186552 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8831cdf-7ba6-4738-9a51-380cdd79f0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:20:06.186825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8831cdf-7ba6-4738-9a51-380cdd79f0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:20:06.187102 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8831cdf-7ba6-4738-9a51-380cdd79f0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:20:06.188843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d8831cdf-7ba6-4738-9a51-380cdd79f0b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:20:06.198199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8831cdf-7ba6-4738-9a51-380cdd79f0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:20:06.199627 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8831cdf-7ba6-4738-9a51-380cdd79f0b6 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:20:06.207371 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1414/2823] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:20:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:20:16.203831 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=26 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:20:32.970534 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d0066-1463-46f3-9080-5c26a62411e0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:20:32.972848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-012d0066-1463-46f3-9080-5c26a62411e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:20:33.084441 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d0066-1463-46f3-9080-5c26a62411e0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:20:33.090541 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b347ef8-9783-4f06-872d-74e1abfe05d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:20:33.091250 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b347ef8-9783-4f06-872d-74e1abfe05d7 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:20:33.091594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b347ef8-9783-4f06-872d-74e1abfe05d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:20:33.091929 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b347ef8-9783-4f06-872d-74e1abfe05d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:20:33.102767 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9b347ef8-9783-4f06-872d-74e1abfe05d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:20:33.117776 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b347ef8-9783-4f06-872d-74e1abfe05d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:20:33.119416 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b347ef8-9783-4f06-872d-74e1abfe05d7 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:20:33.132133 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1410/2824] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:20:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:20:41.578231 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d85c2-1e5e-48a7-8276-09c0e2a2ebd9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:20:41.578793 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d85c2-1e5e-48a7-8276-09c0e2a2ebd9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:20:41.578793 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d85c2-1e5e-48a7-8276-09c0e2a2ebd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:20:41.597696 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-037d85c2-1e5e-48a7-8276-09c0e2a2ebd9 None None] MFA Rules not processed for user `ff988a4b381b4f039a8d990164e575e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:20:41.598929 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-037d85c2-1e5e-48a7-8276-09c0e2a2ebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:20:41.653748 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1415/2825] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:20:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:20:41.959701 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b347ef8-9783-4f06-872d-74e1abfe05d7 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:20:41.961958 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9b347ef8-9783-4f06-872d-74e1abfe05d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:20:41.975280 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b347ef8-9783-4f06-872d-74e1abfe05d7 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:20:41.978904 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c2d63-62b6-440a-a7ff-c1df553e3f03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:20:41.979546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2d63-62b6-440a-a7ff-c1df553e3f03 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:20:41.979821 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2d63-62b6-440a-a7ff-c1df553e3f03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:20:41.980160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2d63-62b6-440a-a7ff-c1df553e3f03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:20:41.981740 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c33c2d63-62b6-440a-a7ff-c1df553e3f03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:20:41.991010 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c2d63-62b6-440a-a7ff-c1df553e3f03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:20:41.992731 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c2d63-62b6-440a-a7ff-c1df553e3f03 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:20:42.000511 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1411/2826] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:20:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:20:43.334198 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d85c2-1e5e-48a7-8276-09c0e2a2ebd9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:20:43.336355 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-037d85c2-1e5e-48a7-8276-09c0e2a2ebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:20:43.408656 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d85c2-1e5e-48a7-8276-09c0e2a2ebd9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:20:43.414401 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c69f8d-ed02-43b0-b527-96457fb9c344 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07d2ee351e734fd09938cea9be3bb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:20:43.415049 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c69f8d-ed02-43b0-b527-96457fb9c344 service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:20:43.415355 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c69f8d-ed02-43b0-b527-96457fb9c344 service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:20:43.415628 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c69f8d-ed02-43b0-b527-96457fb9c344 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:20:43.417379 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b2c69f8d-ed02-43b0-b527-96457fb9c344 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:20:43.428598 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c69f8d-ed02-43b0-b527-96457fb9c344 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:20:43.430690 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c69f8d-ed02-43b0-b527-96457fb9c344 service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:20:43.440420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1416/2827] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:20:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:20:51.732992 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c2d63-62b6-440a-a7ff-c1df553e3f03 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:20:51.748045 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c2d63-62b6-440a-a7ff-c1df553e3f03 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:20:51.753574 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010525e-aa1f-42eb-bda1-44f05da4adc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:20:51.754179 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010525e-aa1f-42eb-bda1-44f05da4adc9 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:20:51.754458 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010525e-aa1f-42eb-bda1-44f05da4adc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:20:51.754734 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010525e-aa1f-42eb-bda1-44f05da4adc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:20:51.756553 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7010525e-aa1f-42eb-bda1-44f05da4adc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:20:51.770041 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010525e-aa1f-42eb-bda1-44f05da4adc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:20:51.771675 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010525e-aa1f-42eb-bda1-44f05da4adc9 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:20:51.784490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1412/2828] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:20:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:20:53.436344 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=57 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:20:55.468893 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c69f8d-ed02-43b0-b527-96457fb9c344 service placement] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:20:55.470343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b2c69f8d-ed02-43b0-b527-96457fb9c344 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:20:55.485931 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c69f8d-ed02-43b0-b527-96457fb9c344 service placement] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:20:55.491679 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a799f-cb91-42a5-a857-65d6bb65c760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:20:55.491983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a799f-cb91-42a5-a857-65d6bb65c760 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:20:55.492259 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a799f-cb91-42a5-a857-65d6bb65c760 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:20:55.492531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a799f-cb91-42a5-a857-65d6bb65c760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:20:55.494767 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-289a799f-cb91-42a5-a857-65d6bb65c760 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:20:55.506996 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a799f-cb91-42a5-a857-65d6bb65c760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:20:55.508610 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a799f-cb91-42a5-a857-65d6bb65c760 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:20:55.519527 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1417/2829] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:20:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:21:01.779734 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=46 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:21:05.515069 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:22:12.273385 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18c8a9-26e9-4066-a9a9-c7cfa60fd96f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:22:12.273937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18c8a9-26e9-4066-a9a9-c7cfa60fd96f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:22:12.273937 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18c8a9-26e9-4066-a9a9-c7cfa60fd96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:22:12.292393 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0c18c8a9-26e9-4066-a9a9-c7cfa60fd96f None None] MFA Rules not processed for user `ff988a4b381b4f039a8d990164e575e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:22:12.293573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0c18c8a9-26e9-4066-a9a9-c7cfa60fd96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:22:12.300537 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1413/2830] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:22:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:22:12.611488 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a799f-cb91-42a5-a857-65d6bb65c760 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:22:12.612981 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-289a799f-cb91-42a5-a857-65d6bb65c760 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:22:12.625000 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a799f-cb91-42a5-a857-65d6bb65c760 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:22:12.628664 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b510b0b-377f-486e-bf48-33b0a130e83f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:22:12.629263 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b510b0b-377f-486e-bf48-33b0a130e83f service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:22:12.629541 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b510b0b-377f-486e-bf48-33b0a130e83f service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:22:12.629812 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b510b0b-377f-486e-bf48-33b0a130e83f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:22:12.631588 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8b510b0b-377f-486e-bf48-33b0a130e83f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:22:12.641669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b510b0b-377f-486e-bf48-33b0a130e83f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:22:12.643167 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b510b0b-377f-486e-bf48-33b0a130e83f service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:22:12.650898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1418/2831] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:22:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:22:22.287823 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:22:22.647331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:23:07.741109 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18c8a9-26e9-4066-a9a9-c7cfa60fd96f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:07.742491 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0c18c8a9-26e9-4066-a9a9-c7cfa60fd96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:07.757797 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18c8a9-26e9-4066-a9a9-c7cfa60fd96f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:07.762948 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdf806-d4bc-4eeb-809d-74e3f1c90fb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07d2ee351e734fd09938cea9be3bb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:07.763576 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdf806-d4bc-4eeb-809d-74e3f1c90fb6 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:07.763852 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdf806-d4bc-4eeb-809d-74e3f1c90fb6 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:07.764121 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdf806-d4bc-4eeb-809d-74e3f1c90fb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:07.767230 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a3fdf806-d4bc-4eeb-809d-74e3f1c90fb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:07.780980 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fdf806-d4bc-4eeb-809d-74e3f1c90fb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:07.782580 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fdf806-d4bc-4eeb-809d-74e3f1c90fb6 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:07.792852 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1414/2832] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:23:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:23:17.788454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:23:28.047458 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b510b0b-377f-486e-bf48-33b0a130e83f service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:28.061950 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b510b0b-377f-486e-bf48-33b0a130e83f service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:28.067270 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be91d2a-505e-49f9-85a0-5173719f8c1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:28.068149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be91d2a-505e-49f9-85a0-5173719f8c1b service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:28.068422 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be91d2a-505e-49f9-85a0-5173719f8c1b service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:28.068690 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be91d2a-505e-49f9-85a0-5173719f8c1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:28.070383 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4be91d2a-505e-49f9-85a0-5173719f8c1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:28.081363 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be91d2a-505e-49f9-85a0-5173719f8c1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:28.082897 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be91d2a-505e-49f9-85a0-5173719f8c1b service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:28.091497 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1419/2833] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:23:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:23:38.087583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:23:41.494525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdf806-d4bc-4eeb-809d-74e3f1c90fb6 service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:41.504245 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdf806-d4bc-4eeb-809d-74e3f1c90fb6 service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:41.507835 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bd96a-454c-494c-9453-e0d4732ca9ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:41.508441 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bd96a-454c-494c-9453-e0d4732ca9ad service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:41.508743 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bd96a-454c-494c-9453-e0d4732ca9ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:41.509013 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bd96a-454c-494c-9453-e0d4732ca9ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:41.510722 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c09bd96a-454c-494c-9453-e0d4732ca9ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:41.574200 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bd96a-454c-494c-9453-e0d4732ca9ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:41.575664 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bd96a-454c-494c-9453-e0d4732ca9ad service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:41.585496 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1415/2834] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:23:44.619778 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be91d2a-505e-49f9-85a0-5173719f8c1b service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:44.632129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be91d2a-505e-49f9-85a0-5173719f8c1b service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:44.637380 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf902d-cf7d-46f8-b226-26cbb5b800bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07d2ee351e734fd09938cea9be3bb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:44.638007 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf902d-cf7d-46f8-b226-26cbb5b800bd service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:44.638286 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf902d-cf7d-46f8-b226-26cbb5b800bd service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:44.638555 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf902d-cf7d-46f8-b226-26cbb5b800bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:44.640439 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1eaf902d-cf7d-46f8-b226-26cbb5b800bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:44.654487 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf902d-cf7d-46f8-b226-26cbb5b800bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:44.657165 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf902d-cf7d-46f8-b226-26cbb5b800bd service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:44.672295 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bd96a-454c-494c-9453-e0d4732ca9ad service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:44.674037 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c09bd96a-454c-494c-9453-e0d4732ca9ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:44.677818 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1420/2835] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:23:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:23:44.688593 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bd96a-454c-494c-9453-e0d4732ca9ad service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:44.693941 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac7351-a5fe-4b21-bd80-57eaedeed649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:44.694692 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac7351-a5fe-4b21-bd80-57eaedeed649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:44.695034 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac7351-a5fe-4b21-bd80-57eaedeed649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:44.695414 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac7351-a5fe-4b21-bd80-57eaedeed649 admin admin] PATH_INFO: `/v3/users/ff988a4b381b4f039a8d990164e575e7` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:44.696546 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac7351-a5fe-4b21-bd80-57eaedeed649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff988a4b381b4f039a8d990164e575e7)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:44.698439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac7351-a5fe-4b21-bd80-57eaedeed649 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:44.746233 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d9ac7351-a5fe-4b21-bd80-57eaedeed649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff988a4b381b4f039a8d990164e575e7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:44.746907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d9ac7351-a5fe-4b21-bd80-57eaedeed649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff988a4b381b4f039a8d990164e575e7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:44.747565 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d9ac7351-a5fe-4b21-bd80-57eaedeed649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff988a4b381b4f039a8d990164e575e7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:44.755384 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d9ac7351-a5fe-4b21-bd80-57eaedeed649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff988a4b381b4f039a8d990164e575e7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:44.763033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d9ac7351-a5fe-4b21-bd80-57eaedeed649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff988a4b381b4f039a8d990164e575e7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:44.779773 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1416/2836] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:23:44 2022] DELETE /identity/v3/users/ff988a4b381b4f039a8d990164e575e7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:23:44.952140 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf902d-cf7d-46f8-b226-26cbb5b800bd service placement] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:44.965934 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf902d-cf7d-46f8-b226-26cbb5b800bd service placement] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:45.022588 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8a94b-1f66-4f5b-8cf0-6fdb1942fb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:45.023246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8a94b-1f66-4f5b-8cf0-6fdb1942fb00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:45.023524 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8a94b-1f66-4f5b-8cf0-6fdb1942fb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:45.023794 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8a94b-1f66-4f5b-8cf0-6fdb1942fb00 admin admin] PATH_INFO: `/v3/projects/1d9e7b23be474a17a8054e5d4bf8c90a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:45.024898 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8a94b-1f66-4f5b-8cf0-6fdb1942fb00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d9e7b23be474a17a8054e5d4bf8c90a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:45.026772 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8a94b-1f66-4f5b-8cf0-6fdb1942fb00 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:45.071969 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-09a8a94b-1f66-4f5b-8cf0-6fdb1942fb00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d9e7b23be474a17a8054e5d4bf8c90a', 'request_id': 'req-09a8a94b-1f66-4f5b-8cf0-6fdb1942fb00'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:45.077468 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-09a8a94b-1f66-4f5b-8cf0-6fdb1942fb00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d9e7b23be474a17a8054e5d4bf8c90a', 'request_id': 'req-09a8a94b-1f66-4f5b-8cf0-6fdb1942fb00'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:45.083403 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-09a8a94b-1f66-4f5b-8cf0-6fdb1942fb00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d9e7b23be474a17a8054e5d4bf8c90a', 'request_id': 'req-09a8a94b-1f66-4f5b-8cf0-6fdb1942fb00'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:45.095437 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-09a8a94b-1f66-4f5b-8cf0-6fdb1942fb00 admin admin] The token cache is being invalidate because project 1d9e7b23be474a17a8054e5d4bf8c90a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:23:45.095723 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-09a8a94b-1f66-4f5b-8cf0-6fdb1942fb00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:45.096329 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-09a8a94b-1f66-4f5b-8cf0-6fdb1942fb00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:45.097780 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1421/2837] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:23:44 2022] DELETE /identity/v3/projects/1d9e7b23be474a17a8054e5d4bf8c90a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:23:45.102869 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4023af-1387-4d41-9b28-0855cc643009 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:45.103221 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4023af-1387-4d41-9b28-0855cc643009 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:45.103494 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4023af-1387-4d41-9b28-0855cc643009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:45.122954 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7d4023af-1387-4d41-9b28-0855cc643009 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:23:45.124600 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7d4023af-1387-4d41-9b28-0855cc643009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:45.182432 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1417/2838] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:23:45.189952 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03f9ba-86ef-4f13-9666-0db41963471c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:45.190380 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03f9ba-86ef-4f13-9666-0db41963471c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:45.190657 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03f9ba-86ef-4f13-9666-0db41963471c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:45.210681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-bd03f9ba-86ef-4f13-9666-0db41963471c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:23:45.211924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bd03f9ba-86ef-4f13-9666-0db41963471c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:45.220414 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1422/2839] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:23:45.224697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4023af-1387-4d41-9b28-0855cc643009 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:45.235154 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4023af-1387-4d41-9b28-0855cc643009 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:45.239907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10642405-ed7d-4a2a-adda-eccc7bdbd4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:45.240516 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10642405-ed7d-4a2a-adda-eccc7bdbd4cc admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:45.240795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10642405-ed7d-4a2a-adda-eccc7bdbd4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:45.241065 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10642405-ed7d-4a2a-adda-eccc7bdbd4cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:45.241987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10642405-ed7d-4a2a-adda-eccc7bdbd4cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:23:45.242298 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10642405-ed7d-4a2a-adda-eccc7bdbd4cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:45.243939 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10642405-ed7d-4a2a-adda-eccc7bdbd4cc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:45.245558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:23:45.261852 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1418/2840] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:23:45.263976 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03f9ba-86ef-4f13-9666-0db41963471c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:45.274031 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03f9ba-86ef-4f13-9666-0db41963471c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:45.278639 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d704e-4ee9-4cc1-b894-885c4c3c680c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:45.279273 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d704e-4ee9-4cc1-b894-885c4c3c680c admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:45.279565 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d704e-4ee9-4cc1-b894-885c4c3c680c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:45.279833 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d704e-4ee9-4cc1-b894-885c4c3c680c admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:45.280948 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d704e-4ee9-4cc1-b894-885c4c3c680c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:45.282814 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d704e-4ee9-4cc1-b894-885c4c3c680c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:45.314030 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1423/2841] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:23:45 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:23:45.319574 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10642405-ed7d-4a2a-adda-eccc7bdbd4cc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:45.329827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10642405-ed7d-4a2a-adda-eccc7bdbd4cc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:45.386001 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c0fe0-823f-4c16-8b96-08b748461e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:45.386598 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c0fe0-823f-4c16-8b96-08b748461e68 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:45.386877 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c0fe0-823f-4c16-8b96-08b748461e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:45.387186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c0fe0-823f-4c16-8b96-08b748461e68 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:45.387800 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c0fe0-823f-4c16-8b96-08b748461e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:45.389721 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c0fe0-823f-4c16-8b96-08b748461e68 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:45.411057 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1419/2842] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:23:45 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:23:45.415122 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d704e-4ee9-4cc1-b894-885c4c3c680c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:45.426614 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d704e-4ee9-4cc1-b894-885c4c3c680c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:45.431468 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b64050-0092-43c6-bae8-2d40f45cce7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:45.432199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b64050-0092-43c6-bae8-2d40f45cce7c admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:45.432631 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b64050-0092-43c6-bae8-2d40f45cce7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:45.432812 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b64050-0092-43c6-bae8-2d40f45cce7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:45.433715 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b64050-0092-43c6-bae8-2d40f45cce7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:45.435335 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b64050-0092-43c6-bae8-2d40f45cce7c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:45.445439 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1424/2843] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:23:45.449402 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c0fe0-823f-4c16-8b96-08b748461e68 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:45.459836 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c0fe0-823f-4c16-8b96-08b748461e68 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:45.464657 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec486415-7a25-4683-8bf7-81347ecc73e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:45.465248 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec486415-7a25-4683-8bf7-81347ecc73e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:45.465520 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec486415-7a25-4683-8bf7-81347ecc73e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:45.465784 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec486415-7a25-4683-8bf7-81347ecc73e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:45.466411 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec486415-7a25-4683-8bf7-81347ecc73e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:45.468759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec486415-7a25-4683-8bf7-81347ecc73e3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:45.479684 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1420/2844] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:23:45.483734 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b64050-0092-43c6-bae8-2d40f45cce7c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:45.493273 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b64050-0092-43c6-bae8-2d40f45cce7c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:45.497748 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43638309-b7e3-4c26-9220-8419b7145ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:45.498371 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43638309-b7e3-4c26-9220-8419b7145ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:45.498645 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43638309-b7e3-4c26-9220-8419b7145ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:45.498912 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43638309-b7e3-4c26-9220-8419b7145ca5 admin admin] PATH_INFO: `/v3/projects/77b0170dc1df4ff3b9cd9091fb260379/users/f706e65958994b809b7bf99afa4a9769/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:45.512857 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43638309-b7e3-4c26-9220-8419b7145ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b0170dc1df4ff3b9cd9091fb260379, user_id=f706e65958994b809b7bf99afa4a9769, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:45.516124 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43638309-b7e3-4c26-9220-8419b7145ca5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:45.528707 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1425/2845] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:23:45 2022] PUT /identity/v3/projects/77b0170dc1df4ff3b9cd9091fb260379/users/f706e65958994b809b7bf99afa4a9769/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:23:45.539563 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfbc6c-6d9c-4bb6-b634-586f8f5c05f8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:45.539971 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfbc6c-6d9c-4bb6-b634-586f8f5c05f8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:45.540270 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfbc6c-6d9c-4bb6-b634-586f8f5c05f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:45.567832 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5adfbc6c-6d9c-4bb6-b634-586f8f5c05f8 None None] MFA Rules not processed for user `f706e65958994b809b7bf99afa4a9769`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:23:45.569016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5adfbc6c-6d9c-4bb6-b634-586f8f5c05f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:45.632705 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1421/2846] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:23:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:23:45.644024 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43638309-b7e3-4c26-9220-8419b7145ca5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:45.645681 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-43638309-b7e3-4c26-9220-8419b7145ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:45.660856 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:23:45.704343 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43638309-b7e3-4c26-9220-8419b7145ca5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:45.707884 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b513a-fd9a-458c-9cf9-189e8aff083a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:45.708468 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b513a-fd9a-458c-9cf9-189e8aff083a service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:45.708741 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b513a-fd9a-458c-9cf9-189e8aff083a service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:45.709008 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b513a-fd9a-458c-9cf9-189e8aff083a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:45.716912 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b513a-fd9a-458c-9cf9-189e8aff083a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:45.718984 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b513a-fd9a-458c-9cf9-189e8aff083a service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:45.727720 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1426/2847] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:23:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:23:54.063403 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfbc6c-6d9c-4bb6-b634-586f8f5c05f8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:54.124318 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfbc6c-6d9c-4bb6-b634-586f8f5c05f8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:54.128822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0d2fb-30e8-4ea6-aedf-37e77f60d11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:54.129440 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0d2fb-30e8-4ea6-aedf-37e77f60d11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:54.129713 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0d2fb-30e8-4ea6-aedf-37e77f60d11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:54.130003 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0d2fb-30e8-4ea6-aedf-37e77f60d11d admin admin] PATH_INFO: `/v3/users/f706e65958994b809b7bf99afa4a9769` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:54.131119 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0d2fb-30e8-4ea6-aedf-37e77f60d11d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f706e65958994b809b7bf99afa4a9769)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:54.133017 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0d2fb-30e8-4ea6-aedf-37e77f60d11d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:54.135300 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:23:54.179160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e3d0d2fb-30e8-4ea6-aedf-37e77f60d11d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f706e65958994b809b7bf99afa4a9769'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:54.179800 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e3d0d2fb-30e8-4ea6-aedf-37e77f60d11d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f706e65958994b809b7bf99afa4a9769'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:54.180393 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e3d0d2fb-30e8-4ea6-aedf-37e77f60d11d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f706e65958994b809b7bf99afa4a9769'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:54.187607 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e3d0d2fb-30e8-4ea6-aedf-37e77f60d11d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f706e65958994b809b7bf99afa4a9769'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:54.195000 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e3d0d2fb-30e8-4ea6-aedf-37e77f60d11d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f706e65958994b809b7bf99afa4a9769'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:54.212564 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1422/2848] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:23:54 2022] DELETE /identity/v3/users/f706e65958994b809b7bf99afa4a9769 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:23:54.216983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63850637-395d-42f9-ae90-6311709725d5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:54.217447 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63850637-395d-42f9-ae90-6311709725d5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:54.217609 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63850637-395d-42f9-ae90-6311709725d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:54.235819 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-63850637-395d-42f9-ae90-6311709725d5 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:23:54.237010 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-63850637-395d-42f9-ae90-6311709725d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:54.295389 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1427/2849] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:23:54.305326 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0d2fb-30e8-4ea6-aedf-37e77f60d11d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:54.306751 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e3d0d2fb-30e8-4ea6-aedf-37e77f60d11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:54.364282 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0d2fb-30e8-4ea6-aedf-37e77f60d11d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:54.367919 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebf303-79a2-4068-b908-dd88dee1a1f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:54.368517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebf303-79a2-4068-b908-dd88dee1a1f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:54.368788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebf303-79a2-4068-b908-dd88dee1a1f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:54.369054 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebf303-79a2-4068-b908-dd88dee1a1f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:54.378580 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebf303-79a2-4068-b908-dd88dee1a1f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:54.380087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebf303-79a2-4068-b908-dd88dee1a1f0 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:54.389444 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1423/2850] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:23:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:23:54.659438 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63850637-395d-42f9-ae90-6311709725d5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:54.660929 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-63850637-395d-42f9-ae90-6311709725d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:54.678441 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63850637-395d-42f9-ae90-6311709725d5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:54.683992 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bad90-c57c-4ce9-9075-bfd318225636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:54.684597 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bad90-c57c-4ce9-9075-bfd318225636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:54.684896 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bad90-c57c-4ce9-9075-bfd318225636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:54.685186 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bad90-c57c-4ce9-9075-bfd318225636 admin admin] PATH_INFO: `/v3/projects/77b0170dc1df4ff3b9cd9091fb260379` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:54.686421 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6bad90-c57c-4ce9-9075-bfd318225636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77b0170dc1df4ff3b9cd9091fb260379)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:54.688873 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6bad90-c57c-4ce9-9075-bfd318225636 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:54.735810 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4a6bad90-c57c-4ce9-9075-bfd318225636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77b0170dc1df4ff3b9cd9091fb260379', 'request_id': 'req-4a6bad90-c57c-4ce9-9075-bfd318225636'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:54.741073 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4a6bad90-c57c-4ce9-9075-bfd318225636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77b0170dc1df4ff3b9cd9091fb260379', 'request_id': 'req-4a6bad90-c57c-4ce9-9075-bfd318225636'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:54.747150 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4a6bad90-c57c-4ce9-9075-bfd318225636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77b0170dc1df4ff3b9cd9091fb260379', 'request_id': 'req-4a6bad90-c57c-4ce9-9075-bfd318225636'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:54.759466 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4a6bad90-c57c-4ce9-9075-bfd318225636 admin admin] The token cache is being invalidate because project 77b0170dc1df4ff3b9cd9091fb260379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:23:54.759743 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4a6bad90-c57c-4ce9-9075-bfd318225636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:54.760385 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4a6bad90-c57c-4ce9-9075-bfd318225636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:54.761870 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1428/2851] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:23:54 2022] DELETE /identity/v3/projects/77b0170dc1df4ff3b9cd9091fb260379 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:23:54.767975 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5dec2-1ab6-4eac-96f0-a18754648f82 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:54.768260 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5dec2-1ab6-4eac-96f0-a18754648f82 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:54.768535 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5dec2-1ab6-4eac-96f0-a18754648f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:54.787527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-97b5dec2-1ab6-4eac-96f0-a18754648f82 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:23:54.788716 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-97b5dec2-1ab6-4eac-96f0-a18754648f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:54.847850 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1424/2852] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:23:54.855580 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6185e4a-ced9-4dab-870d-2a7e9e92d5f5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:54.855888 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6185e4a-ced9-4dab-870d-2a7e9e92d5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:54.856154 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6185e4a-ced9-4dab-870d-2a7e9e92d5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:54.875594 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a6185e4a-ced9-4dab-870d-2a7e9e92d5f5 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:23:54.876763 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a6185e4a-ced9-4dab-870d-2a7e9e92d5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:54.884445 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1429/2853] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 07:23:54.888528 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5dec2-1ab6-4eac-96f0-a18754648f82 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:54.899187 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5dec2-1ab6-4eac-96f0-a18754648f82 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:54.903650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50400d1-cc52-44b7-b2e5-d27dc691f8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:54.904242 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50400d1-cc52-44b7-b2e5-d27dc691f8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:54.904517 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50400d1-cc52-44b7-b2e5-d27dc691f8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:54.904789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50400d1-cc52-44b7-b2e5-d27dc691f8d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:54.905873 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50400d1-cc52-44b7-b2e5-d27dc691f8d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:23:54.906195 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50400d1-cc52-44b7-b2e5-d27dc691f8d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:54.910642 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50400d1-cc52-44b7-b2e5-d27dc691f8d9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:54.919063 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1425/2854] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 07:23:54.923441 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6185e4a-ced9-4dab-870d-2a7e9e92d5f5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:54.936815 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6185e4a-ced9-4dab-870d-2a7e9e92d5f5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:54.941535 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e177a-03a2-4d0f-9d3d-769e9ad05938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:54.942125 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e177a-03a2-4d0f-9d3d-769e9ad05938 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:54.942401 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e177a-03a2-4d0f-9d3d-769e9ad05938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:54.942921 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e177a-03a2-4d0f-9d3d-769e9ad05938 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:54.943566 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e177a-03a2-4d0f-9d3d-769e9ad05938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:54.945452 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e177a-03a2-4d0f-9d3d-769e9ad05938 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:54.972241 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1430/2855] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:23:54 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:23:54.976391 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50400d1-cc52-44b7-b2e5-d27dc691f8d9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:54.986401 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50400d1-cc52-44b7-b2e5-d27dc691f8d9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:54.994149 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:23:55.044417 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480b6d4-90bc-4d5c-8cdf-cd1286701510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:55.045014 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480b6d4-90bc-4d5c-8cdf-cd1286701510 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:55.045289 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480b6d4-90bc-4d5c-8cdf-cd1286701510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:55.045561 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480b6d4-90bc-4d5c-8cdf-cd1286701510 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:55.046169 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480b6d4-90bc-4d5c-8cdf-cd1286701510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:55.048103 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480b6d4-90bc-4d5c-8cdf-cd1286701510 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:55.069183 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1426/2856] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:23:54 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:23:55.073299 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e177a-03a2-4d0f-9d3d-769e9ad05938 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:55.084197 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e177a-03a2-4d0f-9d3d-769e9ad05938 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:55.089005 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a2eb1-92cc-4bfc-af3f-60cedee4b6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:55.089597 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a2eb1-92cc-4bfc-af3f-60cedee4b6ce admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:55.089874 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a2eb1-92cc-4bfc-af3f-60cedee4b6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:55.090144 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a2eb1-92cc-4bfc-af3f-60cedee4b6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:55.090790 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a2eb1-92cc-4bfc-af3f-60cedee4b6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:55.092411 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a2eb1-92cc-4bfc-af3f-60cedee4b6ce admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:55.097694 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:23:55.103459 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1431/2857] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:23:55.106955 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480b6d4-90bc-4d5c-8cdf-cd1286701510 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:55.117150 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480b6d4-90bc-4d5c-8cdf-cd1286701510 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:55.121779 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82127b-f3ff-49e0-bf90-aea42666d8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:55.122369 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82127b-f3ff-49e0-bf90-aea42666d8dd admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:55.122643 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82127b-f3ff-49e0-bf90-aea42666d8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:55.122920 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82127b-f3ff-49e0-bf90-aea42666d8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:55.123590 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82127b-f3ff-49e0-bf90-aea42666d8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:55.125886 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82127b-f3ff-49e0-bf90-aea42666d8dd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:55.136231 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1427/2858] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:23:55.140341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a2eb1-92cc-4bfc-af3f-60cedee4b6ce admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:55.150035 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a2eb1-92cc-4bfc-af3f-60cedee4b6ce admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:55.154590 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff11045-4b3d-4269-9e2c-a48b5f8640e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:55.155834 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff11045-4b3d-4269-9e2c-a48b5f8640e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:55.156261 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff11045-4b3d-4269-9e2c-a48b5f8640e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:55.156413 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff11045-4b3d-4269-9e2c-a48b5f8640e4 admin admin] PATH_INFO: `/v3/projects/6334569324cc4376a0fad80516aa8904/users/aeb3f24b561a4e4c815a1e2db6f314ea/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:55.170420 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff11045-4b3d-4269-9e2c-a48b5f8640e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6334569324cc4376a0fad80516aa8904, user_id=aeb3f24b561a4e4c815a1e2db6f314ea, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:55.173611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff11045-4b3d-4269-9e2c-a48b5f8640e4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:55.185929 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1432/2859] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:23:55 2022] PUT /identity/v3/projects/6334569324cc4376a0fad80516aa8904/users/aeb3f24b561a4e4c815a1e2db6f314ea/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:23:55.196422 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514689db-acc7-4059-97cb-c43d788a9616 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:55.196707 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514689db-acc7-4059-97cb-c43d788a9616 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:55.197026 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514689db-acc7-4059-97cb-c43d788a9616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:55.225208 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-514689db-acc7-4059-97cb-c43d788a9616 None None] MFA Rules not processed for user `aeb3f24b561a4e4c815a1e2db6f314ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:23:55.226413 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-514689db-acc7-4059-97cb-c43d788a9616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:55.290261 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1428/2860] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:23:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:23:55.301748 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff11045-4b3d-4269-9e2c-a48b5f8640e4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:55.303544 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8ff11045-4b3d-4269-9e2c-a48b5f8640e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:55.359121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff11045-4b3d-4269-9e2c-a48b5f8640e4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:55.362688 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdb61b-e8af-47d2-a7d0-d9254bbf30ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:55.363319 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdb61b-e8af-47d2-a7d0-d9254bbf30ed service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:55.363593 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdb61b-e8af-47d2-a7d0-d9254bbf30ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:55.363859 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdb61b-e8af-47d2-a7d0-d9254bbf30ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:55.371796 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdb61b-e8af-47d2-a7d0-d9254bbf30ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:55.373199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdb61b-e8af-47d2-a7d0-d9254bbf30ed service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:55.382410 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1433/2861] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:23:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:23:55.403369 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514689db-acc7-4059-97cb-c43d788a9616 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:55.465426 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514689db-acc7-4059-97cb-c43d788a9616 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:55.470440 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696445cc-2ed4-4473-8cde-9ac56044c459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:55.471091 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696445cc-2ed4-4473-8cde-9ac56044c459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:55.471388 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696445cc-2ed4-4473-8cde-9ac56044c459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:55.471660 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696445cc-2ed4-4473-8cde-9ac56044c459 admin admin] PATH_INFO: `/v3/users/aeb3f24b561a4e4c815a1e2db6f314ea` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:55.472782 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696445cc-2ed4-4473-8cde-9ac56044c459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeb3f24b561a4e4c815a1e2db6f314ea)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:55.474678 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696445cc-2ed4-4473-8cde-9ac56044c459 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:55.496186 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:23:55.523450 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-696445cc-2ed4-4473-8cde-9ac56044c459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeb3f24b561a4e4c815a1e2db6f314ea'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:55.524105 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-696445cc-2ed4-4473-8cde-9ac56044c459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeb3f24b561a4e4c815a1e2db6f314ea'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:55.524729 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-696445cc-2ed4-4473-8cde-9ac56044c459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeb3f24b561a4e4c815a1e2db6f314ea'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:55.531664 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-696445cc-2ed4-4473-8cde-9ac56044c459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeb3f24b561a4e4c815a1e2db6f314ea'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:55.538831 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-696445cc-2ed4-4473-8cde-9ac56044c459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeb3f24b561a4e4c815a1e2db6f314ea'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:55.557300 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1429/2862] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:23:55 2022] DELETE /identity/v3/users/aeb3f24b561a4e4c815a1e2db6f314ea => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:23:55.562421 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2689bcd-353b-4f5c-8e5d-9602226f88b4 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:55.562717 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2689bcd-353b-4f5c-8e5d-9602226f88b4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:55.562988 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2689bcd-353b-4f5c-8e5d-9602226f88b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:55.582081 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e2689bcd-353b-4f5c-8e5d-9602226f88b4 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:23:55.583306 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e2689bcd-353b-4f5c-8e5d-9602226f88b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:55.641396 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1434/2863] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:23:55.651037 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696445cc-2ed4-4473-8cde-9ac56044c459 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:55.652558 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-696445cc-2ed4-4473-8cde-9ac56044c459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:55.710059 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696445cc-2ed4-4473-8cde-9ac56044c459 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:55.713688 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf9a94-b02b-48b1-afb4-83fcf2f12f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:55.714291 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf9a94-b02b-48b1-afb4-83fcf2f12f83 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:55.714569 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf9a94-b02b-48b1-afb4-83fcf2f12f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:55.714836 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf9a94-b02b-48b1-afb4-83fcf2f12f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:55.724416 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf9a94-b02b-48b1-afb4-83fcf2f12f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:55.725854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf9a94-b02b-48b1-afb4-83fcf2f12f83 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:55.735699 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1430/2864] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:23:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:23:56.005810 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2689bcd-353b-4f5c-8e5d-9602226f88b4 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:56.007689 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e2689bcd-353b-4f5c-8e5d-9602226f88b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:56.022019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2689bcd-353b-4f5c-8e5d-9602226f88b4 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:56.027698 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b63387-9a29-4b87-9554-e8fd13e19e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:56.028244 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b63387-9a29-4b87-9554-e8fd13e19e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:56.028521 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b63387-9a29-4b87-9554-e8fd13e19e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:56.028837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b63387-9a29-4b87-9554-e8fd13e19e09 admin admin] PATH_INFO: `/v3/projects/6334569324cc4376a0fad80516aa8904` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:56.029977 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b63387-9a29-4b87-9554-e8fd13e19e09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6334569324cc4376a0fad80516aa8904)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:56.031983 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b63387-9a29-4b87-9554-e8fd13e19e09 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:56.080637 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-22b63387-9a29-4b87-9554-e8fd13e19e09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6334569324cc4376a0fad80516aa8904', 'request_id': 'req-22b63387-9a29-4b87-9554-e8fd13e19e09'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:56.086152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-22b63387-9a29-4b87-9554-e8fd13e19e09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6334569324cc4376a0fad80516aa8904', 'request_id': 'req-22b63387-9a29-4b87-9554-e8fd13e19e09'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:56.092302 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-22b63387-9a29-4b87-9554-e8fd13e19e09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6334569324cc4376a0fad80516aa8904', 'request_id': 'req-22b63387-9a29-4b87-9554-e8fd13e19e09'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:56.105091 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-22b63387-9a29-4b87-9554-e8fd13e19e09 admin admin] The token cache is being invalidate because project 6334569324cc4376a0fad80516aa8904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:23:56.105382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-22b63387-9a29-4b87-9554-e8fd13e19e09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:56.106005 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-22b63387-9a29-4b87-9554-e8fd13e19e09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:23:56.107525 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1435/2865] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:23:56 2022] DELETE /identity/v3/projects/6334569324cc4376a0fad80516aa8904 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:23:56.113004 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf41e01-4f6e-4048-a624-5ad4df840102 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:56.113490 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf41e01-4f6e-4048-a624-5ad4df840102 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:56.113583 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf41e01-4f6e-4048-a624-5ad4df840102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:56.133331 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-dbf41e01-4f6e-4048-a624-5ad4df840102 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:23:56.134457 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dbf41e01-4f6e-4048-a624-5ad4df840102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:56.193259 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1431/2866] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:23:56.202543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44e297-3a2c-47a8-a37b-edb4e685676c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:56.202806 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44e297-3a2c-47a8-a37b-edb4e685676c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:56.203077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44e297-3a2c-47a8-a37b-edb4e685676c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:56.210695 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:23:56.224417 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1e44e297-3a2c-47a8-a37b-edb4e685676c None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:23:56.225646 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1e44e297-3a2c-47a8-a37b-edb4e685676c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:56.234305 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1436/2867] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:23:56.238551 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf41e01-4f6e-4048-a624-5ad4df840102 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:56.248020 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf41e01-4f6e-4048-a624-5ad4df840102 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:56.253493 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e02a7d-c969-4a92-9c31-df2b5db9fa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:56.254087 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e02a7d-c969-4a92-9c31-df2b5db9fa93 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:56.254365 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e02a7d-c969-4a92-9c31-df2b5db9fa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:56.254637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e02a7d-c969-4a92-9c31-df2b5db9fa93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:56.255314 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e02a7d-c969-4a92-9c31-df2b5db9fa93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:23:56.255615 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e02a7d-c969-4a92-9c31-df2b5db9fa93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:56.257208 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e02a7d-c969-4a92-9c31-df2b5db9fa93 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:56.268910 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1432/2868] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:23:56.273210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44e297-3a2c-47a8-a37b-edb4e685676c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:56.283401 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44e297-3a2c-47a8-a37b-edb4e685676c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:56.290006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb6c96-efdf-4522-9de8-5950d5e414c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:56.290605 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb6c96-efdf-4522-9de8-5950d5e414c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:56.291001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb6c96-efdf-4522-9de8-5950d5e414c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:56.291909 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb6c96-efdf-4522-9de8-5950d5e414c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:56.292543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb6c96-efdf-4522-9de8-5950d5e414c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:56.294450 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb6c96-efdf-4522-9de8-5950d5e414c6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:56.322630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1437/2869] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:23:56 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 07:23:56.327016 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e02a7d-c969-4a92-9c31-df2b5db9fa93 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:56.337007 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e02a7d-c969-4a92-9c31-df2b5db9fa93 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:56.363371 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:23:56.395265 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e33ce-239c-4ccf-846a-6c9a61f4b68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:56.395799 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e33ce-239c-4ccf-846a-6c9a61f4b68e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:56.396092 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e33ce-239c-4ccf-846a-6c9a61f4b68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:56.396378 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e33ce-239c-4ccf-846a-6c9a61f4b68e admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:56.396992 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e33ce-239c-4ccf-846a-6c9a61f4b68e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:56.398895 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e33ce-239c-4ccf-846a-6c9a61f4b68e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:56.419574 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1433/2870] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:23:56 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:23:56.424554 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb6c96-efdf-4522-9de8-5950d5e414c6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:56.435246 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb6c96-efdf-4522-9de8-5950d5e414c6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:56.440411 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7157c-be4b-4465-bce8-1ae6333d87e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:56.441007 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7157c-be4b-4465-bce8-1ae6333d87e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:56.441287 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7157c-be4b-4465-bce8-1ae6333d87e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:56.441557 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7157c-be4b-4465-bce8-1ae6333d87e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:56.442309 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7157c-be4b-4465-bce8-1ae6333d87e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:56.444341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7157c-be4b-4465-bce8-1ae6333d87e1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:56.454293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1438/2871] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:23:56.458273 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e33ce-239c-4ccf-846a-6c9a61f4b68e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:56.468622 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e33ce-239c-4ccf-846a-6c9a61f4b68e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:56.473166 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe885e9-d963-40f7-91b5-3ebce88af55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:56.473751 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe885e9-d963-40f7-91b5-3ebce88af55b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:56.474025 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe885e9-d963-40f7-91b5-3ebce88af55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:56.474294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe885e9-d963-40f7-91b5-3ebce88af55b admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:56.474924 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe885e9-d963-40f7-91b5-3ebce88af55b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:56.476534 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe885e9-d963-40f7-91b5-3ebce88af55b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:56.486788 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1434/2872] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:23:56.490662 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7157c-be4b-4465-bce8-1ae6333d87e1 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:56.500331 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7157c-be4b-4465-bce8-1ae6333d87e1 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:56.504843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3a7d1-f846-437c-b9cf-6579110fa0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:56.505473 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3a7d1-f846-437c-b9cf-6579110fa0e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:56.505747 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3a7d1-f846-437c-b9cf-6579110fa0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:56.506014 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3a7d1-f846-437c-b9cf-6579110fa0e8 admin admin] PATH_INFO: `/v3/projects/776fad5747b240de889edcd26eeb940a/users/b8ad284a090f4732b0b6cf4f7cfd0f25/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:56.520089 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3a7d1-f846-437c-b9cf-6579110fa0e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=776fad5747b240de889edcd26eeb940a, user_id=b8ad284a090f4732b0b6cf4f7cfd0f25, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:56.522677 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3a7d1-f846-437c-b9cf-6579110fa0e8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:56.535886 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1439/2873] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:23:56 2022] PUT /identity/v3/projects/776fad5747b240de889edcd26eeb940a/users/b8ad284a090f4732b0b6cf4f7cfd0f25/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:23:56.546883 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39650f33-f388-4566-aa5c-767e4d35c10d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:56.547373 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39650f33-f388-4566-aa5c-767e4d35c10d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:56.547727 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39650f33-f388-4566-aa5c-767e4d35c10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:56.575428 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-39650f33-f388-4566-aa5c-767e4d35c10d None None] MFA Rules not processed for user `b8ad284a090f4732b0b6cf4f7cfd0f25`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:23:56.576629 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-39650f33-f388-4566-aa5c-767e4d35c10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:56.641009 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1435/2874] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:23:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:23:56.651748 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3a7d1-f846-437c-b9cf-6579110fa0e8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:23:56.653441 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fca3a7d1-f846-437c-b9cf-6579110fa0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:23:56.708825 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3a7d1-f846-437c-b9cf-6579110fa0e8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:23:56.712488 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e57dc-af34-48bf-acd6-c4561aa8bfa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:23:56.713083 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e57dc-af34-48bf-acd6-c4561aa8bfa8 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:23:56.713361 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e57dc-af34-48bf-acd6-c4561aa8bfa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:23:56.713630 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e57dc-af34-48bf-acd6-c4561aa8bfa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:23:56.722948 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e57dc-af34-48bf-acd6-c4561aa8bfa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:23:56.724476 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e57dc-af34-48bf-acd6-c4561aa8bfa8 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:23:56.733308 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1440/2875] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:23:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:24:02.035874 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39650f33-f388-4566-aa5c-767e4d35c10d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:02.098073 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39650f33-f388-4566-aa5c-767e4d35c10d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:02.102595 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda76b4-2049-4132-bbc7-38f9166c1c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:02.103250 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda76b4-2049-4132-bbc7-38f9166c1c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:02.103535 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda76b4-2049-4132-bbc7-38f9166c1c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:02.103806 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda76b4-2049-4132-bbc7-38f9166c1c84 admin admin] PATH_INFO: `/v3/users/b8ad284a090f4732b0b6cf4f7cfd0f25` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:02.104902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda76b4-2049-4132-bbc7-38f9166c1c84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ad284a090f4732b0b6cf4f7cfd0f25)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:02.106791 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda76b4-2049-4132-bbc7-38f9166c1c84 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:02.146213 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:24:02.152495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aeda76b4-2049-4132-bbc7-38f9166c1c84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ad284a090f4732b0b6cf4f7cfd0f25'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:02.153211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aeda76b4-2049-4132-bbc7-38f9166c1c84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ad284a090f4732b0b6cf4f7cfd0f25'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:02.154033 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aeda76b4-2049-4132-bbc7-38f9166c1c84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ad284a090f4732b0b6cf4f7cfd0f25'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:02.162141 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aeda76b4-2049-4132-bbc7-38f9166c1c84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ad284a090f4732b0b6cf4f7cfd0f25'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:02.169160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aeda76b4-2049-4132-bbc7-38f9166c1c84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ad284a090f4732b0b6cf4f7cfd0f25'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:02.192802 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1436/2876] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:24:02 2022] DELETE /identity/v3/users/b8ad284a090f4732b0b6cf4f7cfd0f25 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:24:02.198292 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c044927-26b5-48d8-868a-380c4e74a7e6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:02.198798 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c044927-26b5-48d8-868a-380c4e74a7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:02.198914 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c044927-26b5-48d8-868a-380c4e74a7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:02.218901 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7c044927-26b5-48d8-868a-380c4e74a7e6 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:24:02.220139 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7c044927-26b5-48d8-868a-380c4e74a7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:02.278966 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1441/2877] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:24:02.289183 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda76b4-2049-4132-bbc7-38f9166c1c84 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:02.290619 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aeda76b4-2049-4132-bbc7-38f9166c1c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:02.348649 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda76b4-2049-4132-bbc7-38f9166c1c84 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:02.352217 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387f91c-3d83-455f-b5b8-167737ee0062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:02.352839 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387f91c-3d83-455f-b5b8-167737ee0062 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:02.353113 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387f91c-3d83-455f-b5b8-167737ee0062 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:02.353380 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387f91c-3d83-455f-b5b8-167737ee0062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:02.362949 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387f91c-3d83-455f-b5b8-167737ee0062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:02.364402 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387f91c-3d83-455f-b5b8-167737ee0062 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:02.373499 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1437/2878] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:24:02.639005 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c044927-26b5-48d8-868a-380c4e74a7e6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:02.640447 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7c044927-26b5-48d8-868a-380c4e74a7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:02.653352 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c044927-26b5-48d8-868a-380c4e74a7e6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:02.658224 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50eeb5-1167-4d9a-8cf0-f7e3d83c36c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:02.659514 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50eeb5-1167-4d9a-8cf0-f7e3d83c36c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:02.659817 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50eeb5-1167-4d9a-8cf0-f7e3d83c36c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:02.660118 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50eeb5-1167-4d9a-8cf0-f7e3d83c36c2 admin admin] PATH_INFO: `/v3/projects/776fad5747b240de889edcd26eeb940a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:02.661203 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50eeb5-1167-4d9a-8cf0-f7e3d83c36c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=776fad5747b240de889edcd26eeb940a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:02.663384 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50eeb5-1167-4d9a-8cf0-f7e3d83c36c2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:02.700150 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:24:02.710333 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9a50eeb5-1167-4d9a-8cf0-f7e3d83c36c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '776fad5747b240de889edcd26eeb940a', 'request_id': 'req-9a50eeb5-1167-4d9a-8cf0-f7e3d83c36c2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:02.715713 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9a50eeb5-1167-4d9a-8cf0-f7e3d83c36c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '776fad5747b240de889edcd26eeb940a', 'request_id': 'req-9a50eeb5-1167-4d9a-8cf0-f7e3d83c36c2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:02.722495 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9a50eeb5-1167-4d9a-8cf0-f7e3d83c36c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '776fad5747b240de889edcd26eeb940a', 'request_id': 'req-9a50eeb5-1167-4d9a-8cf0-f7e3d83c36c2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:02.734272 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9a50eeb5-1167-4d9a-8cf0-f7e3d83c36c2 admin admin] The token cache is being invalidate because project 776fad5747b240de889edcd26eeb940a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:24:02.734556 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9a50eeb5-1167-4d9a-8cf0-f7e3d83c36c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:02.735285 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9a50eeb5-1167-4d9a-8cf0-f7e3d83c36c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:02.736839 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1442/2879] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:24:02 2022] DELETE /identity/v3/projects/776fad5747b240de889edcd26eeb940a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:24:02.741914 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e4835-531d-4eb4-8ecc-c26570ba97ec None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:02.742149 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e4835-531d-4eb4-8ecc-c26570ba97ec None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:02.742427 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e4835-531d-4eb4-8ecc-c26570ba97ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:02.763922 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-506e4835-531d-4eb4-8ecc-c26570ba97ec None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:24:02.765125 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-506e4835-531d-4eb4-8ecc-c26570ba97ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:02.823682 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1438/2880] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:24:02.831627 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e25aea-8d99-48dc-96e2-9752ea01564f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:02.831910 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e25aea-8d99-48dc-96e2-9752ea01564f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:02.832179 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e25aea-8d99-48dc-96e2-9752ea01564f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:02.851805 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-57e25aea-8d99-48dc-96e2-9752ea01564f None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:24:02.853016 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-57e25aea-8d99-48dc-96e2-9752ea01564f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:02.860999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1443/2881] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:24:02.865795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e4835-531d-4eb4-8ecc-c26570ba97ec None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:02.875671 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e4835-531d-4eb4-8ecc-c26570ba97ec None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:02.880851 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34f9d3-ec34-4398-92fb-68042e538d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:02.881440 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34f9d3-ec34-4398-92fb-68042e538d8d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:02.881712 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34f9d3-ec34-4398-92fb-68042e538d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:02.881979 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34f9d3-ec34-4398-92fb-68042e538d8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:02.882607 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34f9d3-ec34-4398-92fb-68042e538d8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:24:02.882902 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34f9d3-ec34-4398-92fb-68042e538d8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:02.884496 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34f9d3-ec34-4398-92fb-68042e538d8d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:02.896335 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1439/2882] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:24:02.899822 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e25aea-8d99-48dc-96e2-9752ea01564f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:02.908837 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e25aea-8d99-48dc-96e2-9752ea01564f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:02.913475 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d90cc-b130-4838-b7e2-dea0dbb66c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:02.914054 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d90cc-b130-4838-b7e2-dea0dbb66c40 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:02.914329 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d90cc-b130-4838-b7e2-dea0dbb66c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:02.914597 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d90cc-b130-4838-b7e2-dea0dbb66c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:02.915245 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d90cc-b130-4838-b7e2-dea0dbb66c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:02.917117 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d90cc-b130-4838-b7e2-dea0dbb66c40 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:02.945129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1444/2883] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:24:02 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:24:02.949485 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34f9d3-ec34-4398-92fb-68042e538d8d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:02.959482 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34f9d3-ec34-4398-92fb-68042e538d8d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:03.003704 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:24:03.018120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561be11-71f6-4945-ae38-6f9c5c1216a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:03.018720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561be11-71f6-4945-ae38-6f9c5c1216a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:03.019148 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561be11-71f6-4945-ae38-6f9c5c1216a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:03.019454 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561be11-71f6-4945-ae38-6f9c5c1216a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:03.020074 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561be11-71f6-4945-ae38-6f9c5c1216a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:03.021977 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561be11-71f6-4945-ae38-6f9c5c1216a8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:03.043180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1440/2884] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:24:02 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:24:03.047408 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d90cc-b130-4838-b7e2-dea0dbb66c40 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:03.058617 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d90cc-b130-4838-b7e2-dea0dbb66c40 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:03.063284 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64f2a4-bb32-44fa-a7d7-d2e724634f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:03.063874 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64f2a4-bb32-44fa-a7d7-d2e724634f99 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:03.064154 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64f2a4-bb32-44fa-a7d7-d2e724634f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:03.064426 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64f2a4-bb32-44fa-a7d7-d2e724634f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:03.065129 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64f2a4-bb32-44fa-a7d7-d2e724634f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:03.066679 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64f2a4-bb32-44fa-a7d7-d2e724634f99 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:03.076669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1445/2885] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:24:03.080525 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561be11-71f6-4945-ae38-6f9c5c1216a8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:03.090351 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561be11-71f6-4945-ae38-6f9c5c1216a8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:03.094854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ef458-e153-46d9-a045-1eedcad141bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:03.095483 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ef458-e153-46d9-a045-1eedcad141bb admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:03.095756 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ef458-e153-46d9-a045-1eedcad141bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:03.096030 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ef458-e153-46d9-a045-1eedcad141bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:03.097276 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ef458-e153-46d9-a045-1eedcad141bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:03.098840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ef458-e153-46d9-a045-1eedcad141bb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:03.109008 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1441/2886] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:24:03.113723 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64f2a4-bb32-44fa-a7d7-d2e724634f99 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:03.123496 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64f2a4-bb32-44fa-a7d7-d2e724634f99 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:03.128654 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe52cba-ff4e-458c-9b20-951fe1b6afd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:03.129297 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe52cba-ff4e-458c-9b20-951fe1b6afd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:03.129576 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe52cba-ff4e-458c-9b20-951fe1b6afd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:03.129880 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe52cba-ff4e-458c-9b20-951fe1b6afd5 admin admin] PATH_INFO: `/v3/projects/5ac954ff763f42808add8c1be5baafb9/users/d4bff293561248089d284b9c943309d4/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:03.144388 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe52cba-ff4e-458c-9b20-951fe1b6afd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac954ff763f42808add8c1be5baafb9, user_id=d4bff293561248089d284b9c943309d4, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:03.147054 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe52cba-ff4e-458c-9b20-951fe1b6afd5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:03.160341 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1446/2887] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:24:03 2022] PUT /identity/v3/projects/5ac954ff763f42808add8c1be5baafb9/users/d4bff293561248089d284b9c943309d4/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:24:03.171704 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3b1ae-a0da-44e7-bb50-cac936cc4694 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:03.171987 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3b1ae-a0da-44e7-bb50-cac936cc4694 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:03.172257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3b1ae-a0da-44e7-bb50-cac936cc4694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:03.200289 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ead3b1ae-a0da-44e7-bb50-cac936cc4694 None None] MFA Rules not processed for user `d4bff293561248089d284b9c943309d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:24:03.201501 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ead3b1ae-a0da-44e7-bb50-cac936cc4694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:03.264475 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1442/2888] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:24:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:24:03.275431 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe52cba-ff4e-458c-9b20-951fe1b6afd5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:03.277359 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6fe52cba-ff4e-458c-9b20-951fe1b6afd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:03.338062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe52cba-ff4e-458c-9b20-951fe1b6afd5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:03.341579 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff14a7-c7e6-4341-8b8f-ff3ddce9ef6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8977d7479b3e405c976fa1a570987704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:03.342180 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff14a7-c7e6-4341-8b8f-ff3ddce9ef6c service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:03.342460 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff14a7-c7e6-4341-8b8f-ff3ddce9ef6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:03.342728 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff14a7-c7e6-4341-8b8f-ff3ddce9ef6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:03.351586 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff14a7-c7e6-4341-8b8f-ff3ddce9ef6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:03.353008 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff14a7-c7e6-4341-8b8f-ff3ddce9ef6c service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:03.362713 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1447/2889] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:24:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:24:13.261452 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:24:13.357941 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=64,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:24:13.379537 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3b1ae-a0da-44e7-bb50-cac936cc4694 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:13.441528 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3b1ae-a0da-44e7-bb50-cac936cc4694 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:13.446469 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88add5-4e06-4d85-8d48-6db3b6f9f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:13.447180 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88add5-4e06-4d85-8d48-6db3b6f9f5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:13.447461 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88add5-4e06-4d85-8d48-6db3b6f9f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:13.447730 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88add5-4e06-4d85-8d48-6db3b6f9f5a3 admin admin] PATH_INFO: `/v3/users/d4bff293561248089d284b9c943309d4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:13.448828 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88add5-4e06-4d85-8d48-6db3b6f9f5a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4bff293561248089d284b9c943309d4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:13.450749 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88add5-4e06-4d85-8d48-6db3b6f9f5a3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:13.495761 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ba88add5-4e06-4d85-8d48-6db3b6f9f5a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4bff293561248089d284b9c943309d4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:13.496396 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ba88add5-4e06-4d85-8d48-6db3b6f9f5a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4bff293561248089d284b9c943309d4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:13.496988 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ba88add5-4e06-4d85-8d48-6db3b6f9f5a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4bff293561248089d284b9c943309d4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:13.503685 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ba88add5-4e06-4d85-8d48-6db3b6f9f5a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4bff293561248089d284b9c943309d4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:13.511725 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ba88add5-4e06-4d85-8d48-6db3b6f9f5a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4bff293561248089d284b9c943309d4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:13.529438 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1443/2890] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:24:13 2022] DELETE /identity/v3/users/d4bff293561248089d284b9c943309d4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:24:13.533881 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664b640-e885-41dc-82dc-ae087e9d5a3e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:13.534160 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664b640-e885-41dc-82dc-ae087e9d5a3e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:13.534445 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664b640-e885-41dc-82dc-ae087e9d5a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:13.552765 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4664b640-e885-41dc-82dc-ae087e9d5a3e None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:24:13.553942 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4664b640-e885-41dc-82dc-ae087e9d5a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:13.610339 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1448/2891] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:24:13.620111 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88add5-4e06-4d85-8d48-6db3b6f9f5a3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:13.621512 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ba88add5-4e06-4d85-8d48-6db3b6f9f5a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:13.679651 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88add5-4e06-4d85-8d48-6db3b6f9f5a3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:13.683294 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c509b-86ea-42b8-8030-982ac0a88de4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:13.683892 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c509b-86ea-42b8-8030-982ac0a88de4 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:13.684167 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c509b-86ea-42b8-8030-982ac0a88de4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:13.684436 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c509b-86ea-42b8-8030-982ac0a88de4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:13.694256 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c509b-86ea-42b8-8030-982ac0a88de4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:13.695656 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c509b-86ea-42b8-8030-982ac0a88de4 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:13.704957 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1444/2892] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:24:13.967047 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664b640-e885-41dc-82dc-ae087e9d5a3e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:13.968490 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4664b640-e885-41dc-82dc-ae087e9d5a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:13.982558 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664b640-e885-41dc-82dc-ae087e9d5a3e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:13.988072 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3bc8a-cff0-4edd-8ac1-220ddd7a3323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:13.988703 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3bc8a-cff0-4edd-8ac1-220ddd7a3323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:13.988981 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3bc8a-cff0-4edd-8ac1-220ddd7a3323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:13.990105 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3bc8a-cff0-4edd-8ac1-220ddd7a3323 admin admin] PATH_INFO: `/v3/projects/5ac954ff763f42808add8c1be5baafb9` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:13.991808 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3bc8a-cff0-4edd-8ac1-220ddd7a3323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ac954ff763f42808add8c1be5baafb9)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:13.993809 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3bc8a-cff0-4edd-8ac1-220ddd7a3323 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:14.041967 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-32a3bc8a-cff0-4edd-8ac1-220ddd7a3323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ac954ff763f42808add8c1be5baafb9', 'request_id': 'req-32a3bc8a-cff0-4edd-8ac1-220ddd7a3323'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:14.047662 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-32a3bc8a-cff0-4edd-8ac1-220ddd7a3323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ac954ff763f42808add8c1be5baafb9', 'request_id': 'req-32a3bc8a-cff0-4edd-8ac1-220ddd7a3323'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:14.054411 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-32a3bc8a-cff0-4edd-8ac1-220ddd7a3323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ac954ff763f42808add8c1be5baafb9', 'request_id': 'req-32a3bc8a-cff0-4edd-8ac1-220ddd7a3323'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:14.066560 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-32a3bc8a-cff0-4edd-8ac1-220ddd7a3323 admin admin] The token cache is being invalidate because project 5ac954ff763f42808add8c1be5baafb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:24:14.066843 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-32a3bc8a-cff0-4edd-8ac1-220ddd7a3323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:14.068358 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-32a3bc8a-cff0-4edd-8ac1-220ddd7a3323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:24:14.070118 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1449/2893] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:24:13 2022] DELETE /identity/v3/projects/5ac954ff763f42808add8c1be5baafb9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:24:14.075255 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a093f-f112-406a-934b-83ed08ef056e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:14.075541 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a093f-f112-406a-934b-83ed08ef056e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:14.075811 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a093f-f112-406a-934b-83ed08ef056e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:14.094751 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-396a093f-f112-406a-934b-83ed08ef056e None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:24:14.095973 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-396a093f-f112-406a-934b-83ed08ef056e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:14.112217 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:24:14.157505 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1445/2894] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:24:14.166455 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f957f3-c3fc-4e59-bd31-baa4b4a81aea None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:14.166744 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f957f3-c3fc-4e59-bd31-baa4b4a81aea None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:14.167019 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f957f3-c3fc-4e59-bd31-baa4b4a81aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:14.187346 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-76f957f3-c3fc-4e59-bd31-baa4b4a81aea None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:24:14.188550 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-76f957f3-c3fc-4e59-bd31-baa4b4a81aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:14.198017 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1450/2895] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:24:14.202358 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a093f-f112-406a-934b-83ed08ef056e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:14.212639 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a093f-f112-406a-934b-83ed08ef056e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:14.217200 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c471dc0-2baa-4b09-9b00-fde45390d330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:14.217792 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c471dc0-2baa-4b09-9b00-fde45390d330 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:14.218070 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c471dc0-2baa-4b09-9b00-fde45390d330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:14.218341 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c471dc0-2baa-4b09-9b00-fde45390d330 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:14.218979 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c471dc0-2baa-4b09-9b00-fde45390d330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 07:24:14.219312 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c471dc0-2baa-4b09-9b00-fde45390d330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:14.220885 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c471dc0-2baa-4b09-9b00-fde45390d330 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:14.232792 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1446/2896] 10.222.0.40 () {58 vars in 1153 bytes} [Tue Aug 9 07:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 07:24:14.236734 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f957f3-c3fc-4e59-bd31-baa4b4a81aea None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:14.247006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f957f3-c3fc-4e59-bd31-baa4b4a81aea None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:14.251930 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5304e-6fd0-4b57-bd85-c3b3588c7263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:14.252922 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5304e-6fd0-4b57-bd85-c3b3588c7263 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:14.252922 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5304e-6fd0-4b57-bd85-c3b3588c7263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:14.252922 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5304e-6fd0-4b57-bd85-c3b3588c7263 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:14.253576 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5304e-6fd0-4b57-bd85-c3b3588c7263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:14.256181 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5304e-6fd0-4b57-bd85-c3b3588c7263 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:14.283997 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1451/2897] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:24:14 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:24:14.288795 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c471dc0-2baa-4b09-9b00-fde45390d330 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:14.298919 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c471dc0-2baa-4b09-9b00-fde45390d330 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:14.356822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01280b-a76d-4f13-ab16-9f1234677442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:14.357419 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01280b-a76d-4f13-ab16-9f1234677442 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:14.357697 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01280b-a76d-4f13-ab16-9f1234677442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:14.357967 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01280b-a76d-4f13-ab16-9f1234677442 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:14.358573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01280b-a76d-4f13-ab16-9f1234677442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:14.360495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01280b-a76d-4f13-ab16-9f1234677442 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:14.381955 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1447/2898] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:24:14 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:24:14.386032 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5304e-6fd0-4b57-bd85-c3b3588c7263 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:14.396690 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5304e-6fd0-4b57-bd85-c3b3588c7263 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:14.401344 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c42afb-0576-4898-bdff-9bd7544efd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:14.401932 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c42afb-0576-4898-bdff-9bd7544efd96 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:14.402211 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c42afb-0576-4898-bdff-9bd7544efd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:14.402483 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c42afb-0576-4898-bdff-9bd7544efd96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:14.403148 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c42afb-0576-4898-bdff-9bd7544efd96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:14.404717 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c42afb-0576-4898-bdff-9bd7544efd96 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:14.414964 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1452/2899] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:24:14.418863 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01280b-a76d-4f13-ab16-9f1234677442 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:14.428708 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01280b-a76d-4f13-ab16-9f1234677442 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:14.433342 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ec174-0bcf-44bb-86cc-47eb1aa75b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:14.433935 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ec174-0bcf-44bb-86cc-47eb1aa75b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:14.434214 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ec174-0bcf-44bb-86cc-47eb1aa75b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:14.434485 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ec174-0bcf-44bb-86cc-47eb1aa75b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:14.435153 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ec174-0bcf-44bb-86cc-47eb1aa75b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:14.436759 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ec174-0bcf-44bb-86cc-47eb1aa75b93 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:14.447724 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1448/2900] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:24:14.451714 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c42afb-0576-4898-bdff-9bd7544efd96 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:14.462366 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c42afb-0576-4898-bdff-9bd7544efd96 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:14.466945 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11285be1-ad12-4f33-80f6-e5ae95523c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:14.467697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11285be1-ad12-4f33-80f6-e5ae95523c8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:14.468003 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11285be1-ad12-4f33-80f6-e5ae95523c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:14.468223 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11285be1-ad12-4f33-80f6-e5ae95523c8f admin admin] PATH_INFO: `/v3/projects/bc16db01905b4f9b8cdaa075a659ddc7/users/b271bd30490e40cf9cc9831fea68d8cd/roles/decfb257a46442b8b4637f8c95c9967b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:14.484097 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11285be1-ad12-4f33-80f6-e5ae95523c8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc16db01905b4f9b8cdaa075a659ddc7, user_id=b271bd30490e40cf9cc9831fea68d8cd, role_id=decfb257a46442b8b4637f8c95c9967b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:14.486784 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11285be1-ad12-4f33-80f6-e5ae95523c8f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:14.500008 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1453/2901] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:24:14 2022] PUT /identity/v3/projects/bc16db01905b4f9b8cdaa075a659ddc7/users/b271bd30490e40cf9cc9831fea68d8cd/roles/decfb257a46442b8b4637f8c95c9967b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:24:14.505557 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3648b-e3f5-47d9-9b03-fc07b61127b1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:14.505882 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3648b-e3f5-47d9-9b03-fc07b61127b1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:14.506158 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3648b-e3f5-47d9-9b03-fc07b61127b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:14.525136 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e0e3648b-e3f5-47d9-9b03-fc07b61127b1 None None] MFA Rules not processed for user `bcf6cd86a276482e8265d5687ef8c40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:24:14.526329 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e0e3648b-e3f5-47d9-9b03-fc07b61127b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:14.583858 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1449/2902] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:24:14.593366 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11285be1-ad12-4f33-80f6-e5ae95523c8f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:14.595044 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-11285be1-ad12-4f33-80f6-e5ae95523c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:14.616841 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:24:14.654505 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11285be1-ad12-4f33-80f6-e5ae95523c8f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:14.658119 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f808e-dfec-4cbd-bd9d-5ccb235312e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:14.658712 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f808e-dfec-4cbd-bd9d-5ccb235312e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:14.659006 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f808e-dfec-4cbd-bd9d-5ccb235312e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:14.659293 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f808e-dfec-4cbd-bd9d-5ccb235312e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:14.668259 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f808e-dfec-4cbd-bd9d-5ccb235312e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:14.669665 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f808e-dfec-4cbd-bd9d-5ccb235312e5 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:14.679782 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1454/2903] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:24:18.466307 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378bd12-9fa3-48cd-8585-870218954066 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:18.467353 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378bd12-9fa3-48cd-8585-870218954066 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:18.467848 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378bd12-9fa3-48cd-8585-870218954066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:18.500765 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7378bd12-9fa3-48cd-8585-870218954066 None None] MFA Rules not processed for user `b271bd30490e40cf9cc9831fea68d8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:24:18.502321 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7378bd12-9fa3-48cd-8585-870218954066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:18.524169 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:24:18.581650 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1450/2904] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:24:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:24:18.596235 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f808e-dfec-4cbd-bd9d-5ccb235312e5 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:18.606501 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f808e-dfec-4cbd-bd9d-5ccb235312e5 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:18.611180 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871790ef-cbcb-4f69-ba64-6cef7688d40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:18.611785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871790ef-cbcb-4f69-ba64-6cef7688d40c admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:18.612059 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871790ef-cbcb-4f69-ba64-6cef7688d40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:18.612324 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871790ef-cbcb-4f69-ba64-6cef7688d40c admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:18.612955 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871790ef-cbcb-4f69-ba64-6cef7688d40c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:18.615149 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871790ef-cbcb-4f69-ba64-6cef7688d40c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:18.647565 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1455/2905] 10.222.0.40 () {60 vars in 1153 bytes} [Tue Aug 9 07:24:18 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:24:18.651642 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378bd12-9fa3-48cd-8585-870218954066 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:18.669439 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378bd12-9fa3-48cd-8585-870218954066 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:18.732104 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70c4b1-ea4d-4afc-8d12-37c382707975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:18.732720 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70c4b1-ea4d-4afc-8d12-37c382707975 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:18.732993 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70c4b1-ea4d-4afc-8d12-37c382707975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:18.733257 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70c4b1-ea4d-4afc-8d12-37c382707975 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:18.733872 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70c4b1-ea4d-4afc-8d12-37c382707975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:18.735821 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70c4b1-ea4d-4afc-8d12-37c382707975 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:18.759305 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1451/2906] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Aug 9 07:24:18 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 07:24:18.763397 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871790ef-cbcb-4f69-ba64-6cef7688d40c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:18.774353 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871790ef-cbcb-4f69-ba64-6cef7688d40c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:18.779004 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910e5d5-9fb6-4e8d-9a21-44e3c68a0bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:18.779657 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910e5d5-9fb6-4e8d-9a21-44e3c68a0bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:18.779936 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910e5d5-9fb6-4e8d-9a21-44e3c68a0bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:18.780199 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910e5d5-9fb6-4e8d-9a21-44e3c68a0bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:18.780959 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910e5d5-9fb6-4e8d-9a21-44e3c68a0bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:18.782568 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910e5d5-9fb6-4e8d-9a21-44e3c68a0bd6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:18.793911 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1456/2907] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 07:24:18.797954 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70c4b1-ea4d-4afc-8d12-37c382707975 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:18.809084 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70c4b1-ea4d-4afc-8d12-37c382707975 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:18.813906 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae873b-5436-4d15-a835-13631705b0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:18.814551 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae873b-5436-4d15-a835-13631705b0e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:18.814823 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae873b-5436-4d15-a835-13631705b0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:18.815125 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae873b-5436-4d15-a835-13631705b0e9 admin admin] PATH_INFO: `/v3/projects/12ca8e81af884e2a976ee638b4d855ff/users/c35de9bb9df8475facfcddbbe70ccda0/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:18.831768 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae873b-5436-4d15-a835-13631705b0e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ca8e81af884e2a976ee638b4d855ff, user_id=c35de9bb9df8475facfcddbbe70ccda0, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:18.834816 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae873b-5436-4d15-a835-13631705b0e9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:18.848406 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1452/2908] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:24:18 2022] PUT /identity/v3/projects/12ca8e81af884e2a976ee638b4d855ff/users/c35de9bb9df8475facfcddbbe70ccda0/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:24:18.852903 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910e5d5-9fb6-4e8d-9a21-44e3c68a0bd6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:18.866247 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910e5d5-9fb6-4e8d-9a21-44e3c68a0bd6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:18.927702 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee796b5-bda9-496d-8aaa-964b52722046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:18.928294 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee796b5-bda9-496d-8aaa-964b52722046 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:18.928568 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee796b5-bda9-496d-8aaa-964b52722046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:18.928834 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee796b5-bda9-496d-8aaa-964b52722046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:18.929464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee796b5-bda9-496d-8aaa-964b52722046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:18.931060 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee796b5-bda9-496d-8aaa-964b52722046 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:18.940494 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1457/2909] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Aug 9 07:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 07:24:18.945076 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae873b-5436-4d15-a835-13631705b0e9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:18.954956 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae873b-5436-4d15-a835-13631705b0e9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:18.959592 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce60aa-16da-45bc-a19e-f1e38e2f564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:18.960224 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce60aa-16da-45bc-a19e-f1e38e2f564f admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:18.960501 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce60aa-16da-45bc-a19e-f1e38e2f564f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:18.960769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce60aa-16da-45bc-a19e-f1e38e2f564f admin admin] PATH_INFO: `/v3/projects/12ca8e81af884e2a976ee638b4d855ff/users/c35de9bb9df8475facfcddbbe70ccda0/roles/9e31b186d8d94a4abeb35be6dfd4ab24` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:18.962637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce60aa-16da-45bc-a19e-f1e38e2f564f admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ca8e81af884e2a976ee638b4d855ff, user_id=c35de9bb9df8475facfcddbbe70ccda0, role_id=9e31b186d8d94a4abeb35be6dfd4ab24)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:18.965254 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce60aa-16da-45bc-a19e-f1e38e2f564f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:18.975681 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1453/2910] 10.222.0.40 () {60 vars in 1483 bytes} [Tue Aug 9 07:24:18 2022] PUT /identity/v3/projects/12ca8e81af884e2a976ee638b4d855ff/users/c35de9bb9df8475facfcddbbe70ccda0/roles/9e31b186d8d94a4abeb35be6dfd4ab24 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:24:23.269350 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb7f33-e815-4323-9b19-5ad95713bba5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:23.269831 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb7f33-e815-4323-9b19-5ad95713bba5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:23.270022 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb7f33-e815-4323-9b19-5ad95713bba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:23.320750 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f0bb7f33-e815-4323-9b19-5ad95713bba5 None None] MFA Rules not processed for user `c35de9bb9df8475facfcddbbe70ccda0`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:24:23.322776 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f0bb7f33-e815-4323-9b19-5ad95713bba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:23.420753 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1458/2911] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:24:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:24:23.432951 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce60aa-16da-45bc-a19e-f1e38e2f564f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:23.434785 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3cce60aa-16da-45bc-a19e-f1e38e2f564f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:23.532854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce60aa-16da-45bc-a19e-f1e38e2f564f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:23.538372 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a406a-1e41-41cf-9da5-b54b1b4a16cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44c764958784616b8bdbf59e5692ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:23.539753 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a406a-1e41-41cf-9da5-b54b1b4a16cb service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:23.540037 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a406a-1e41-41cf-9da5-b54b1b4a16cb service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:23.540310 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a406a-1e41-41cf-9da5-b54b1b4a16cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:23.544822 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:24:23.608933 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a406a-1e41-41cf-9da5-b54b1b4a16cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:23.610426 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a406a-1e41-41cf-9da5-b54b1b4a16cb service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:23.627325 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1454/2912] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:24:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 07:24:23.768311 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8535fb-5799-4014-a1cc-b133cc69d39a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:23.768712 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8535fb-5799-4014-a1cc-b133cc69d39a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:23.769048 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8535fb-5799-4014-a1cc-b133cc69d39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:23.791955 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:24:23.830832 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-df8535fb-5799-4014-a1cc-b133cc69d39a None None] MFA Rules not processed for user `664e4353726c42c9bfb80b1701d35aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:24:23.832185 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-df8535fb-5799-4014-a1cc-b133cc69d39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:23.914429 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1459/2913] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Aug 9 07:24:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:24:23.966827 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a406a-1e41-41cf-9da5-b54b1b4a16cb service glance] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:23.968992 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f40a406a-1e41-41cf-9da5-b54b1b4a16cb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:24.063932 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a406a-1e41-41cf-9da5-b54b1b4a16cb service glance] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:24.070130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b562480-f914-466c-ae14-659ba156efc2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f19a17424c44eea58efb957246cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:24.070724 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b562480-f914-466c-ae14-659ba156efc2 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:24.070995 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b562480-f914-466c-ae14-659ba156efc2 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:24.071316 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b562480-f914-466c-ae14-659ba156efc2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:24.079069 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b562480-f914-466c-ae14-659ba156efc2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:24.080655 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b562480-f914-466c-ae14-659ba156efc2 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:24.089165 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1455/2914] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Aug 9 07:24:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 07:24:32.405991 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343541f6-330e-40a8-991f-04092f0e74ad None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:32.406531 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343541f6-330e-40a8-991f-04092f0e74ad None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:32.406649 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343541f6-330e-40a8-991f-04092f0e74ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:32.425736 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-343541f6-330e-40a8-991f-04092f0e74ad None None] MFA Rules not processed for user `b271bd30490e40cf9cc9831fea68d8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:24:32.427785 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-343541f6-330e-40a8-991f-04092f0e74ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:32.434632 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1460/2915] 10.222.0.40 () {58 vars in 958 bytes} [Tue Aug 9 07:24:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:24:32.474209 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b562480-f914-466c-ae14-659ba156efc2 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:32.483495 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b562480-f914-466c-ae14-659ba156efc2 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:32.487064 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1028d-455a-4182-8a73-d69e91bf36e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e44c764958784616b8bdbf59e5692ca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:32.487668 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1028d-455a-4182-8a73-d69e91bf36e8 service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:32.487942 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1028d-455a-4182-8a73-d69e91bf36e8 service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:32.488208 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1028d-455a-4182-8a73-d69e91bf36e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:32.490542 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fed1028d-455a-4182-8a73-d69e91bf36e8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:32.560054 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1028d-455a-4182-8a73-d69e91bf36e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:32.561466 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1028d-455a-4182-8a73-d69e91bf36e8 service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:32.567055 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:24:32.572888 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1456/2916] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:24:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:24:33.114611 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343541f6-330e-40a8-991f-04092f0e74ad None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:33.115999 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-343541f6-330e-40a8-991f-04092f0e74ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:33.173860 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343541f6-330e-40a8-991f-04092f0e74ad None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:33.177727 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b1ee5-b051-499e-97a2-5793f1780a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:33.178326 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b1ee5-b051-499e-97a2-5793f1780a81 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:33.178599 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b1ee5-b051-499e-97a2-5793f1780a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:33.178864 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b1ee5-b051-499e-97a2-5793f1780a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:33.180597 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b74b1ee5-b051-499e-97a2-5793f1780a81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:33.194951 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b1ee5-b051-499e-97a2-5793f1780a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:33.196378 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b1ee5-b051-499e-97a2-5793f1780a81 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:33.207332 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1461/2917] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:24:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:24:34.376968 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31de4f-00dd-45cb-8b54-14854322efa6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:34.377527 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31de4f-00dd-45cb-8b54-14854322efa6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:34.377908 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31de4f-00dd-45cb-8b54-14854322efa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:34.398359 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9d31de4f-00dd-45cb-8b54-14854322efa6 None None] MFA Rules not processed for user `664e4353726c42c9bfb80b1701d35aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:24:34.399681 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9d31de4f-00dd-45cb-8b54-14854322efa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:24:34.407346 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1457/2918] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Aug 9 07:24:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:24:34.420464 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b1ee5-b051-499e-97a2-5793f1780a81 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:34.431922 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b1ee5-b051-499e-97a2-5793f1780a81 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:34.436900 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da330d-c8ed-4d6c-b3a7-6acc80f14793 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f19a17424c44eea58efb957246cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:34.437442 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da330d-c8ed-4d6c-b3a7-6acc80f14793 service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:34.437717 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da330d-c8ed-4d6c-b3a7-6acc80f14793 service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:34.437984 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da330d-c8ed-4d6c-b3a7-6acc80f14793 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:34.446888 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da330d-c8ed-4d6c-b3a7-6acc80f14793 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:34.448535 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da330d-c8ed-4d6c-b3a7-6acc80f14793 service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:34.456429 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1462/2919] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Aug 9 07:24:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 07:24:44.392868 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:24:44.453210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=70 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:24:58.201991 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31de4f-00dd-45cb-8b54-14854322efa6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:24:58.211843 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31de4f-00dd-45cb-8b54-14854322efa6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:24:58.215381 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13d3f0-a3ed-44c4-b5de-9cb81c4bb72e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:24:58.215967 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13d3f0-a3ed-44c4-b5de-9cb81c4bb72e service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:24:58.216239 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13d3f0-a3ed-44c4-b5de-9cb81c4bb72e service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:24:58.216503 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13d3f0-a3ed-44c4-b5de-9cb81c4bb72e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:24:58.225731 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13d3f0-a3ed-44c4-b5de-9cb81c4bb72e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:24:58.227196 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13d3f0-a3ed-44c4-b5de-9cb81c4bb72e service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:24:58.236342 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1458/2920] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:24:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:25:08.232253 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:25:10.420382 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da330d-c8ed-4d6c-b3a7-6acc80f14793 service swift] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:25:10.430996 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da330d-c8ed-4d6c-b3a7-6acc80f14793 service swift] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:25:10.434634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04481386-784f-4bb4-849f-f71903d39ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d75da9360ef490f910fabc3920c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:25:10.435286 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04481386-784f-4bb4-849f-f71903d39ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:25:10.435563 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04481386-784f-4bb4-849f-f71903d39ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:25:10.435834 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04481386-784f-4bb4-849f-f71903d39ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:25:10.437543 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-04481386-784f-4bb4-849f-f71903d39ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:25:10.447758 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04481386-784f-4bb4-849f-f71903d39ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:25:10.449152 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04481386-784f-4bb4-849f-f71903d39ab3 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:25:10.456989 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1463/2921] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:25:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:25:20.453519 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:27:18.202700 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13d3f0-a3ed-44c4-b5de-9cb81c4bb72e service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:27:18.204343 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ff13d3f0-a3ed-44c4-b5de-9cb81c4bb72e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:27:18.340088 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13d3f0-a3ed-44c4-b5de-9cb81c4bb72e service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:27:18.347563 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508592f-3ee6-4035-acc5-a3df59db7381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e949d9666be44a0b6122d510168c7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:27:18.348368 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508592f-3ee6-4035-acc5-a3df59db7381 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:27:18.348703 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508592f-3ee6-4035-acc5-a3df59db7381 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:27:18.349118 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508592f-3ee6-4035-acc5-a3df59db7381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:27:18.351169 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d508592f-3ee6-4035-acc5-a3df59db7381 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:27:18.365443 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508592f-3ee6-4035-acc5-a3df59db7381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:27:18.367986 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508592f-3ee6-4035-acc5-a3df59db7381 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:27:18.387251 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1459/2922] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:27:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:27:27.068877 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2becc2-3e4e-40b7-bb95-ada91c637f2a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:27:27.069327 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2becc2-3e4e-40b7-bb95-ada91c637f2a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:27:27.069432 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2becc2-3e4e-40b7-bb95-ada91c637f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:27:27.097842 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-cc2becc2-3e4e-40b7-bb95-ada91c637f2a None None] MFA Rules not processed for user `664e4353726c42c9bfb80b1701d35aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 07:27:27.099033 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cc2becc2-3e4e-40b7-bb95-ada91c637f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:27:27.106062 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1464/2923] 10.222.0.40 () {58 vars in 967 bytes} [Tue Aug 9 07:27:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 07:27:27.146946 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508592f-3ee6-4035-acc5-a3df59db7381 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:27:27.158091 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508592f-3ee6-4035-acc5-a3df59db7381 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:27:27.162890 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2d7b6-62ff-446d-819a-ca735084e634 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f19a17424c44eea58efb957246cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:27:27.163507 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2d7b6-62ff-446d-819a-ca735084e634 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:27:27.163780 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2d7b6-62ff-446d-819a-ca735084e634 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:27:27.164046 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2d7b6-62ff-446d-819a-ca735084e634 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:27:27.172047 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2d7b6-62ff-446d-819a-ca735084e634 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:27:27.173594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2d7b6-62ff-446d-819a-ca735084e634 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:27:27.181838 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1460/2924] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Aug 9 07:27:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 07:27:33.715526 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2becc2-3e4e-40b7-bb95-ada91c637f2a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:27:33.716924 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cc2becc2-3e4e-40b7-bb95-ada91c637f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:27:33.768769 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2d7b6-62ff-446d-819a-ca735084e634 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:27:33.822271 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2becc2-3e4e-40b7-bb95-ada91c637f2a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:27:33.827375 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46152d66-a2fb-4850-960e-532c3663ec2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07d2ee351e734fd09938cea9be3bb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:27:33.828121 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46152d66-a2fb-4850-960e-532c3663ec2c service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:27:33.828403 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46152d66-a2fb-4850-960e-532c3663ec2c service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:27:33.828672 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46152d66-a2fb-4850-960e-532c3663ec2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:27:33.830391 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-46152d66-a2fb-4850-960e-532c3663ec2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:27:33.842001 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46152d66-a2fb-4850-960e-532c3663ec2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:27:33.843541 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46152d66-a2fb-4850-960e-532c3663ec2c service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:27:33.853964 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2d7b6-62ff-446d-819a-ca735084e634 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:27:33.854212 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1465/2925] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:27:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:27:33.858845 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5211d-0b69-45ed-ac9f-2f186be31914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:27:33.859566 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5211d-0b69-45ed-ac9f-2f186be31914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:27:33.859840 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5211d-0b69-45ed-ac9f-2f186be31914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:27:33.860107 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5211d-0b69-45ed-ac9f-2f186be31914 admin admin] PATH_INFO: `/v3/users/b271bd30490e40cf9cc9831fea68d8cd` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:27:33.861211 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5211d-0b69-45ed-ac9f-2f186be31914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b271bd30490e40cf9cc9831fea68d8cd)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:27:33.863130 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5211d-0b69-45ed-ac9f-2f186be31914 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:27:33.907573 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:27:33.910370 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7ff5211d-0b69-45ed-ac9f-2f186be31914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b271bd30490e40cf9cc9831fea68d8cd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:33.911494 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7ff5211d-0b69-45ed-ac9f-2f186be31914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b271bd30490e40cf9cc9831fea68d8cd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:33.912299 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7ff5211d-0b69-45ed-ac9f-2f186be31914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b271bd30490e40cf9cc9831fea68d8cd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:33.919588 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7ff5211d-0b69-45ed-ac9f-2f186be31914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b271bd30490e40cf9cc9831fea68d8cd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:33.926328 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7ff5211d-0b69-45ed-ac9f-2f186be31914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b271bd30490e40cf9cc9831fea68d8cd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:33.944238 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1461/2926] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:27:33 2022] DELETE /identity/v3/users/b271bd30490e40cf9cc9831fea68d8cd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 07:27:34.116971 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46152d66-a2fb-4850-960e-532c3663ec2c service placement] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:27:34.127890 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46152d66-a2fb-4850-960e-532c3663ec2c service placement] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:27:34.186075 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6786966-e528-4572-ae6f-fdb3d26ab7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:27:34.186693 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786966-e528-4572-ae6f-fdb3d26ab7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:27:34.186968 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786966-e528-4572-ae6f-fdb3d26ab7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:27:34.187269 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786966-e528-4572-ae6f-fdb3d26ab7ca admin admin] PATH_INFO: `/v3/projects/bc16db01905b4f9b8cdaa075a659ddc7` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:27:34.188418 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6786966-e528-4572-ae6f-fdb3d26ab7ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc16db01905b4f9b8cdaa075a659ddc7)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:27:34.190282 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6786966-e528-4572-ae6f-fdb3d26ab7ca admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:27:34.235558 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a6786966-e528-4572-ae6f-fdb3d26ab7ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc16db01905b4f9b8cdaa075a659ddc7', 'request_id': 'req-a6786966-e528-4572-ae6f-fdb3d26ab7ca'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:34.239995 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:27:34.241303 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a6786966-e528-4572-ae6f-fdb3d26ab7ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc16db01905b4f9b8cdaa075a659ddc7', 'request_id': 'req-a6786966-e528-4572-ae6f-fdb3d26ab7ca'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:34.248872 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a6786966-e528-4572-ae6f-fdb3d26ab7ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc16db01905b4f9b8cdaa075a659ddc7', 'request_id': 'req-a6786966-e528-4572-ae6f-fdb3d26ab7ca'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:34.277791 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a6786966-e528-4572-ae6f-fdb3d26ab7ca admin admin] The token cache is being invalidate because project bc16db01905b4f9b8cdaa075a659ddc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:27:34.278078 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a6786966-e528-4572-ae6f-fdb3d26ab7ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:34.278697 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a6786966-e528-4572-ae6f-fdb3d26ab7ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:34.280217 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1466/2927] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:27:34 2022] DELETE /identity/v3/projects/bc16db01905b4f9b8cdaa075a659ddc7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:27:34.284120 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5211d-0b69-45ed-ac9f-2f186be31914 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:27:34.285500 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7ff5211d-0b69-45ed-ac9f-2f186be31914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:27:34.298854 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5211d-0b69-45ed-ac9f-2f186be31914 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:27:34.354700 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25f6a4-2a27-4430-8cc9-e35aec5c4af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:27:34.355361 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25f6a4-2a27-4430-8cc9-e35aec5c4af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:27:34.355637 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25f6a4-2a27-4430-8cc9-e35aec5c4af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:27:34.355907 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25f6a4-2a27-4430-8cc9-e35aec5c4af9 admin admin] PATH_INFO: `/v3/users/c35de9bb9df8475facfcddbbe70ccda0` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:27:34.357034 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25f6a4-2a27-4430-8cc9-e35aec5c4af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c35de9bb9df8475facfcddbbe70ccda0)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:27:34.358934 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25f6a4-2a27-4430-8cc9-e35aec5c4af9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:27:34.416667 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0e25f6a4-2a27-4430-8cc9-e35aec5c4af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c35de9bb9df8475facfcddbbe70ccda0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:34.417238 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0e25f6a4-2a27-4430-8cc9-e35aec5c4af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c35de9bb9df8475facfcddbbe70ccda0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:34.417860 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0e25f6a4-2a27-4430-8cc9-e35aec5c4af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c35de9bb9df8475facfcddbbe70ccda0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:34.424594 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0e25f6a4-2a27-4430-8cc9-e35aec5c4af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c35de9bb9df8475facfcddbbe70ccda0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:34.433242 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0e25f6a4-2a27-4430-8cc9-e35aec5c4af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c35de9bb9df8475facfcddbbe70ccda0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:34.451042 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1462/2928] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Aug 9 07:27:34 2022] DELETE /identity/v3/users/c35de9bb9df8475facfcddbbe70ccda0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:27:34.622409 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6786966-e528-4572-ae6f-fdb3d26ab7ca admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:27:34.623956 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a6786966-e528-4572-ae6f-fdb3d26ab7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:27:34.641583 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6786966-e528-4572-ae6f-fdb3d26ab7ca admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:27:34.703077 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc61118-5b9c-4735-9ecd-26fd91bf44ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcf6cd86a276482e8265d5687ef8c40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7517e8deb7c2455e89af98b08782ec1d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:27:34.703656 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc61118-5b9c-4735-9ecd-26fd91bf44ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:27:34.703936 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc61118-5b9c-4735-9ecd-26fd91bf44ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:27:34.704210 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc61118-5b9c-4735-9ecd-26fd91bf44ee admin admin] PATH_INFO: `/v3/projects/12ca8e81af884e2a976ee638b4d855ff` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:27:34.705328 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc61118-5b9c-4735-9ecd-26fd91bf44ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ca8e81af884e2a976ee638b4d855ff)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:27:34.707250 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc61118-5b9c-4735-9ecd-26fd91bf44ee admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:27:34.754435 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-abc61118-5b9c-4735-9ecd-26fd91bf44ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ca8e81af884e2a976ee638b4d855ff', 'request_id': 'req-abc61118-5b9c-4735-9ecd-26fd91bf44ee'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:34.760669 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-abc61118-5b9c-4735-9ecd-26fd91bf44ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ca8e81af884e2a976ee638b4d855ff', 'request_id': 'req-abc61118-5b9c-4735-9ecd-26fd91bf44ee'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:34.766634 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-abc61118-5b9c-4735-9ecd-26fd91bf44ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ca8e81af884e2a976ee638b4d855ff', 'request_id': 'req-abc61118-5b9c-4735-9ecd-26fd91bf44ee'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:34.779728 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-abc61118-5b9c-4735-9ecd-26fd91bf44ee admin admin] The token cache is being invalidate because project 12ca8e81af884e2a976ee638b4d855ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 07:27:34.780039 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-abc61118-5b9c-4735-9ecd-26fd91bf44ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:34.780640 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-abc61118-5b9c-4735-9ecd-26fd91bf44ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 07:27:34.782104 dv-cinder-852514-1-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1467/2929] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Aug 9 07:27:34 2022] DELETE /identity/v3/projects/12ca8e81af884e2a976ee638b4d855ff => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 07:27:44.447484 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:27:44.776779 dv-cinder-852514-1-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=61,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:28:11.718222 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25f6a4-2a27-4430-8cc9-e35aec5c4af9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 07:28:11.719672 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0e25f6a4-2a27-4430-8cc9-e35aec5c4af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:28:11.787189 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25f6a4-2a27-4430-8cc9-e35aec5c4af9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 07:28:11.844915 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df972019-813d-49ad-aae0-a711ca53227f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07d2ee351e734fd09938cea9be3bb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '342524b45def418783374ff6733e94b9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 07:28:11.845516 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df972019-813d-49ad-aae0-a711ca53227f service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 07:28:11.845789 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df972019-813d-49ad-aae0-a711ca53227f service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 07:28:11.846053 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df972019-813d-49ad-aae0-a711ca53227f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 07:28:11.847766 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-df972019-813d-49ad-aae0-a711ca53227f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 07:28:11.859138 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df972019-813d-49ad-aae0-a711ca53227f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 07:28:11.860689 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df972019-813d-49ad-aae0-a711ca53227f service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 07:28:11.870194 dv-cinder-852514-1-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1463/2930] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Aug 9 07:28:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 07:28:21.866160 dv-cinder-852514-1-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=58 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}